基于数据水平分割的ETL执行优化

Journal of Applied Sciences ›› 2005, Vol. 23 ›› Issue (3): 300-304.

• Articles • Previous Articles Next Articles

Optimization of ETL Execution by the Horizontal Partitioning Method

HAN Jing-yu, XU Li-zhen, DONG Yi-sheng

Department of Computer Science and Engineering, Southeast University, Nanjing 210096, China

Received:2004-01-06 Revised:2004-05-18 Online:2005-05-31 Published:2005-05-31

Abstract

Abstract: ETL is a tool suite for data loading and maintaining of data warehouse.How to efficiently shorten the ETL process execution time is a big challenge because the volume of data to be processed is very large. Four types of view horizontal patition approaches such as " single fact derived by one view", " single fact derived by many views", "many facts derived by one view" and "many facts derived by many views" are proposed to shorten the execution time.The theory and experiment result prove it to be efficient.

Key words: ETL, horizontal partition, incremental maintenance

CLC Number:

TP311

HAN Jing-yu, XU Li-zhen, DONG Yi-sheng. Optimization of ETL Execution by the Horizontal Partitioning Method[J]. Journal of Applied Sciences, 2005, 23(3): 300-304.

[1]	HE Zhengyuan, DUAN Tiantian, ZHANG Ying, ZHANG Hanwen, SUN Yi. Blockchain in Internet of Things: Application and Challenges [J]. Journal of Applied Sciences, 2020, 38(1): 22-33.
[2]	BAO Zhenshan, WANG Kaixuan, ZHANG Wenbo. A Practical Byzantine Fault Tolerance Consensus Algorithm Based on Tree Topological Network [J]. Journal of Applied Sciences, 2020, 38(1): 34-50.
[3]	ZOU Xiuqing, LUO Decun, LIN Ping, SHEN Shiping, XIE Zhenping, WANG Yujue, DING Yong. System of River Chief-Oriented Water Quality Information Certification Based on Blockchain [J]. Journal of Applied Sciences, 2020, 38(1): 65-80.
[4]	YUAN Chenjuan, SUN Guozi, LI Huakang, WANG Jitao. Credible Depository Chain System of Card Games [J]. Journal of Applied Sciences, 2020, 38(1): 81-92.
[5]	JIANG Yunchao, HE Xiaowei, CUI Yiju. Blockchain Node Storage Optimization Scheme [J]. Journal of Applied Sciences, 2020, 38(1): 119-126.
[6]	ZHANG Yifei, CAO Shaozhong, QI Deli, WANG Liang, YANG Yanhong. Book Infringement Record Depositing Platform Based on Blockchain [J]. Journal of Applied Sciences, 2020, 38(1): 184-196.
[7]	HU Bengu, DAI Muhong. Multiple-center Points Incremental Fuzzy Clustering Algorithm [J]. Journal of Applied Sciences, 2019, 37(6): 806-814.
[8]	WANG Dianlai, SU Aixia, LIU Wenping. Trend Analysis of Vegetation Cover Changes Based on Spearman Rank Correlation Coefficient [J]. Journal of Applied Sciences, 2019, 37(4): 519-528.
[9]	WANG Juquan, WANG Wei, MA Huimin, YANG Bo, DU Wen. Urban Passenger Flow Aggregation Risk Forecasting Based on Principal Component Regression Algorithm [J]. Journal of Applied Sciences, 2019, 37(4): 529-540.
[10]	FENG Yong, QU Bohao, XU Hongyan, WANG Rongbing, ZHANG Yonggang. Chinese FastText Short Text Classification Method Integrating TF-IDF and LDA [J]. Journal of Applied Sciences, 2019, 37(3): 378-388.
[11]	LI Bo, ZHENG Bo, GUO Zi-yang, WANG Hong-zhi. The State-of-the-Art Blockchain Applications in Finance: Progress and Trends [J]. Journal of Applied Sciences, 2019, 37(2): 151-163.
[12]	BIN Sheng, SUN Geng-xin, ZHOU Shuang. Public Opinion Propagation Model in Social Network Based on Blockchain [J]. Journal of Applied Sciences, 2019, 37(2): 191-202.
[13]	HOU Qi-hui, DENG Zu-qiang, ZOU Ping, WANG Qiu-sheng, LI Yan-dong, JIANG Hai-sen. DDoS Defense Method of IoT Devices Based on Blockchain [J]. Journal of Applied Sciences, 2019, 37(2): 213-223.
[14]	ZHAO Ling-qi, SONG Yu-bo, ZHANG Ke-luo, HU Ai-qun, LUO Jian. Logistics Information Privacy Protection Based on Blockchain and Hierarchical Encryption [J]. Journal of Applied Sciences, 2019, 37(2): 224-234.
[15]	YANG Min, ZHANG Shi-bin, ZHANG Hang, LIU Ning, GAN Bo. User Trust Negotiation Model Based on Two-Layer Blockchain in Heterogeneous Alliance System [J]. Journal of Applied Sciences, 2019, 37(2): 244-252.

Optimization of ETL Execution by the Horizontal Partitioning Method

PDF

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments