OVERVIEW OF OPTIMIZATION METHODS FOR PRODUCTIVITY OF THE ETL PROCES-Reference-Cited by-同舟云学术

OVERVIEW OF OPTIMIZATION METHODS FOR PRODUCTIVITY OF THE ETL PROCES

Published:2021-12-27 Issue:4-2021 Volume: Page:556-563
ISSN:1694-8181
Container-title:The Heralds of KSUCTA, №4, 2021
language:ru
Short-container-title:The herald of KSUCTA n.a.N.Isanov

Author:

Kartanova A.Dzh.¹^ORCID,Imanbekov T.I.¹

Affiliation:

1. KSUCTA n. a. N. Isanov, Bishkek, Kyrgyz Republic

Abstract

One of the important aspects in management and acceleration of processes, operations in databases and data warehouses is ETL processes, the process of extracting, transforming and loading data. These processes without optimizing, a realization data warehouse project is costly, complex, and time-consuming. This paper provides an overview and research of methods for optimizing the performance of ETL processes; that the most important indicator of ETL system's operation is the time and speed of data processing is shown. The issues of the generalized structure of ETL process flows are considered, the architecture of ETL process optimization is proposed, and the main methods of parallel data processing in ETL systems are presented, those methods can improve its performance. The most relevant today of the problem is performance of ETL processes for data warehouses is considered in detail.

Publisher

Kyrgyz State University of Construction, Transportation and Architecture n.a. N.Isanov

Reference7 articles.

1. Inmon W. Building the Data Warehouse. – New York: John Willey & Sons, 1992.

2. Kimball R. The Data Warehouse Lifecycle Toolkit, 2nd Edition: Practical Techniques for Building Data Warehouse and Business Intelligence Systems/ Kimball R., Ross M., etc. – John Wiley & Sons, 2008.

3. Xiufeng Liu, Nadeem Iftikhar. An ETL optimization framework using partitioning and parallelization.SAC '15 Proceedings of the 30th Annual ACM Symposium on Applied Computing (pp. 1015-1022). USA: ACM New York, NY, USA ©2015.

4. Simitsis, A., Vassiliadis, P., and Sellis, T. Optimizing ETL Processes in Data Warehouses. In Proc. of ICDE, pp. 564-575, 2005.

5. S. H. A. El-Sappagh, A. M. A. Hendawi, A. H. El Bastawissy, “A proposed model for data warehouse ETL processes”, Journal of King Saud University Computer and Information Sciences, Vol. 23, No. 2, pp.91-104, 2011.