Challenges and Solutions of Real-Time Data Integration Techniques by ETL Application-Reference-Cited by-同舟云学术

Challenges and Solutions of Real-Time Data Integration Techniques by ETL Application

Published:2024-01-04 Issue: Volume: Page:348-371
ISSN:2327-3275
Container-title:Advances in Business Information Systems and Analytics
language:
Short-container-title:

Author:

Biswas Neepa¹^ORCID,Biswas Sudarsan²,Mondal Kartick Chandra³^ORCID,Maiti Suchismita¹

Affiliation:

1. Narula Institute of Technology, India

2. RCC Institute of Information Technology, India

3. Jadavpur University, India

Abstract

Business organizations are trying to focus from the traditional extract-transform-load (ETL) system towards real-time implementation of the ETL process. Traditional ETL process upgrades new data to the data warehouse (DW) at predefined time intervals when the DW is in off-line mode. Modern organizations want to capture and respond to business events faster than ever. Accessing fresh data is not possible using traditional ETL. Real-time ETL can reflect fresh data on the warehouse immediately at the occurrence of an event in the operational data store. Therefore, the key tool for business trade lies in real-time enterprise DW enabled with Business Intelligence. This study provides an overview of ETL process and its evolution towards real-time ETL. This chapter will represent the real-time ETL characteristics, its technical challenges, and some popular real-time ETL implementation methods. Finally, some future directions towards real-time ETL technology are explored.

Publisher

IGI Global

Reference53 articles.

1. A new generation of middleware solutions for a near-real-time data warehousing architecture

2. Ali, F. S. E. (2014). A survey of real-time data warehouse and ETL. International Scientific Journal of Management Information Systems, 9(3), 03-09.

3. Change data capture efficient ETL for real-time BI.;I.Ankorion;Information & Management,2005

4. Attunity. (2009). Efficient and Real Time Data Integration With Change Data Capture. An Attunity White Paper. http://download.101com.com/tdwi/ww29/attunity_efficient_and_real-time_di.pdf

5. A New Approach for Conceptual Extraction-Transformation-Loading Process Modeling