Affiliation:
1. Department of Computer Science, University of California
Abstract
We present incremental view maintenance algorithms for a data warehouse derived from multiple distributed autonomous data sources. We begin with a detailed framework for analyzing view maintenance algorithms for multiple data sources with concurrent updates. Earlier approaches for view maintenance in the presence of concurrent updates typically require two types of messages: one to compute the view change due to the initial update and the other to compensate the view change due to interfering concurrent updates. The algorithms developed in this paper instead perform the compensation locally by using the information that is already available at the data warehouse. The first algorithm, termed SWEEP, ensures complete consistency of the view at the data warehouse in the presence of concurrent updates. Previous algorithms for incremental view maintenance either required a quiescent state at the data warehouse or required an exponential number of messages in terms of the data sources. In contrast, this algorithm does not require that the data warehouse be in a quiescent state for incorporating the new views and also the message complexity is linear in the number of data sources. The second algorithm, termed Nested SWEEP, attempts to compute a composite view change for multiple updates that occur concurrently while maintaining strong consistency.
Publisher
Association for Computing Machinery (ACM)
Subject
Information Systems,Software
Cited by
41 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. A Step Toward Deep Online Aggregation;Proceedings of the ACM on Management of Data;2023-06-13
2. Parallel Maintenance of Materialized Views in Large-Scale Analytic Platforms;International Journal of Organizational and Collective Intelligence;2022-07-21
3. Smarter Warehouse;2022 IEEE 38th International Conference on Data Engineering Workshops (ICDEW);2022-05
4. Towards Handling Incremental Load for Anomalies in Near Real Time Data Warehouse;WSEAS TRANSACTIONS ON SYSTEMS AND CONTROL;2020-12-07
5. Differential Data Quality Verification on Partitioned Data;2019 IEEE 35th International Conference on Data Engineering (ICDE);2019-04