Affiliation:
1. Graz University of Technology, Graz, Austria
2. Technische Universität Berlin, Berlin, Germany
Abstract
In the exploratory data science lifecycle, data scientists often spent the majority of their time finding, integrating, validating and cleaning relevant datasets. Despite recent work on data validation, and numerous error detection and correction algorithms, in practice, data cleaning for ML remains largely a manual, unpleasant, and labor-intensive trial and error process, especially in large-scale, distributed computation. The target ML application---such as classification or regression models---can be used as a signal of valuable feedback though, for selecting effective data cleaning strategies. In this paper, we introduce SAGA, a framework for automatically generating the top-K most effective data cleaning pipelines. SAGA adopts ideas from Auto-ML, feature selection, and hyper-parameter tuning. Our framework is extensible for user-provided constraints, new data cleaning primitives, and ML applications; automatically generates hybrid runtime plans of local and distributed operations; and performs pruning by interesting properties (e.g., monotonicity). Instead of full automation---which is rather unrealistic---SAGA simplifies the mechanical aspects of data cleaning. Our experiments show that SAGA yields robust accuracy improvements over state-of-the-art, and good scalability regarding increasing data sizes and number of evaluated pipelines.
Publisher
Association for Computing Machinery (ACM)
Reference128 articles.
1. Ziawasch Abedjan Lukasz Golab Felix Naumann and Thorsten Papenbrock. 2018. Data Profiling. In Synthesis Lectures on Data Management. http://sites.computer.org/debull/A18june/p3.pdf Ziawasch Abedjan Lukasz Golab Felix Naumann and Thorsten Papenbrock. 2018. Data Profiling. In Synthesis Lectures on Data Management. http://sites.computer.org/debull/A18june/p3.pdf
2. Giorgos Alexiou , George Papastefanatos , Vassilis Stamatopoulos , Georgia Koutrika , and Nectarios Koziris . 2022. QueryER: A Framework for Fast Analysis-Aware Deduplication over Dirty Data. CoRR , Vol. abs/ 2202 .01546 ( 2022 ). showeprint[arXiv]2202.01546 https://arxiv.org/abs/2202.01546 Giorgos Alexiou, George Papastefanatos, Vassilis Stamatopoulos, Georgia Koutrika, and Nectarios Koziris. 2022. QueryER: A Framework for Fast Analysis-Aware Deduplication over Dirty Data. CoRR, Vol. abs/2202.01546 (2022). showeprint[arXiv]2202.01546 https://arxiv.org/abs/2202.01546
3. ASQ/ANSI/ISO. 2015. 9001:2015: Quality management systems - Requirements. ASQ/ANSI/ISO. 2015. 9001:2015: Quality management systems - Requirements.
4. TFX