Affiliation:
1. Technion - Israel Institute of Technology, Haifa, Israel
2. CSAIL MIT, Cambridge, MA, USA
3. Hebrew University, Jerusalem, Israel
4. Duke University, Durham, USA
Abstract
SQL queries with group-by and average are frequently used and plotted as bar charts in several data analysis applications. Understanding the reasons behind the results in such an aggregate view may be a highly nontrivial and time-consuming task, especially for large datasets with multiple attributes. Hence, generating automated explanations for aggregate views can allow users to gain better insights into the results while saving time in data analysis. When providing explanations for such views, it is paramount to ensure that they are succinct yet comprehensive, reveal different types of insights that hold for different aggregate answers in the view, and, most importantly, they reflect reality and arm users to make informed data-driven decisions, i.e., the explanations do not only consider correlations but are causal. In this paper, we present CauSumX, a framework for generating summarized causal explanations for the entire aggregate view. Using background knowledge captured in a causal DAG, CauSumX finds the most effective causal treatments for different groups in the view. We formally define the framework and the optimization problem, study its complexity, and devise an efficient algorithm using the Apriori algorithm, LP rounding, and several optimizations. We experimentally show that our system generates useful summarized causal explanations compared to prior work and scales well for large high-dimensional data.
Funder
NSF
NSF Convergence Accelerator Program award
Publisher
Association for Computing Machinery (ACM)
Reference82 articles.
1. 2021. 2021 Stackoverflow Developer Survey. https://insights.stackoverflow.com/survey/2021.
2. 2021. Adult Census Income Dataset. https://www.kaggle.com/datasets/uciml/adult-census-income.
3. 2023. The 19th*. https://19thnews.org/2023/03/parenthood-stereotypes-gender-pay-gap/. Accessed: 2023-05--18.
4. 2023. OpenAI Introducing ChatGPT. https://openai.com/blog/chatgpt.
5. 2023. Viza jobs. https://vizajobs.com/what-do-technology-jobs-paysalary-insights-and-compensation-factors/.