Affiliation:
1. University of Wisconsin-Madison
2. Google Inc.
Abstract
This paper introduces DIAMetrics: a novel framework for end-to-end benchmarking and performance monitoring of query engines. DIAMetrics consists of a number of components supporting tasks such as automated workload summarization, data anonymization, benchmark execution, monitoring, regression identification, and alerting. The architecture of DIAMetrics is highly modular and supports multiple systems by abstracting their implementation details and relying on common canonical formats and pluggable software drivers. The end result is a powerful unified framework that is capable of supporting every aspect of benchmarking production systems and workloads. DIAMetrics has been developed in Google and is being used to benchmark various internal query engines. In this paper, we give an overview of DIAMetrics and discuss its design and implementation. Furthermore, we provide details about its deployment and example use cases. Given the variety of supported systems and use cases within Google, we argue that its core concepts can be used more widely to enable comparative end-to-end benchmarking in other industrial environments.
Publisher
Association for Computing Machinery (ACM)
Subject
Information Systems,Software
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Using eBPF for Database Workload Tracing: An Explorative Study;Companion of the 2023 ACM/SPEC International Conference on Performance Engineering;2023-04-15
2. Raven: Benchmarking Monetary Expense and Query Efficiency of OLAP Engines on the Cloud;Database Systems for Advanced Applications;2023
3. DBMS annihilator;Proceedings of the VLDB Endowment;2022-08
4. Doppler;Proceedings of the VLDB Endowment;2022-08