Abstract
Increasingly, cloud database vendors host large-scale geographically distributed clusters to provide cloud database services. When managing the clusters, we observe that it is challenging to simultaneously maximizing the resource allocation ratio and resource availability. This problem becomes more severe in modern cloud database clusters, where resource allocations occur more frequently and on a greater scale. To improve the resource allocation ratio without hurting resource availability, we introduce Eigen, a large-scale cloud-native cluster management system for large-scale databases on the cloud. Based on a resource flow model, we propose a hierarchical resource management system and three resource optimization algorithms that enable
end-to-end resource optimization.
Furthermore, we demonstrate the system optimization that promotes user experience by reducing scheduling latencies and improving scheduling throughput. Eigen has been launched in a large-scale public-cloud production environment for 30+ months and served more than 30+ regions (100+ available zones) globally. Based on the evaluation of real-world clusters and simulated experiments, Eigen can improve the allocation ratio by over 27% (from 60% to 87.0%) on average, while the ratio of delayed resource provisions is under 0.1%.
Publisher
Association for Computing Machinery (ACM)
Subject
General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development
Reference32 articles.
1. An opportunity cost approach for job assignment in a scalable computing cluster
2. Base stock policy with retrial demands
3. AWS. Amazon Aurora Serverless. https://aws.amazon.com/rds/aurora/serverless AWS. Amazon Aurora Serverless. https://aws.amazon.com/rds/aurora/serverless
4. Azure. Azure SQL Serverless. https://learn.microsoft.com/en-us/azure/azure-sql/database/serverless-tier-overview Azure. Azure SQL Serverless. https://learn.microsoft.com/en-us/azure/azure-sql/database/serverless-tier-overview
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献