Affiliation:
1. School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
Abstract
In recent years, Kubernetes (K8s) has become a dominant resource management and scheduling system in the cloud. In practical scenarios, short-running cloud workloads are usually scheduled through different scheduling algorithms provided by Kubernetes. For example, artificial intelligence (AI) workloads are scheduled through different Volcano scheduling algorithms, such as GANG_MRP, GANG_LRP, and GANG_BRA. One key challenge is that the selection of scheduling algorithms has considerable impacts on job performance results. However, it takes a prohibitively long time to select the optimal algorithm because applying one algorithm in one single job may take a few minutes to complete. This poses the urgent requirement of a simulator that can quickly evaluate the performance impacts of different algorithms, while also considering scheduling-related factors, such as cluster resources, job structures and scheduler configurations. In this paper, we design and implement a Kubernetes simulator called K8sSim, which incorporates typical Kubernetes and Volcano scheduling algorithms for both generic and AI workloads, and provides an accurate simulation of their scheduling process in real clusters. We use real cluster traces from Alibaba to evaluate the effectiveness of K8sSim, and the evaluation results show that (i) compared to the real cluster, K8sSim can accurately evaluate the performance of different scheduling algorithms with similar CloseRate (a novel metric we define to intuitively show the simulation accuracy), and (ii) it can also quickly obtain the scheduling results of different scheduling algorithms by accelerating the scheduling time by an average of 38.56×.
Funder
National Natural Science Foundation of China
National Research and Development Program of China
Swiss National Science Foundation NRP75 project
Subject
Electrical and Electronic Engineering,Mechanical Engineering,Control and Systems Engineering
Reference37 articles.
1. Fog-enabled event processing based on IoT resource models;Zhang;IEEE Trans. Knowl. Data Eng.,2018
2. Benchmarking big data systems: A review;Han;IEEE Trans. Serv. Comput.,2017
3. 5G-slicing-enabled scalable SDN core network: Toward an ultra-low latency of autonomous driving service;Chekired;IEEE J. Sel. Areas Commun.,2019
4. Real-time crowd monitoring using seamless indoor-outdoor localization;Kulshrestha;IEEE Trans. Mob. Comput.,2019
5. Han, R., Zong, Z., Zhang, F., Vazquez-Poletti, J.L., Jia, Z., and Wang, L. (2017, January 25–30). Cloudmix: Generating diverse and reducible workloads for cloud systems. Proceedings of the2017 IEEE 10th International Conference on Cloud Computing (CLOUD), Honololu, HI, USA.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献