ImpalaE: Towards an optimal policy for efficient resource management at the edge
-
Published:2022-11-21
Issue:1
Volume:1
Page:43-54
-
ISSN:2837-181X
-
Container-title:Journal of Edge Computing
-
language:
-
Short-container-title:J. Edge Comp.
Author:
Lorido-Botran TaniaORCID, Bhatti Muhammad KhurramORCID
Abstract
Edge computing is an extension of cloud computing where physical servers are deployed closer to the users in order to reduce latency. Edge data centers face the challenge of serving a continuously increasing number of applications with a reduced capacity compared to traditional data center. This paper introduces ImpalaE, an agent based on Deep Reinforcement Learning that aims at optimizing the resource usage in edge data centers. First, it proposes modeling the problem as a Markov Decision Process, with two optimization objectives: reducing the number of physical servers used and maximize number of applications placed in the data center. Second, it introduces an agent based on Proximal Policy Optimization, for finding the optimal consolidation policy, and an asynchronous architecture with multiple workers-shared learner that enables for faster convergence, even with reduced amount of data. We show the potential in a simulated edge data center scenario with different VM sizes based on Microsoft Azure real traces, considering CPU, memory, disk and network requirements. Experiments show that ImpalaE effectively increases the number of VMs that can be placed per episode and that it quickly converges to an optimal policy.
Publisher
Academy of Cognitive and Natural Sciences
Reference21 articles.
1. Choo, K.K.R., Lu, R., Chen, L. and Yi, X., 2018. A foggy research future: Advances and future opportunities in fog computing research. 2. Du, B., Wu, C. and Huang, Z., 2019. Learning resource allocation and pricing for cloud profit maximization. Proceedings of the AAAI Conference on Artificial Intelligence. vol. 33, pp.7570–7577. 3. Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V., Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning, I. and Others, 2018. Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures. International Conference on Machine Learning. PMLR, pp.1407–1416. 4. Fan, Q. and Ansari, N., 2017. Cost aware cloudlet placement for big data processing at the edge. 2017 IEEE International Conference on Communications (ICC). IEEE, pp.1–6. 5. Hadary, O., Marshall, L., Menache, I., Pan, A., Greeff, E.E., Dion, D., Dorminey, S., Joshi, S., Chen, Y., Russinovich, M. and Others, 2020. Protean: VM Allocation Service at Scale. 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). pp.845–861.
|
|