Affiliation:
1. Department of Electronics and Communications Engineering, Kwangwoon University, Seoul 01897, Republic of Korea
Abstract
Various edge collaboration schemes that rely on reinforcement learning (RL) have been proposed to improve the quality of experience (QoE). Deep RL (DRL) maximizes cumulative rewards through large-scale exploration and exploitation. However, the existing DRL schemes do not consider the temporal states using a fully connected layer. Moreover, they learn the offloading policy regardless of the importance of experience. They also do not learn enough because of their limited experiences in distributed environments. To solve these problems, we proposed a distributed DRL-based computation offloading scheme for improving the QoE in edge computing environments. The proposed scheme selects the offloading target by modeling the task service time and load balance. We implemented three methods to improve the learning performance. Firstly, the DRL scheme used the least absolute shrinkage and selection operator (LASSO) regression and attention layer to consider the temporal states. Secondly, we learned the optimal policy based on the importance of experience using the TD error and loss of the critic network. Finally, we adaptively shared the experience between agents, based on the strategy gradient, to solve the data sparsity problem. The simulation results showed that the proposed scheme achieved lower variation and higher rewards than the existing schemes.
Funder
Korean government
Research Grant of Kwangwoon University
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference45 articles.
1. Performance Evaluation Metrics for Cloud, Fog, and Edge Computing: A Review, Taxonomy, Benchmarks, and Standards for Future Research;Aslanpour;Internet Things,2020
2. Edge Computing: A Survey;Khan;Future Gener. Comput. Syst.,2019
3. Fast Forest Fire Smoke Detection using MVMNet;Hu;Knowl.-Based Syst.,2020
4. Edge Cloud Offloading Algorithms: Issues, Methods, and Perspectives;Wang;ACM Comput. Surv.,2020
5. Meng, Q., Wang, K., Liu, B., Miyazaki, T., and He, X. (2018, January 20–24). QoE-based Big Data Analysis with Deep Learning in Pervasive Edge Environment. Proceedings of the IEEE International Conference on Communications, Kansas City, MO, USA.
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献