Abstract
In this paper, we propose a novel Deep Reinforcement Learning Evolution Algorithm (DRLEA) method to control the antenna parameters of the High-Altitude Platform Station (HAPS) mobile to reduce the number of low-throughput users. Considering the random movement of the HAPS caused by the winds, the throughput of the users might decrease. Therefore, we propose a method that can dynamically adjust the antenna parameters based on the throughput of the users in the coverage area to reduce the number of low-throughput users by improving the users’ throughput. Different from other model-based reinforcement learning methods, such as the Deep Q Network (DQN), the proposed method combines the Evolution Algorithm (EA) with Reinforcement Learning (RL) to avoid the sub-optimal solutions in each state. Moreover, we consider non-uniform user distribution scenarios, which are common in the real world, rather than ideal uniform user distribution scenarios. To evaluate the proposed method, we do the simulations under four different real user distribution scenarios and compare the proposed method with the conventional EA and RL methods. The simulation results show that the proposed method effectively reduces the number of low throughput users after the HAPS moves.
Funder
JST SPRING
National Institute of Information and Communications Technology (NICT), Japan
Subject
Computer Networks and Communications
Reference41 articles.
1. High-Altitude Platforms for Wireless Communications;Tozer;Electron. Commun. Eng. J. (ECEJ),2001
2. (2019, August 26). Why SoftBank Is Looking to the Stratosphere. Softbank. Available online: https://www.softbank.jp/en/sbnews/entry/20190826_01.
3. Tereza, P., and Elizabeth, H. (2022, November 23). Starlink Satellites: Everything You Need to Know about the Controversial Internet Megaconstellation. SPACE. Available online: https://www.space.com/spacex-starlink-satellites.html.
4. Aerial RIS-Assisted High Altitude Platform Communications;Gao;IEEE Wirel. Commun. Lett.,2021
5. Broadband communications via high-altitude platforms: A survey;Karapantazis;IEEE Commun. Surv. Tutorials,2005
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献