Affiliation:
1. Beijing Key Laboratory of Work Safety Intelligent Monitoring, School of Electronic Egineering, Beijing University of Posts and Telecommunications, Xitucheng Road No. 10, Beijing 100876, China
2. School of Electronic Engineering, Dublin City University, Collins Avenue Extension, D09 D209 Dublin, Ireland
Abstract
This paper investigates an intelligent reflecting surface (IRS)-aided integrated sensing and communication (ISAC) framework to cope with the problem of spectrum scarcity and poor wireless environment. The main goal of the proposed framework in this work is to optimize the overall performance of the system, including sensing, communication, and computational offloading. We aim to achieve the trade-off between system performance and overhead by optimizing spectrum and computing resource allocation. On the one hand, the joint design of transmit beamforming and phase shift matrices can enhance the radar sensing quality and increase the communication data rate. On the other hand, task offloading and computation resource allocation optimize energy consumption and delay. Due to the coupled and high dimension optimization variables, the optimization problem is non-convex and NP-hard. Meanwhile, given the dynamic wireless channel condition, we formulate the optimization design as a Markov decision process. To tackle this complex optimization problem, we proposed two innovative deep reinforcement learning (DRL)-based schemes. Specifically, a deep deterministic policy gradient (DDPG) method is proposed to address the continuous high-dimensional action space, and the prioritized experience replay is adopted to speed up the convergence process. Then, a twin delayed DDPG algorithm is designed based on this DRL framework. Numerical results confirm the effectiveness of proposed schemes compared with the benchmark methods.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference45 articles.
1. (2023, September 20). ITU-R WP5D. Draft New Recommendation ITU-R M. [IMT. Framework for 2030 and Beyond]–Framework and Overall Objectives of the Future Development of IMT for 2030 and Beyond. Available online: https://www.itu.int/md/R19-WP5D-230612-TD-0905/.
2. Toward millimeter-wave joint radar communications: A signal processing perspective;Mishra;IEEE Signal Process. Mag.,2019
3. Adaptive virtual waveform design for millimeter-wave joint communication–Radar;Kumari;IEEE Trans. Signal Process.,2019
4. A mmWave automotive joint radar-communications system;Dokhanchi;IEEE Trans Aerosp. Electron. Syst.,2019
5. Time-Division ISAC Enabled Connected Automated Vehicles Cooperation Algorithm Design and Performance Evaluation;Zhang;IEEE J. Sel. Areas Commun.,2022