Affiliation:
1. Faculty of Information Science and Engineering Ocean University of China Qingdao Shangdong China
2. Systems Laboratory, School of Engineering & Physical Sciences Heriot‐Watt University Edinburgh UK
3. School of Cyber Science and Engineering Sichuan University Chengdu Sichaun China
Abstract
AbstractIn this article, an optimal bipartite consensus control (OBCC) scheme is proposed for heterogeneous multiagent systems (MASs) with input delay by reinforcement learning (RL) algorithm. A directed signed graph is established to construct MASs with competitive and cooperative relationships, and model reduction method is developed to tackle input delay problem. Then, based on the Hamilton–Jacobi–Bellman (HJB) equation, policy iteration method is utilized to design the bipartite consensus controller, which consists of value function and optimal controller. Further, a distributed event‐triggered function is proposed to increase control efficiency, which only requires information from its own agent and neighboring agents. Based on the input‐to‐state stability (ISS) function and Lyapunov function, sufficient conditions for the stability of MASs can be derived. Apart from that, RL algorithm is employed to solve the event‐triggered OBCC problem in MASs, where critic neural networks (NNs) and actor NNs estimate value function and control policy, respectively. Finally, simulation results are given to validate the feasibility and efficiency of the proposed algorithm.
Funder
China Scholarship Council
Fundamental Research Funds for the Central Universities
National Natural Science Foundation of China
Subject
Control and Systems Engineering,Electrical and Electronic Engineering,Mathematics (miscellaneous)