MiA-CODER: A Multi-Intelligent Agent-Enabled Reinforcement Learning for Accurate Coverage Hole Detection and Recovery in Unequal Cluster-Tree-Based QoSensing WSN

Abstract

Coverage is an important factor for the effective transmission of data in the wireless sensor networks. Normally, the formation of coverage holes in the network deprives its performance and reduces the lifetime of the network. In this paper, a multi-intelligent agent enabled reinforcement learning-based coverage hole detection and recovery (MiA-CODER) is proposed in order to overcome the existing challenges related to coverage of the network. Initially, the formation of coverage holes is prevented by optimizing the energy consumption in the network. This is performed by constructing the unequal Sierpinski cluster-tree topology (USCT) and the cluster head is selected by implementing multi-objective black widow optimization (MoBWo) to facilitate the effective transmission of data. Further, the energy consumption of the nodes is minimized by performing dynamic sleep scheduling in which Tsallis entropy enabled Bayesian probability (TE2BP) is implemented to switch the nodes between active and sleep mode. Then, the coverage hole detection and repair are carried out in which the detection of coverage holes if any, both inside the cluster and between the clusters, is completed by using the virtual sector-based hole detection (ViSHD) protocol. Once the detection is over, the BS starts the hole repair process by using a multi-agent SARSA algorithm which selects the optimal mobile node and replaces it to cover the hole. By doing so, the coverage of the network is enhanced and better QoSensing is achieved. The proposed approach is simulated in NS 3.26 and evaluated in terms of coverage rate, number of dead nodes, average energy consumption and throughput.