Integrating Actuator Fault-Tolerant Control and Deep-Learning-Based NDVI Estimation for Precision Agriculture with a Hexacopter UAV

Abstract

This paper presents an actuator fault-tolerant control (FTC) strategy for a hexacopter unmanned aerial vehicle (UAV) designed specifically for precision agriculture applications. The proposed approach integrates advanced sensing techniques, including the estimation of Near-Infrared (NIR) reflectance from RGB imagery using the Pix2Pix deep learning network based on conditional Generative Adversarial Networks (cGANs), to enable the calculation of the Normalized Difference Vegetation Index (NDVI) for health assessment. Additionally, trajectory flight planning is developed to ensure the efficient coverage of the targeted agricultural area while considering the vehicle’s dynamics and fault-tolerant capabilities, even in the case of total actuator failures. The effectiveness of the proposed system is validated through simulations and real-world experiments, demonstrating its potential for reliable and accurate data collection in precision agriculture. An NDVI test was conducted on a sugarcane crop using the estimated NIR to assess the crop’s condition during its tillering stage. Therefore, the main contributions this paper include (i) the development of an actuator FTC strategy for a hexacopter UAV in precision agriculture applications, integrating advanced sensing techniques such as NIR reflectance estimation using deep learning network; (ii) the design of a flight trajectory planning method ensuring the efficient coverage of the targeted agricultural area, considering the vehicle’s dynamics and fault-tolerant capabilities; (iii) the validation of the proposed system through simulations and real-world experiments; and (iv) the successful integration of FTC scheme, advanced sensing, and flight trajectory planning for reliable and accurate data collection in precision agriculture.