UAV system with trinocular vision for external obstacle detection of transmission lines

Abstract

External obstacle detection is a significant task in transmission line inspection and is related to the safe operation of the power transmission grid. In recent years, unmanned aerial vehicles (UAVs) equipped with different devices have been widely used for transmission line inspection. However, because of the complex environment of transmission lines and weak power line textures in the obtained images, most existing methods and systems cannot meet the requirements for real-time and high-accuracy external obstacle detection of transmission lines. In this paper, a novel, to the best of our knowledge, UAV system integrated trinocular vision technology with remote sensing is developed to achieve better external obstacle detection of transmission lines in real time, which is composed of a DJ-Innovations (DJI) UAV equipped with a global positioning system (GPS), angle sensors, trinocular vision including three visible cameras with the same parameters, and a small processor with a pre-implanted software algorithm. In this paper, a new method for external obstacle detection of transmission lines is proposed to satisfy the requirements for real-time and high-accuracy practical inspection applications. First, the original trinocular images need to be rectified. Then, the rectified trinocular images are adopted to achieve three-dimensional reconstruction of power lines. Finally, based on trinocular vision, bag of feature, and GPS, the clearance distance measurement, obstacle classification, and obstacle location are realized. Experimental tests on 220 kV transmission lines reveal that our proposed system can be applied in practical inspection environments and has good performance.