A Fitting Recognition Approach Combining Depth-Attention YOLOv5 and Prior Synthetic Dataset
-
Published:2022-11-02
Issue:21
Volume:12
Page:11122
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Zhang JieORCID, Lei JinORCID, Qin Xinyan, Li Bo, Li Zhaojun, Li Huidong, Zeng Yujie, Song Jie
Abstract
To address power transmission lines (PTLs) traveling through complex environments leading to misdetections and omissions in fitting recognition using cameras, we propose a fitting recognition approach combining depth-attention YOLOv5 and prior synthetic dataset to improve the validity of fitting recognition. First, datasets with inspection features are automatically synthesized based on prior series data, achieving better results with a smaller data volume for the deep learning model and reducing the cost of obtaining fitting datasets. Next, a unique data collection mode is proposed using a developed flying-walking power transmission line inspection robot (FPTLIR) as the acquisition platform. The obtained image data in this collection mode has obvious time-space, stability, and depth difference, fusing the two data types in the deep learning model to improve the accuracy. Finally, a depth-attention mechanism is proposed to change the attention on the images with depth information, reducing the probability of model misdetection and omission. Test field experiments results show that compared with YOLOv5, the mAP5095 (mean average precision on step size 0.05 for thresholds from 0.5 to 0.95) of our depth-attention YOLOv5 model for fitting is 68.1%, the recall is 98.3%, and the precision is 98.3%. Among them, AP, recall, and precision increased by 5.2%, 4.8%, and 4.1%, respectively. Test field experiments verify the feasibility of the depth-attention YOLOv5. Line field experiments results show that the mAP5095 of our depth-attention YOLOv5 model for fittings is 64.6%, and the mAPs of each class are improved compared with other attention mechanisms. The inference speed of depth-attention YOLOv5 is 3 ms slower than the standard YOLOv5 model and 10 ms to 15 ms faster than other attention mechanisms, verifying the validity of the depth-attention YOLOv5. The proposed approach improves the accuracy of the fitting recognition on PTLs, providing a recognition and localization basis for the automation and intelligence of inspection robots.
Funder
the National Natural Science Foundation of China the Financial Science and Technology Program of the XPCC the High-level Talent Project of Shihezi University
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference53 articles.
1. Luo, Y., Yu, X., Yang, D., and Zhou, B. A survey of intelligent transmission line inspection based on unmanned aerial vehicle. Artif. Intell. Rev., 2022. 2. A Review on State-of-the-Art Power Line Inspection Techniques;Yang;IEEE Trans. Instrum. Meas.,2020 3. Fan, F., Wu, G., Wang, M., Cao, Q., and Yang, S. Multi-Robot Cyber Physical System for Sensing Environmental Variables of Transmission Line. Sensors, 2018. 18. 4. Xinyan, Q., Gongping, W., and Jin, L. Detecting Inspection Objects of Power Line from Cable Inspection Robot LiDAR Data. Sensors, 2018. 18. 5. Qin, X., Wu, G., Lei, J., Fan, F., Ye, X., and Mei, Q. A novel method of autonomous inspection for transmission line based on cable inspection robot lidar data. Sensors, 2018. 18.
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Transmission Tower Re-Identification Algorithm Based on Machine Vision;Applied Sciences;2024-01-08 2. Research on abnormal detection method of rail fastener based on YOLOV5;Eighth International Conference on Electromechanical Control Technology and Transportation (ICECTT 2023);2023-09-07 3. Research on an Improved Detection Algorithm Based on YOLOv5s for Power Line Self-Exploding Insulators;Electronics;2023-08-31 4. Research on Small Target Detection Algorithm Based on Improved YOLOv5;2023 19th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD);2023-07-29 5. DyHead-YOLOv5 Based on Improved Object Detection Heads with Attentions;2023 19th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD);2023-07-29
|
|