Transformer‐optimized generation, detection, and tracking network for images with drainage pipeline defects

Abstract

AbstractRegular detection of defects in drainage pipelines is crucial. However, some problems associated with pipeline defect detection, such as data scarcity and defect counting difficulty, need to be addressed. Therefore, a Transformer‐optimized generation, detection, and counting method for drainage‐pipeline defects was established in this paper. First, a generation network called Trans‐GAN‐Cla was developed for data augmentation. A classification network was trained to improve the quality of the generated images. Second, a detection and tracking model called Trans‐Det‐Tra was developed to track and count the number of defects. Third, the feature extraction capability of the proposed method was improved by leveraging Transformers. Compared with some well‐known convolutional neural network‐based methods, the proposed network achieved the best classification and detection accuracies of 87.2% and 87.57%, respectively. Furthermore, the F1 scores were 87.7% and 91.9%. Finally, two pieces of onsite videos were detected and tracked, and the numbers of misalignments and obstacles were accurately counted. The results indicate that the established Transformer‐optimized method can generate high‐quality images and realize the high‐accuracy detection and counting of drainage pipeline defects.