Affiliation:
1. Hunan Province Key Laboratory of Electric Power Robot School of Electrical and Information Engineering, Changsha University of Science and Technology Changsha Hunan China
2. College of Electronics and Information Engineering, Sichuan University Chengdu Sichuan China
Abstract
AbstractDue to the high‐risk working environment of high‐voltage transmission lines, defect samples of strain clamps cannot be fully and completely collected. As a result, the deep learning method based on defect sample tags cannot effectively identify all abnormalities. To solve this problem, an unsupervised anomaly detection method based on knowledge distillation is proposed, which only requires a small number of normal samples to drive the model for anomaly detection. ResNet is the framework of the teacherstudent model, and the feature activation layer after ResBlock is used for knowledge transfer. Residual‐assisted attention and pyramid‐splitting attention were used to enhance the spatial perception and multi‐scale information utilization ability of the model. This model only transmits the information of normal samples and is sensitive to abnormal samples. The proposed model outperformed the baseline by 23% and individual categories by 78% on the MVTec AD (Anomaly Detection Dataset) and outperformed the baseline by 45% and individual categories by 10% on the CIFAR10 and is also reliable for Mnist and Fashion Mnist. This method performs best (82.71%) over the existing method on the self‐built data set.
Publisher
Institution of Engineering and Technology (IET)
Subject
Electrical and Electronic Engineering,Energy Engineering and Power Technology,Control and Systems Engineering