Detection of the Bolt Loosening Angle through Semantic Key Point Extraction Detection by Using an Hourglass Network

Abstract

Damage in bolts, which are used as connecting fasteners in steel structures, affects structural safety. Sophisticated machine vision methods have been formulated for the detection of loose bolts, but their accuracy remains an area for improvement. In this paper, a method based on a stacked hourglass network is proposed for automatically extracting the key points of a bolt and for obtaining the bolt loosening angle by comparing the rotations of the key points before and after the bolt is damaged. A data set containing 100 images of key bolt loosening points was collected, and rotation was performed as data augmentation to yield 1800 images. Moreover, a method was designed for automatically annotating the augmented image data set. In this study, 70%, 10%, and 20% of the annotated image data set were used for training, validation, and testing, respectively. Subsequently, a neural network model based on a stacked hourglass network was established to train the annotated image data set. The detection results were evaluated in terms of normalized errors (NEs), percentage of correct key points (PCK), detection speed, and training time. In testing, the proposed method accurately and efficiently identified the bolt loosening angle, with a PCK value as high as 99.3%. The accuracy of the proposed method was also highly robust to different shooting distances, viewing angles, and illumination levels.