Crack detection and dimensional assessment using smartphone sensors and deep learning

Abstract

This paper addresses the crucial need for effective crack detection and dimensional assessment in civil infrastructure materials to ensure safety and functionality. It proposes a cost-effective crack detection and dimensional assessment solution by applying state-of-the-art deep learning on smartphone sensor imagery and positioning data. The proposed methodology integrates three-dimensional (3D) data from LiDAR sensors with Mask R-convolutional neural network (CNN) and YOLOv8 object detection networks, for automated crack detection in concrete structures, allowing for accurate measurement of crack dimensions, including length, width, and area. The study finds that YOLOv8 produces superior precision and recall results in crack detection compared to Mask R-CNN. Furthermore, the calculated crack-straight-length closely aligns with the ground-truth straight-length, with an average error of 1.5%. These research contributions include developing a multi-modal solution combining LiDAR observations with image masks for precise 3D crack measurements, establishing a dimensional assessment pipeline to convert segmented cracks into measurements, and comparing state-of-the-art CNN-based networks for crack detection in real-life images.