Railroad missing components detection via cascade region‐based convolutional neural network with predefined proposal templates

Abstract

AbstractIn the field of railway infrastructure maintenance, timely and accurate detection of component anomalies is crucial for safety and efficiency. This paper presents the Cascade Region‐based convolutional neural network with Predefined Proposal Templates (CR‐PPT), an innovative method for railroad components inspection in complex railway infrastructure using edge‐computing devices. Unlike previous systems, CR‐PPT employs a series of predefined templates that enable it to detect both the presence and missing elements within various fastening systems. Our experimental analysis pinpoints the most effective network configurations for CR‐PPT. Furthermore, the paper examines CR‐PPT's proficiency in zero‐shot learning and fine‐tuning, highlighting its adaptability to new fastening systems. We have developed an optimized inference pipeline on NVIDIA Jetson AGX Orin, significantly enhancing its applicability for railway inspection practices. Field blind tests validate the model's high precision and efficiency, greatly reducing the time and labor required for inspections. The findings highlight CR‐PPT's potential as an efficient and robust tool for track health assessment, marking a notable progression in the integration of AI and computer vision in rail track inspection.