Snow‐ or ice‐covered road detection in winter road surface conditions using deep neural networks

Abstract

AbstractTraffic accidents occur frequently in cold and snow‐ or ice‐covered regions due to weather changes that occur during the winter season. To detect the snow‐ or ice‐covered roads in road surface conditions, road surface images captured using fixed‐point cameras installed along the route are sufficient. This paper proposes a snow‐ or ice‐covered road detection method that uses the deep convolutional autoencoding Gaussian mixture model (DCAGMM) with structural similarity (SSIM). The DCAGMM method, which is an unsupervised anomaly detection method, is unaffected by imbalance in the training data. In addition, the end‐to‐end convolutional neural network implemented in the DCAGMM enables the capture of the unique characteristics of the road surface images. Finally, by reconstructing the input images as normal images, the comparison of the input and reconstructed images enables identification of snow‐ or ice‐covered road areas without requiring pixel‐level annotations. Furthermore, the road surface images include complex characteristics for reconstruction, and the SSIM‐based reconstruction error allows us to preserve the image quality of the reconstructed image. Experimental results obtained on real‐world road surface images demonstrate the effectiveness of the proposed method.