The Verification of the Correct Visibility of Horizontal Road Signs Using Deep Learning and Computer Vision
-
Published:2023-10-20
Issue:20
Volume:13
Page:11489
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Kulawik Joanna1ORCID, Kubanek Mariusz1ORCID, Garus Sebastian2ORCID
Affiliation:
1. Faculty of Mechanical Engineering and Computer Science, Department of Computer Sciences, Czestochowa University of Technology, Dabrowskiego 73, 42-201 Czestochowa, Poland 2. Faculty of Mechanical Engineering and Computer Science, Department of Mechanics and Fundamentals of Machine Design, Czestochowa University of Technology, Dabrowskiego 73, 42-201 Czestochowa, Poland
Abstract
This research aimed to develop a system for classifying horizontal road signs as correct or with poor visibility. In Poland, road markings are applied by using a specialized white, reflective paint and require periodic repainting. Our developed system is designed to assist in the decision-making process regarding the need for repainting. It operates by analyzing images captured by a standard car camera or driving recorder. The image data undergo initial segmentation and classification processes, facilitated by the utilization of the YOLOv4-Tiny neural network model. The input data to the network consist of frames extracted from the video stream. To train the model, we established our proprietary database, which comprises 6250 annotated images and video frames captured during driving. The annotations provide detailed information about object types, their locations within the image, and their sizes. The trained neural network model effectively identifies and classifies objects within our dataset. Subsequently, based on the classification results, the identified image fragments are subjected to further analysis. The analysis relies on assessing pixel-level contrasts within the images. Notably, the road surface is intentionally designed to be dark, while road signs exhibit relatively lighter colors. In conclusion, the developed system serves the purpose of determining the correctness or visibility quality of horizontal road signs. It achieves this by leveraging computer vision techniques, deep learning with YOLOv4-Tiny, and a meticulously curated database. Ultimately, the system provides valuable information regarding the condition of specific horizontal road signs, aiding in the decision-making process regarding potential repainting needs.
Funder
Polish Minister of Science and Higher Education
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference29 articles.
1. DDTree: A hybrid genetic algorithm with multiple decoding methods for energy-aware remanufacturing system scheduling problem;Wang;Robot.-Comput.-Integr. Manuf.,2023 2. Tian, G., Zhang, L., Fathollahi-Fard, A.M., Kang, Q., Li, Z., and Wong, K.Y. (2023). Addressing a collaborative maintenance planning using multiple operators by a multi-objective Metaheuristic algorithm. IEEE Trans. Autom. Sci. Eng., 1–13. 3. Yang, F., Qiao, Y., Wei, W., Wang, X., Wan, D., Damaševičius, R., and Woźniak, M. (2020). DDTree: A Hybrid Deep Learning Model for Real-Time Waterway Depth Prediction and Smart Navigation. Appl. Sci., 10. 4. Estimating the distance to an object from grayscale stereo images using deep learning;Kulawik;J. Appl. Math. Comput. Mech.,2022 5. Deep learning for occluded and multi-scale pedestrian detection: A review;Xiao;IET Image Process.,2021
|
|