Monitoring Driving in a Monotonous Environment: Classification and Recognition of Driving Fatigue Based on Long Short-Term Memory Network

Abstract

The driver is one of the most important factors in road traffic. Monitoring the driver’s driving status can greatly improve the safety and road operation efficiency of urban road traffic in the case of multiple traffic modes. Fatigue has a significant impact on drivers’ safety on the road, particularly while driving in a monotonous environment for a long time. In this study, the eye movement parameters of 36 drivers were collected through the simulation experiment of a driving simulator. The pupil area and percentage of eye closure (PERCLOS) in driving scenes of the expressway and low-grade rural road were combined with the Stanford Sleepiness Scale (SSS) to determine the threshold of fatigue degree in different monotonous driving scenarios. A recognition model of different fatigue degrees of drivers is built based on the deep learning method of a long short-term memory network (LSTM) to detect the varied fatigue degrees of drivers. The result shows that the fatigue degree of drivers increases as driving time increases on both expressways and low-grade rural roads. In the same driving time, the driver felt tired faster on the expressway, and the fatigue degree was significantly higher than that on the country road. The recognition rate of the established fatigue degree recognition model for driver’s awake state, mild fatigue, moderate fatigue, and severe fatigue is 100%, 93.1%, 98.4%, and 100% respectively, and the total recognition rate can reach 97.8%, which is higher than the recognition accuracy of the traditional machine learning approach.