3D-STCNN: Spatiotemporal Convolutional Neural Network Based on EEG 3D Features for Detecting Driving Fatigue

Abstract

Fatigue driving has become one of the main causes of traffic accidents, and driving fatigue detection based on electroencephalogram (EEG) can effectively evaluate the driver’s mental state and avoid the occurrence of traffic accidents. This article evaluates a feature extraction method for extracting multiple features of EEG signals and establishes a Spatiotemporal Convolutional Neural Network (STCNN) to detect driver fatigue. Firstly, we constructed a three-dimensional feature of the EEG signal, which includes the frequency domain, time domain, and spatial features of the EEG signal. Then, we use STCNN for fatigue state classification. STCNN is composed of an Attention Time Network (ATNet) based on attention mechanism and an Attention Convolutional Neural Network (ACNN) based on attention mechanism. In addition, we conducted fatigue driving experiments and collected EEG signals from 14 subjects in both awake and fatigued states, ultimately collecting EEG data under three different driving task loads. We conducted extensive experiments on this basis and compared the effectiveness of STCNN and six competitive methods. The results show that the classification accuracy of STCNN is 87.55%, which can effectively detect the fatigue status of drivers.