Quantitative identification of daily mental fatigue levels based on multimodal parameters

Abstract

Fatigue has become an important health problem in modern life; excessive mental fatigue may induce various cardiovascular diseases. Most current mental fatigue recognition is based only on specific scenarios and tasks. To improve the accuracy of daily mental fatigue recognition, this paper proposes a multimodal fatigue grading method that combines three signals of electrocardiogram (ECG), photoplethysmography (PPG), and blood pressure (BP). We collected ECG, PPG, and BP from 22 subjects during three time periods: morning, afternoon, and evening. Based on these three signals, 56 characteristic parameters were extracted from multiple dimensions, which comprehensively covered the physiological information in different fatigue states. The extracted parameters were compared with the feature optimization ability of recursive feature elimination (RFE), maximal information coefficient, and joint mutual information, and the optimum feature matrix selected was input into random forest (RF) for a three-level classification. The results showed that the accuracy of classification of fatigue using only one physiological feature was 88.88%, 92.72% using a combination of two physiological features, and 94.87% using all three physiological features. This study indicates that the fusion of multiple physiological traits contains more comprehensive information and better identifies the level of mental fatigue, and the RFE-RF model performs best in fatigue identification. The BP variability index is useful for fatigue classification.