Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis

Abstract

The purpose of this research is to explore the optimization and fusion application of multimodal neuroimaging technology and analyze the evaluation method of human brain fatigue based on multimodal neuroimaging technology. Based on electroencephalogram (EEG) and fMRI (functional magnetic resonance imaging), the four-dimensional consistency of local neural activities (FOCA) and local multimodal serial analysis (LMSA) are first introduced to fuse EEG and fMRI organically. Second, the eigenspace maximal information canonical correlation analysis (emiCCA) is introduced to construct the multimodal neuroimaging data fusion system. Finally, how the brain function network is constructed is introduced. Based on the binary and the weighted brain function networks, the relationship between the human brain fatigue and the brain function network is evaluated by calculating the fractal dimension. Results demonstrate that FOCA performs well in temporal and spatial consistency indexes, and the mean level and standard deviation in the case of temporal and spatial consistency are approximately 0.45. The effect of LMSA indexes is significantly better than generalized linear models (GLMs). Under different signal-to-noise ratios (SNRs), the regression coefficient based on LMSA is much larger than the GLM estimate; the corresponding significance level is $p<0.05$ ; and the maximum value of the regression coefficient appears near 0.2. In the data fusion system, the time-space matching has good results under the time accuracy based on EEG and the space accuracy based on fMRI, with the time accuracy above 88% and the space accuracy above 89%. The fractal dimension analysis based on the brain function network reveals that the weighted brain function network is more sensitive to mental fatigue. The state of human brain fatigue will make the brain function network more complicated. The fractal dimension with more network edges is around 2.2, while the fractal dimension with fewer network edges is around 1.6. The proposed data analysis and fusion system have great application potential and propose a new idea for analyzing human brain fatigue and brain aging.