A multi-band centroid contrastive reconstruction fusion network for motor imagery electroencephalogram signal decoding
-
Published:2023
Issue:12
Volume:20
Page:20624-20647
-
ISSN:1551-0018
-
Container-title:Mathematical Biosciences and Engineering
-
language:
-
Short-container-title:MBE
Author:
Xu Jiacan1, Li Donglin2, Zhou Peng1, Li Chunsheng2, Wang Zinan1, Tong Shenghao1
Affiliation:
1. The College of Engineering Training and Innovation, Shenyang Jianzhu University, Shenyang 110000, China 2. The College of Electrical Engineering, Shenyang University of Technology, Shenyang 110000, China
Abstract
<abstract>
<p>Motor imagery (MI) brain-computer interface (BCI) assist users in establishing direct communication between their brain and external devices by decoding the movement intention of human electroencephalogram (EEG) signals. However, cerebral cortical potentials are highly rhythmic and sub-band features, different experimental situations and subjects have different categories of semantic information in specific sample target spaces. Feature fusion can lead to more discriminative features, but simple fusion of features from different embedding spaces leading to the model global loss is not easily convergent and ignores the complementarity of features. Considering the similarity and category contribution of different sub-band features, we propose a multi-band centroid contrastive reconstruction fusion network (MB-CCRF). We obtain multi-band spatio-temporal features by frequency division, preserving the task-related rhythmic features of different EEG signals; use a multi-stream cross-layer connected convolutional network to perform a deep feature representation for each sub-band separately; propose a centroid contrastive reconstruction fusion module, which maps different sub-band and category features into the same shared embedding space by comparing with category prototypes, reconstructing the feature semantic structure to ensure that the global loss of the fused features converges more easily. Finally, we use a learning mechanism to model the similarity between channel features and use it as the weight of fused sub-band features, thus enhancing the more discriminative features, suppressing the useless features. The experimental accuracy is 79.96% in the BCI competition Ⅳ-Ⅱa dataset. Moreover, the classification effect of sub-band features of different subjects is verified by comparison tests, the category propensity of different sub-band features is verified by confusion matrix tests and the distribution in different classes of each sub-band feature and fused feature are showed by visual analysis, revealing the importance of different sub-band features for the EEG-based MI classification task.</p>
</abstract>
Publisher
American Institute of Mathematical Sciences (AIMS)
Subject
Applied Mathematics,Computational Mathematics,General Agricultural and Biological Sciences,Modeling and Simulation,General Medicine
Reference51 articles.
1. J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, P. H. Peckham, G. Schalk, et al., Brain-computer interface technology: A review of the first international meeting, IEEE Trans. Neural Syst. Rehabil. Eng., 8 (2000), 164–173. https://doi.org/10.1109/TRE.2000.847807 2. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, T. M. Vaughan, Brain–computer interfaces for communication and control, Clin. Neurophysiol., 113 (2002), 767–791. https://doi.org/10.1016/S1388-2457(02)00057-3 3. V. Mihajlović, B. Grundlehner, R. Vullers, J. Penders, Wearable, wireless EEG solutions in daily life applications: What are we missing, IEEE J. Biomed. Health Inf., 19 (2015), 6–21. https://doi.org/10.1109/JBHI.2014.2328317 4. Y. Jiao, Y. Zhang, X. Chen, E. Yin, J. Jin, X. Wang, et al., Sparse group representation model for motor imagery EEG classification, IEEE J. Biomed. Health Inf., 23 (2018), 631–641. https://doi.org/10.1109/JBHI.2018.2832538 5. T. D. Pham, Classification of motor-imagery tasks using a large EEG dataset by fusing classifiers learning on wavelet-scattering features, IEEE Trans. Neural Syst. Rehabil. Eng., 31 (2023), 1097–1107. https://doi.org/10.1109/TNSRE.2023.3241241
|
|