Affiliation:
1. Goa College of Engineering, Goa University, Ponda 403401, India
Abstract
Emotion classification using physiological signals is a promising approach that is likely to become the most prevalent method. Bio-signals such as those derived from Electrocardiograms (ECGs) and the Galvanic Skin Response (GSR) are more reliable than facial and voice recognition signals because they are not influenced by the participant’s subjective perception. However, the precision of emotion classification with ECG and GSR signals is not satisfactory, and new methods need to be developed to improve it. In addition, the fusion of the time and frequency features of ECG and GSR signals should be explored to increase classification accuracy. Therefore, we propose a novel technique for emotion classification that exploits the early fusion of ECG and GSR features extracted from data in the AMIGOS database. To validate the performance of the model, we used various machine learning classifiers, such as Support Vector Machine (SVM), Decision Tree, Random Forest (RF), and K-Nearest Neighbor (KNN) classifiers. The KNN classifier gives the highest accuracy for Valence and Arousal, with 69% and 70% for ECG and 96% and 94% for GSR, respectively. The mutual information technique of feature selection and KNN for classification outperformed the performance of other classifiers. Interestingly, the classification accuracy for the GSR was higher than for the ECG, indicating that the GSR is the preferred modality for emotion detection. Moreover, the fusion of features significantly enhances the accuracy of classification in comparison to the ECG. Overall, our findings demonstrate that the proposed model based on the multiple modalities is suitable for classifying emotions.
Reference46 articles.
1. Emotion recognition from physiological signal analysis: A review;Egger;Electron. Notes Theor. Comput. Sci.,2019
2. A review of recent approaches for emotion classification using electrocardiography and electrodermography signals;Bulagang;Inform. Med. Unlocked,2020
3. Sepúlveda, A., Castillo, F., Palma, C., and Rodriguez-Fernandez, M. (2021). Emotion recognition from ECG signals using wavelet scattering and machine learning. Appl. Sci., 11.
4. Emotion Classification using Physiological Signals: A Recent Survey;Dessai;Proceedings of the 2022 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES),2022
5. Li, K., Shen, X., Chen, Z., He, L., and Liu, Z. (2020). The International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, Springer International Publishing.