Affiliation:
1. Department of Computer Engineering , Karadeniz Technical University , Trabzon , Turkey
Abstract
Abstract
Emotion is one of the most complex and difficult expression to be predicted. Nowadays, many recognition systems that use classification methods have focused on different types of emotion recognition problems. In this paper, we aimed to propose a multimodal fusion method between electroencephalography (EEG) and electrooculography (EOG) signals for emotion recognition. Therefore, before the feature extraction stage, we applied different angle-amplitude transformations to EEG–EOG signals. These transformations take arbitrary time domain signals and convert them two-dimensional images named as Angle-Amplitude Graph (AAG). Then, we extracted image-based features using a scale invariant feature transform method, fused these features originates basically from EEG–EOG and lastly classified with support vector machines. To verify the validity of these proposed methods, we performed experiments on the multimodal DEAP dataset which is a benchmark dataset widely used for emotion analysis with physiological signals. In the experiments, we applied the proposed emotion recognition procedures on the arousal-valence dimensions. We achieved (91.53%) accuracy for the arousal space and (90.31%) for the valence space after fusion. Experimental results showed that the combination of AAG image features belonging to EEG–EOG signals in the baseline angle amplitude transformation approaches enhanced the classification performance on the DEAP dataset.
Reference37 articles.
1. Yan, J, Bracewell, DB, Ren, F, Kuroiwa, S. The creation of a Chinese emotion ontology based on Hownet. Eng Lett 2008;16.
2. Lindsley, DB. Emotion. In: Handbook of Experimental Psychology. New York: Wiley; 1951:473–516 pp.
3. Boehner, K, DePaula, R, Dourish, P, Sengers, P. How emotion is made and measured. Int J Hum Comput Stud 2007;65:275–91. https://doi.org/10.1016/j.ijhcs.2006.11.016.
4. Forlizzi, J, Disalvo, C, Hanington, B. On the relationship between emotion, experience and the design of new products. Des J 2003;6:29–38. https://doi.org/10.2752/146069203789355507.
5. Levine, EL. Emotion and power (as social influence): their impact on organizational citizenship and counter-productive individual and organizational behavior. Hum Resour Manag Rev 2010;20:4–17. https://doi.org/10.1016/j.hrmr.2009.03.011.
Cited by
16 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献