Multi-modal Speech Emotion Recognition: Improving Accuracy Through Fusion of VGGish and BERT Features with Multi-head Attention-Reference-Cited by-同舟云学术

Multi-modal Speech Emotion Recognition: Improving Accuracy Through Fusion of VGGish and BERT Features with Multi-head Attention

Published:2023 Issue: Volume: Page:148-158
ISSN:1867-8211
Container-title:Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
language:
Short-container-title:

Author:

Tran Phuong-Nam^ORCID,Vu Thuy-Duong Thi^ORCID,Dang Duc Ngoc Minh^ORCID,Pham Nhat Truong^ORCID,Tran Anh-Khoa^ORCID

Publisher

Springer Nature Switzerland

Link

https://link.springer.com/content/pdf/10.1007/978-3-031-47359-3_11

Reference18 articles.

1. Liu, D., Chen, L., Wang, Z., Diao, G.: Speech expression multimodal emotion recognition based on deep belief network. J. Grid Comput. 19(2), 22 (2021)

2. Pham, N.T., Dang, D.N.M., Nguyen, S.D.: A method upon deep learning for speech emotion recognition. J. Adv. Eng. Comput. 4(4), 273–285 (2020)

3. Bao, F., Neumann, M., Vu, N.T.: Cyclegan-based emotion style transfer as data augmentation for speech emotion recognition. In: Kubin, G., Kacic, Z. (eds.) Interspeech 2019, 20th Annual Conference of the International Speech Communication Association, Graz, Austria, 15–19 September 2019, pp. 2828–2832. ISCA (2019)

4. Pham, N.T., et al.: Speech emotion recognition: a brief review of multi-modal multi-task learning approaches. In: AETA 2022-Recent Advances in Electrical Engineering and Related Sciences: Theory and Application. Springer, Cham (2022)

5. Pham, N.T., Dang, D.N.M., Pham, B.N.H., Nguyen, S.D.: SERVER: multi-modal speech emotion recognition using transformer-based and vision-based embeddings. In: ICIIT 2023: 8th International Conference on Intelligent Information Technology, Da Nang, Vietnam, 24–26 February 2023. ACM (2023)

Cited by 3 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. MERSA: Multimodal Emotion Recognition with Self-Align Embedding;2024 International Conference on Information Networking (ICOIN);2024-01-17

2. SER-Fuse: An Emotion Recognition Application Utilizing Multi-Modal, Multi-Lingual, and Multi-Feature Fusion;Proceedings of the 12th International Symposium on Information and Communication Technology;2023-12-07

3. Comparative analysis of multi-loss functions for enhanced multi-modal speech emotion recognition;2023 14th International Conference on Information and Communication Technology Convergence (ICTC);2023-10-11