Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module-Reference-Cited by-同舟云学术

Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

Published:2022-11-07 Issue: Volume: Page:
ISSN:
Container-title:INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
language:
Short-container-title:

Author:

Liu Yihe¹^ORCID,Yuan Ziqi²^ORCID,Mao Huisheng²^ORCID,Liang Zhiyun³^ORCID,Yang Wanqiuyue⁴^ORCID,Qiu Yuanzhe¹^ORCID,Cheng Tie⁴^ORCID,Li Xiaoteng⁵^ORCID,Xu Hua²^ORCID,Gao Kai¹^ORCID

Affiliation:

1. Hebei University of Science and Technology, China

2. Tsinghua University, China

3. China Agricultural University, China

4. Beijing University of Post and Telecommunications, China

5. Hebei University of Science and Technology, Shijiazhuang,China, China

Funder

Beijing Academy of Artificial Intelligence(BAAI)

National Natural Science Foundation of China

Natural Science Foundation of Hebei Province

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3536221.3556630

Reference48 articles.

1. Shahin Amiriparian Artem Sokolov Ilhan Aslan Lukas Christ Maurice Gerczuk Tobias Hübner Dmitry Lamanov Manuel Milling Sandra Ottl Ilya Poduremennykh 2021. On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Era. arXiv preprint arXiv:2104.10121(2021). Shahin Amiriparian Artem Sokolov Ilhan Aslan Lukas Christ Maurice Gerczuk Tobias Hübner Dmitry Lamanov Manuel Milling Sandra Ottl Ilya Poduremennykh 2021. On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Era. arXiv preprint arXiv:2104.10121(2021).

2. Tadas Baltrušaitis , Chaitanya Ahuja , and Louis-Philippe Morency . 2018. Multimodal machine learning: A survey and taxonomy . IEEE transactions on pattern analysis and machine intelligence 41, 2( 2018 ), 423–443. Tadas Baltrušaitis, Chaitanya Ahuja, and Louis-Philippe Morency. 2018. Multimodal machine learning: A survey and taxonomy. IEEE transactions on pattern analysis and machine intelligence 41, 2(2018), 423–443.

3. Carlos Busso , Murtaza Bulut , Chi-Chun Lee , Abe Kazemzadeh , Emily Mower , Samuel Kim , Jeannette N Chang , Sungbok Lee , and Shrikanth S Narayanan . 2008 . IEMOCAP: Interactive emotional dyadic motion capture database. Language resources and evaluation 42, 4 (2008), 335–359. Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jeannette N Chang, Sungbok Lee, and Shrikanth S Narayanan. 2008. IEMOCAP: Interactive emotional dyadic motion capture database. Language resources and evaluation 42, 4 (2008), 335–359.

4. J. Chen Z. Yang and D. Yang. 2020. MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification. (2020). J. Chen Z. Yang and D. Yang. 2020. MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification. (2020).

5. Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).

Cited by 16 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. AdaFN-AG: Enhancing multimodal interaction with Adaptive Feature Normalization for multimodal sentiment analysis;Intelligent Systems with Applications;2024-09

2. An autoencoder-based self-supervised learning for multimodal sentiment analysis;Information Sciences;2024-07

3. Feature Alignment and Reconstruction Constraints for Multimodal Sentiment Analysis;2024 International Joint Conference on Neural Networks (IJCNN);2024-06-30

4. SoulSkipper: A Voice-Controlled Emotional Adaptive Game to Complement Therapy for Social Anxiety Disorder;Extended Abstracts of the CHI Conference on Human Factors in Computing Systems;2024-05-02

5. Fusing Modality-Specific Representations and Decisions for Multimodal Emotion Recognition;ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP);2024-04-14