CMCU-CSS: Enhancing Naturalness via Commonsense-based Multi-modal Context Understanding in Conversational Speech Synthesis-Reference-Cited by-同舟云学术

CMCU-CSS: Enhancing Naturalness via Commonsense-based Multi-modal Context Understanding in Conversational Speech Synthesis

Published:2023-10-26 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 31st ACM International Conference on Multimedia
language:
Short-container-title:

Author:

Deng Yayue¹^ORCID,Xue Jinlong¹^ORCID,Wang Fengping¹^ORCID,Gao Yingming¹^ORCID,Li Ya¹^ORCID

Affiliation:

1. Beijing University of Posts and Telecommunications, Beijing, China

Funder

Fundamental Research Funds for the Central Universities

The State Key Laboratory of Multimodal Artificial Intelligence Systems

National Natural Science Foundation of China (NSFC)

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3581783.3612565

Reference35 articles.

1. Alexei Baevski Yuhao Zhou Abdelrahman Mohamed and Michael Auli. 2020. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. In NeurIPS. Alexei Baevski Yuhao Zhou Abdelrahman Mohamed and Michael Auli. 2020. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. In NeurIPS.

2. Antoine Bosselut , Hannah Rashkin , Maarten Sap , Chaitanya Malaviya , Asli Celikyilmaz , and Yejin Choi . 2019 . COMET: Commonsense Transformers for Automatic Knowledge Graph Construction. In ACL (1) . Association for Computational Linguistics , 4762--4779. Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, and Yejin Choi. 2019. COMET: Commonsense Transformers for Automatic Knowledge Graph Construction. In ACL (1). Association for Computational Linguistics, 4762--4779.

3. IEMOCAP: interactive emotional dyadic motion capture database

4. Jian Cong , Shan Yang , Na Hu , Guangzhi Li , Lei Xie , and Dan Su. 2021. Controllable context-aware conversational speech synthesis. arXiv preprint arXiv:2106.10828 ( 2021 ). Jian Cong, Shan Yang, Na Hu, Guangzhi Li, Lei Xie, and Dan Su. 2021. Controllable context-aware conversational speech synthesis. arXiv preprint arXiv:2106.10828 (2021).

5. Commonsense reasoning and commonsense knowledge in artificial intelligence