Inferring Speaking Styles from Multi-modal Conversational Context by Multi-scale Relational Graph Convolutional Networks-Reference-Cited by-同舟云学术

Inferring Speaking Styles from Multi-modal Conversational Context by Multi-scale Relational Graph Convolutional Networks

Published:2022-10-10 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 30th ACM International Conference on Multimedia
language:
Short-container-title:

Author:

Li Jingbei¹,Meng Yi¹,Wu Xixin²,Wu Zhiyong¹,Jia Jia¹,Meng Helen²,Tian Qiao³,Wang Yuping³,Wang Yuxuan³

Affiliation:

1. Tsinghua University, Beijing, China

2. The Chinese University of Hong Kong, Hong Kong, China

3. ByteDance, Shanghai, China

Funder

National Key Research and Development Plan

Shenzhen Key Laboratory of next generation interactive media innovative technology

National Natural Science Foundation of China

National Natural Science Foundation of China-Research Grant Council of Hong Kong

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3503161.3547831

Reference42 articles.

1. Kyunghyun Cho , Bart van Merrienboer , cC aglar Gülcc ehre , Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 . Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In EMNLP. Kyunghyun Cho, Bart van Merrienboer, cC aglar Gülcc ehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In EMNLP.

2. Jian Cong , Shan Yang , Na Hu , Guangzhi Li , Lei Xie , and Dan Su. 2021. Controllable Context-aware Conversational Speech Synthesis. arXiv preprint arXiv:2106.10828 ( 2021 ). Jian Cong, Shan Yang, Na Hu, Guangzhi Li, Lei Xie, and Dan Su. 2021. Controllable Context-aware Conversational Speech Synthesis. arXiv preprint arXiv:2106.10828 (2021).

3. Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).

4. Yaroslav Ganin and Victor Lempitsky . 2015 . Unsupervised domain adaptation by backpropagation . In International conference on machine learning. PMLR, 1180--1189 . Yaroslav Ganin and Victor Lempitsky. 2015. Unsupervised domain adaptation by backpropagation. In International conference on machine learning. PMLR, 1180--1189.

5. Yaroslav Ganin , Evgeniya Ustinova , Hana Ajakan , Pascal Germain , Hugo Larochelle , Francc ois Laviolette , Mario Marchand, and Victor Lempitsky. 2016 . Domain-adversarial training of neural networks. The journal of machine learning research, Vol. 17 , 1 (2016), 2096--2030. Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Francc ois Laviolette, Mario Marchand, and Victor Lempitsky. 2016. Domain-adversarial training of neural networks. The journal of machine learning research, Vol. 17, 1 (2016), 2096--2030.

Cited by 5 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Concss: Contrastive-based Context Comprehension for Dialogue-Appropriate Prosody in Conversational Speech Synthesis;ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP);2024-04-14

2. Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing;IEEE/ACM Transactions on Audio, Speech, and Language Processing;2024

3. CMCU-CSS: Enhancing Naturalness via Commonsense-based Multi-modal Context Understanding in Conversational Speech Synthesis;Proceedings of the 31st ACM International Conference on Multimedia;2023-10-26

4. Emotionally Situated Text-to-Speech Synthesis in User-Agent Conversation;Proceedings of the 31st ACM International Conference on Multimedia;2023-10-26

5. Human-computer interaction for virtual-real fusion;Journal of Image and Graphics;2023