Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing-Reference-Cited by-同舟云学术

Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing

Published:2024 Issue: Volume:32 Page:517-528
ISSN:2329-9290
Container-title:IEEE/ACM Transactions on Audio, Speech, and Language Processing
language:
Short-container-title:IEEE/ACM Trans. Audio Speech Lang. Process.

Author:

Li Jingbei¹^ORCID,Li Sipan¹^ORCID,Chen Ping¹^ORCID,Zhang Luwen¹^ORCID,Meng Yi¹^ORCID,Wu Zhiyong¹^ORCID,Meng Helen²^ORCID,Tian Qiao³^ORCID,Wang Yuping³,Wang Yuxuan³

Affiliation:

1. Tsinghua-CUHK Joint Research Center for Media Sciences, Technologies and Systems, Shenzhen International Graduate School, Tsinghua University, Shenzhen, China

2. Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong, SAR, China

3. ByteDance, Shanghai, China

Funder

National Natural Science Foundation of China

Science, Technology and Innovation Commission of Shenzhen Municipality

AMiner. Shenzhen SciBrain fund and Shenzhen Key Laboratory of next-generation interactive media innovative technology

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Subject

Electrical and Electronic Engineering,Acoustics and Ultrasonics,Computer Science (miscellaneous),Computational Mathematics

Link

http://xplorestaging.ieee.org/ielx7/6570655/10304349/10314740.pdf?arnumber=10314740

Reference44 articles.

1. Text-to-Speech Synthesis

2. Tacotron: Towards End-to-End Speech Synthesis

3. Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions

4. Neural Speech Synthesis with Transformer Network

5. FastSpeech 2: Fast and high-quality end-to-end text to speech;Ren,2020