Multiple Representation Transfer from Large Language Models to End-to-End ASR Systems
-
Published:2024-04-14
Issue:
Volume:
Page:10176-10180
-
ISSN:
-
Container-title:ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
-
language:
-
Short-container-title:
Author:
Udagawa Takuma1,
Suzuki Masayuki1,
Kurata Gakuto1,
Muraoka Masayasu1,
Saon George1
Reference41 articles.
1. BERT: Pre-training of deep bidirectional transformers for language understanding;Devlin
2. Unsupervised Cross-lingual Representation Learning at Scale
3. Gpt-4 technical report;ArXiv,2023
4. Attention is all you need;Vaswani
5. GLUE: A multi-task benchmark and analysis platform for natural language understanding;Wang