Abstract
Code-switching (CS) in spoken language is where the speech has two or more languages within an utterance. It is an unsolved issue in automatic speech recognition (ASR) research as ASR needs to recognise speech in bilingual and multilingual settings, where the accuracy of ASR systems declines with CS due to pronunciation variation. There are very few reviews carried out on CS, with none conducted on bilingual and multilingual CS ASR systems. This study investigates the importance of CS in bilingual and multilingual speech recognition systems. To meet the objective of this study, two research questions were formulated, which cover both the current issues and the direction of the research. Our review focuses on databases, acoustic and language modelling, and evaluation metrics. Using selected keywords, this research has identified 274 papers and selected 42 experimental papers for review, of which 24 (representing 57%) have discussed CS, while the rest look at multilingual ASR research. The selected papers cover many well-resourced and under-resourced languages, and novel techniques to manage CS in ASR systems, which are mapping, combining and merging the phone sets of the languages experimented with in the research. Our review also examines the performance of those methods. This review found a significant variation in the performance of CS in terms of word error rates, indicating an inconsistency in the ability of ASRs to handle CS. In the conclusion, we suggest several future directions that address the issues identified in this review.
Funder
Ministry of Higher Education under the Fundamental Research Grant Scheme
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference66 articles.
1. Classification of Dysarthric Speech According to the Severity of Impairment: an Analysis of Acoustic Features
2. Predicting vowel substitution in code-switched speech;Modipa;Proceedings of the Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech),2015
3. CECOS: A Chinese-English code-switching speech database;Shen;Proceedings of the International Conference on Speech Database and Assessments (Oriental COCOSDA),2011
4. Code-switching detection using multilingual DNNs;Yılmaz;Proceedings of the IEEE Spoken Language Technology Workshop (SLT),2016
5. End-to-end code-switching ASR for low-resourced language pairs;Yue;Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU),2019
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献