Cantonese natural language processing in the transformers era: a survey and current challenges-Reference-Cited by-同舟云学术

Cantonese natural language processing in the transformers era: a survey and current challenges

Published:2024-06-08 Issue: Volume: Page:
ISSN:1574-020X
Container-title:Language Resources and Evaluation
language:en
Short-container-title:Lang Resources & Evaluation

Author:

Xiang Rong,Chersoni Emmanuele,Li Yixia,Li Jing,Huang Chu-Ren,Pan Yushan,Li Yushi

Abstract

AbstractDespite being spoken by a large population of speakers worldwide, Cantonese is under-resourced in terms of the data scale and diversity compared to other major languages. This limitation has excluded it from the current “pre-training and fine-tuning” paradigm that is dominated by Transformer architectures. In this paper, we provide a comprehensive review on the existing resources and methodologies for Cantonese Natural Language Processing, covering the recent progress in language understanding, text generation and development of language models. We finally discuss two aspects of the Cantonese language that could make it potentially challenging even for state-of-the-art architectures: colloquialism and multilinguality

Funder

Hong Kong Polytechnic University

Publisher

Springer Science and Business Media LLC

Link

https://link.springer.com/content/pdf/10.1007/s10579-024-09744-w.pdf

Reference122 articles.

1. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, FL., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S. et al. (2023) GPT-4 Technical Report. arXiv preprint arXiv:2303.08774

2. Ahrens, K. (2015) Corpus of Political Speeches. Hong Kong Baptist University Library, URL https://digital.lib.hkbu.edu.hk/corpus/

3. Almazrouei, E., Alobeidli, H., Alshamsi, A., Cappelli, A., Cojocaru, R., Debbah, M., Goffinet, É., Hesslow, D., Launay, J., & Malartic, Q. et al (2023) The Falcon Series of Open Language Models. arXiv preprint arXiv:2311.16867

4. Bai J., Bai S., Chu Y., Cui Z., Dang K., Deng X., Fan Y., Ge W., Han Y., Huang F. et al (2023) Qwen Technical Teport. arXiv preprint arXiv:2309.16609

5. Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., Do, Q.V., Xu, Y., & Fung, P. (2023) A Multitask., Multilingual., Multimodal Evaluation of ChatGPT on Reasoning., Hallucination., and Interactivity. arXiv preprint arXiv:2302.04023