PSDSpell: Pre-Training with Self-Distillation Learning for Chinese Spelling Correction-Reference-Cited by-同舟云学术

PSDSpell: Pre-Training with Self-Distillation Learning for Chinese Spelling Correction

Published:2024-04-01 Issue:4 Volume:E107.D Page:495-504
ISSN:0916-8532
Container-title:IEICE Transactions on Information and Systems
language:en
Short-container-title:IEICE Trans. Inf. & Syst.

Author:

HE Li¹²,ZHANG Xiaowu¹²,DUAN Jianyong¹²,WANG Hao¹²,LI Xin¹²,ZHAO Liang³⁴

Affiliation:

1. College of Informatics, North China University of Technology

2. CNONIX National Standard Application and Promotion Lab

3. School of Information Management, Wuhan University

4. Key Laboratory of Semantic Publishing and Knowledge Service of the National Press and Publication Administration, Wuhan University

Publisher

Institute of Electronics, Information and Communications Engineers (IEICE)

Link

https://www.jstage.jst.go.jp/article/transinf/E107.D/4/E107.D_2023IHP0005/_pdf

Reference23 articles.

1. [1] C.L. Liu, M.H. Lai, Y.H. Chuang, and C.Y. Lee, “Visually and phonologically similar characters in incorrect simplified Chinese words,” Coling 2010: Posters, Beijing, China, pp.739-747, Aug. 2010.

2. [2] C. Li, C. Zhang, X. Zheng, and X. Huang, “Exploration and exploitation: Two ways to improve Chinese spelling correction models,” Proc. 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Online, pp.441-446, Association for Computational Linguistics, Aug. 2021. 10.18653/v1/2021.acl-short.56

3. [3] J. Devlin, M.W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, Minnesota, pp.4171-4186, June 2019.

4. [4] S.H. Wu, C.L. Liu, and L.H. Lee, “Chinese spelling check evaluation at SIGHAN bake-off 2013,” Proc. Seventh SIGHAN Workshop on Chinese Language Processing, Nagoya, Japan, pp.35-42, Oct. 2013.

5. [5] L.C. Yu, L.H. Lee, Y.H. Tseng, and H.H. Chen, “Overview of SIGHAN 2014 bake-off for Chinese spelling check,” Proc. Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, Wuhan, China, pp.126-132, Oct. 2014.