Affiliation:
1. National Institute of Information and Communications Technology, Kyoto, Japan
Abstract
Experiments on various word segmentation approaches for the Burmese language are conducted and discussed in this note. Specifically, dictionary-based, statistical, and machine learning approaches are tested. Experimental results demonstrate that statistical and machine learning approaches perform significantly better than dictionary-based approaches. We believe that this note, based on an annotated corpus of relatively considerable size (containing approximately a half million words), is the first systematic comparison of word segmentation approaches for Burmese. This work aims to discover the properties and proper approaches to Burmese textual processing and to promote further researches on this understudied language.
Publisher
Association for Computing Machinery (ACM)
Reference15 articles.
1. Chinese word segmentation: A decade review;Huang Chang-Ning;J. Chin. Inform. Process.,2007
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Bi-directional Maximal Matching Algorithm to Segment Khmer Words in Sentence;J INF PROCESS SYST;2022
2. Tackling Hate Speech in Low-resource Languages with Context Experts;International Conference on Information & Communication Technologies and Development 2022;2022-06-27
3. Towards Tokenization and Part-of-Speech Tagging for Khmer: Data and Discussion;ACM Transactions on Asian and Low-Resource Language Information Processing;2021-11-30
4. A Neural Joint Model with BERT for Burmese Syllable Segmentation, Word Segmentation, and POS Tagging;ACM Transactions on Asian and Low-Resource Language Information Processing;2021-07-31
5. A Burmese (Myanmar) Treebank;ACM Transactions on Asian and Low-Resource Language Information Processing;2020-05-31