Analysing the Methods of Dzongkha Word Segmentation-Reference-Cited by-同舟云学术

Analysing the Methods of Dzongkha Word Segmentation

Published:2017-05-24 Issue:1 Volume:21 Page:61-65
ISSN:2255-8691
Container-title:Applied Computer Systems
language:en
Short-container-title:

Author:

Dhungyel Parshu Ram¹,Grundspeņķis Jānis²

Affiliation:

1. College of Science and Technology, Royal University of Bhutan, Thimpu , Bhutan

2. Riga Technical University, Riga , Latvia

Abstract

Abstract In both Chinese and Dzongkha languages, the greatest challenge is to identify the word boundaries because there are no word delimiters as it is in English and other Western languages. Therefore, preprocessing and word segmentation is the first step in Dzongkha language processing, such as translation, spell-checking, and information retrieval. Research on Chinese word segmentation was conducted long time ago. Therefore, it is relatively mature, but the Dzongkha word segmentation has been less studied by researchers. In the paper, we have investigated this major problem in Dzongkha language processing using a probabilistic approach for selecting valid segments with probability being computed on the basis of the corpus.

Publisher

Walter de Gruyter GmbH

Reference7 articles.

1. [1] G. van Driem, “Language Policy in Bhutan,” presented at conference “Bhutan: a traditional order and the forces of change”, London, UK, March 1993.

2. [2] D. C. Chhoeden et al., “Dzongkha Text-to-Speech Synthesis System - Phase II,” in Conference on Human Language Technology for Development, May 2-5, 2011, Alexandria, Egypt, pp. 148-153.

3. [3] S. Norbu et al., “Dzongkha Word Segmentation,” in 8th Workshop on Asian Language Resources, August 21-22, 2010, Beijing, China, pp. 95-102.

4. [4] H. Liu et al., “Tibetan Word Segmentation as Syllable Tagging Using Conditional Random Field,” in 25th Pacific Asia Conference on Language, Information and Computation, December 16-18, 2011, Singapore, pp. 168-177.

5. [5] C. Chungku, J. Rabgay, and P. Choejey, “Dzongkha Text Corpus,” in Conference on Human Language Technology for Development, May 2-5, 2011, Alexandria, Egypt, pp. 34-38.