Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus-Reference-Cited by-同舟云学术

Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus

Published:2022-04-29 Issue:5 Volume:21 Page:1-11
ISSN:2375-4699
Container-title:ACM Transactions on Asian and Low-Resource Language Information Processing
language:en
Short-container-title:ACM Trans. Asian Low-Resour. Lang. Inf. Process.

Author:

Ahmadi Sina¹^ORCID,Hassani Hossein²^ORCID,Jaff Daban Q.³

Affiliation:

1. Insight Centre for Data Analytics, National University of Ireland Galway, Galway, Ireland

2. University of Kurdistan Hewlêr, Erbil, Kurdistan Region, Iraq

3. Department of English, Faculty of Education, Koya University, Koya, Kurdistan Region, Iraq

Abstract

Machine translation has been a major motivation of development in natural language processing. Despite the burgeoning achievements in creating more efficient machine translation systems, thanks to deep learning methods, parallel corpora have remained indispensable for progress in the field. In an attempt to create parallel corpora for the Kurdish language, in this article, we describe our approach in retrieving potentially alignable news articles from multi-language websites and manually align them across dialects and languages based on lexical similarity and transliteration of scripts. We present a corpus containing 12,327 translation pairs in the two major dialects of Kurdish, Sorani and Kurmanji. We also provide 1,797 and 650 translation pairs in English-Kurmanji and English-Sorani. The corpus is publicly available under the CC BY-NC-SA 4.0 license. 1

Publisher

Association for Computing Machinery (ACM)

Subject

General Computer Science

Link

https://dl.acm.org/doi/pdf/10.1145/3511806

Reference51 articles.

1. Developing a fine-grained corpus for a less-resourced language: The case of Kurdish;Abdulrahman Roshna;Proceedings of the ACL Widening Natural Language Processing Workshop (WiNLP ACL’19),2019

2. A rule-based Kurdish text transliteration system;Ahmadi Sina;Asian Low-Resour. Lang. Inf. Process.,2019

3. Sina Ahmadi. 2020. A tokenization system for the Kurdish language. In Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects. International Committee on Computational Linguistics (ICCL), 114–127. Retrieved from https://aclanthology.org/2020.vardial-1.11.

4. Sina Ahmadi, Hossein Hassani, and Kamaladdin Abedi. 2020. A Corpus of the Sorani Kurdish folkloric lyrics. In Proceedings of the 1st Joint Spoken Language Technologies for Under-resourced Languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL) Workshop at the 12th International Conference on Language Resources and Evaluation (LREC).

5. Sina Ahmadi, Hossein Hassani, and John P. McCrae. 2019. Towards electronic lexicography for the Kurdish language. In Proceedings of the eLex Conference. 881–906.

Cited by 4 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. CKMorph: a comprehensive morphological analyzer for Central Kurdish;International Journal of Digital Humanities;2023-01-30

2. WH ² D ² N ² : Distributed AI-enabled OK-ASN service for web of things;ACM Transactions on Asian and Low-Resource Language Information Processing;2022-12-15

3. Mizo to English Machine Translation: An Evaluation Benchmark;2022 International Conference on Futuristic Technologies (INCOFT);2022-11-25

4. Automatically Temporal Labeled Data Generation Using Positional Lexicon Expansion for Focus Time Estimation of News Articles;ACM Transactions on Asian and Low-Resource Language Information Processing;2022-10-19