Konkani WordNet: Corpus-Based Enhancement using Crowdsourcing

Author:

Manerkar Sanjana1ORCID,Asnani Kavita2,Khorjuvenkar Preeti Ravindranath3,Desai Shilpa4,Pawar Jyoti D.3

Affiliation:

1. Computer Department, Goa College of Engineering, Goa University, Farmagudi, Goa, India

2. State Higher Education Council, Directorate of Higher Education and Adjunct Faculty, Government College of Arts, Science & Commerce, Sanquelim, Goa, India

3. Goa Business School (Computer Science & Technology), Goa University, Taleigao, Goa, India

4. Department of Information Technology, Fr. Agnel College, Pilar, Goa, India

Abstract

Konkani is one of the languages included in the eighth schedule of the Indian constitution. It is the official language of Goa and is spoken mainly in Goa and some places in Karnataka and Kerala. Konkani WordNet or Konkani Shabdamalem (kōṁkanī śabdamālēṁ) as it has been referred to, was developed under the Indradhanush WordNet Project Consortium during the period from August 2010 to October 2013. This project was funded by Technology Development for Indian Languages (TDIL), Department of Electronics & Information Technology (Deity), and Ministry of Communication and Information Technology (MCIT). The work on Konkani WordNet has halted since the end of the project. Currently, the Konkani WordNet contains around 32,370 synsets. However, to make it a powerful resource for NLP applications in the Konkani language, a need is felt for research work toward enhancement of the Konkani WordNet via community involvement. Crowdsourcing is a technique in which the knowledge of the crowd is utilized to accomplish a particular task. In this article, we have presented the details of the crowdsourcing platform named “Konkani Shabdarth” (kōṁkanī śabdārth). Konkani Shabdarth attempts to use the knowledge of Konkani speaking people for creating new synsets and perform the quantitative enhancement of the wordnet. It also intends to work toward enhancing the overall quality of the Konkani WordNet by validating the existing synsets, and adding the missing words to the existing synsets. A text corpus named “Konkani Shabdarth Corpus”, has been created from the Konkani literature while implementing the Konkani Shabdarth tool. Using this corpus, 572 root words that are missing from the Konkani WordNet have been identified which are given as input to Konkani Shabdarth. As of now, total 94 users have registered on the platform, out of which 25 users have actually played the game. Currently, 71 new synsets have been obtained for 21 words. For some of the words, multiple entries for the concept definition have been received. This overlap is essential for automating the process of validating the synsets. Due to the pandemic period, it has been difficult to train and get players to actually play the game and contribute. We studied the impact of adding missing words from other existing Konkani text corpus on the coverage of Konkani WordNet. The expected increase in the percentage coverage of Konkani WordNet has been found to be in the range 20–27 after adding the missing words from the Konkani Shabdarth corpus in comparison to the other corpora for which the increase is in the range 1–10.

Publisher

Association for Computing Machinery (ACM)

Subject

General Computer Science

Reference51 articles.

1. Konkani language. Available: Retrieved from https://en.wikipedia.org/wiki/Konkanilanguage [Accessed August 15 2020].

2. Are Konkani speakers declining? Available: https://www.goa365.tv/general/N/are-konkani-speakers-declining-no-rising-in-konkani-states/03857.html 05 Jul 2018 [Accessed August 17 2020].

3. Girish Nath Jha. 2012. The TDIL program and the Indian language corpora initiative (ILCI). In Proceedings of the Language Resources and Evaluation Conference.

4. Shilpa Desai, Jyoti Pawar, and Pushpak Bhattacharya. 2012. Automated paradigm selection for FSA based konkani verb morphologic al analyzer. In Proceedings of the COLING 10-14 (Dec, 2012).

5. Edna Vaz, Shantaram V. Walawalikar, Jyoti Pawar, and Madhavi Sardesai. 2012. BIS annotation standards with reference to konkani language. In Proceedings of the 3rd Workshop on South and Southeast Asian Natural Language Processing. pages 145–152. COLING 2012, Mumbai, December.

Cited by 1 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. English to Konkani Translator Using Hindi as a Pivot Language;2023 International Conference on Recent Advances in Information Technology for Sustainable Development (ICRAIS);2023-11-06

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3