Author:
Mati Diellza Nagavci,Hamiti Mentor,Susuri Arsim,Selimi Besnik,Ajdari Jaumin
Abstract
The development of natural language processing resources for Albanian has grown steadily in recent years. This paper presents research conducted on unsupervised learning-the challenges associated with building a dictionary for the Albanian language and creating part-of-speech tagging models. The majority of languages have their own dictionary, but languages with low resources suffer from a lack of resources. It facilitates the sharing of information and services for users and whole communities through natural language processing. The experimentation corpora for the Albanian language includes 250K sentences from different disciplines, with a proposal for a part-of-speech tagging tag set that can adequately represent the underlying linguistic phenomena. Contributing to the development of Albanian is the purpose of this paper. The results of experiments with the Albanian language corpus revealed that its use of articles and pronouns resembles that of more high-resource languages. According to this study, the total expected frequency as a means for correctly tagging words has been proven effective for populating the Albanian language dictionary.
Publisher
International Association for Educators and Researchers (IAER)
Subject
Electrical and Electronic Engineering,General Computer Science
Reference20 articles.
1. Piotr Kłosowski, “Deep Learning for Natural Language Processing and Language Modelling”, in Proceedings of Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), 19-21 September 2018, Poznan, Poland, Online ISBN: 978-8-3620-6533-2, E-ISBN: 978-83-62065-31-8, DOI: 10.23919/SPA.2018.8563389, pp. 22-32, Published by IEEE, Available: https://ieeexplore.ieee.org/document/8563389.
2. Matteo Pagliardini, Prakhar Gupta and Martin Jaggi, “Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features”, in Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics, June 2018, DOI: 10.18653/v1/N18-1049, pp. 528-540, Published by Association for Computational Linguistics (ACL), Available: https://www.aclweb.org/anthology/N18-1049/.
3. Diellza Nagavci Mati, Mentor Hamiti, Besnik Selimi and Jaumin Ajdari, “Review of Natural Language Processing tasks in Albanian Language”, in Proceedings of the 3rd International Scientific Conference on Business and Economics, 13-15 June 2019, Tetovo, North Macedonia, Online ISBN: 978-608-248-031-2, pp. 317-323, Available: https://www.researchgate.net/publication/348881531_Review_of_Natural_Language_Processing_tasks_in_Albanian_Language.
4. Diellza Nagavci Mati, Mentor Hamiti, Jaumin Ajdari and Besnik Selimi, “A Systematic Mapping Study of Language Features Identification from Large Text Collection”, in Proceedings of the 8th Mediterranean Conference on Embedded Computing (MECO), 10-14 June 2019, Budva, Montenegro, Online ISBN: :978-1-7281-1740-9, E-ISBN: 978-1-7281-1739-3, DOI: 10.1109/MECO.2019.8760042, pp. 259-263, Published by IEEE, Available: https://ieeexplore.ieee.org/document/8760042.
5. Besim Kabashi and Proisl Thomas, “Albanian Part-of-Speech Tagging: Gold Standard and Evaluation”, in Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC), May 2018, Miyazaki, Japan, Online ISBN 979-10-95546-00-9, pp. 2593-2599, Published by European Language Resources Association (ELRA), Available: https://www.aclweb.org/anthology/L18-1412.
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献