An Algorithm for Automatic Text Annotation for Named Entity Recognition using spaCy Framework
Author:
Kumar Murari1, Chaturvedi Krishna Kumar1, Sharma Anu1, Arora Alka1, Farooqi Mohammad Samir1, Lal Shashi Bhushan1, Lama Achal1, Ranjan Rajeev2
Affiliation:
1. ICAR-Indian Agricultural Statistics Research Institute 2. ICAR-Indian Agricultural Research Institute
Abstract
Abstract
Text Annotation is the process of adding metadata in the text and used in various tasks like natural language processing (NLP) and machine learning models. Named entity recognition (NER) is one of the interesting and challenging tasks of NLP and is being used extensively in many domains. The application of NER will also be useful in handling documents, queries, reports and research articles related to agriculture in identifying pests affecting crops. SpaCy, a free and open source library is being used for NER that requires the text data in a complex annotated format. The process of manual annotation is difficult and time-consuming task. Therefore, to streamline the process of text annotation, we developed an algorithm and a tool for automatic annotation of text data. Approximately 3.6 million queries were collected from “Kisan Call Centre”, a helpline service to farmers by Government of India and plant protection queries of Paddy and Wheat crops were extracted from this database. These queries were annotated with the help of developed tool and annotated corpus was created. The annotated corpus is used to develop NER models and trained for crops and associated pests identification in agriculture domain. Further, the performance of the model is enhanced by reducing features using plural to singular conversion and synonym substitution. The model achieved an F1-score of 97.20%, demonstrating a significant improvement of 3.01% compared to the performance with original queries.
Publisher
Research Square Platform LLC
Reference30 articles.
1. Ali, R. S., Zhao, B. Z. H., Asghar, H. J., Nguyen, T., Wood, I. D., & Kaafar, D. (2022). Unintended Memorization and Timing Attacks in Named Entity Recognition Models. arXiv, 1–18. https://doi.org/10.48550/arxiv.2211.02245 2. Transformer based named entity recognition for place name extraction from unstructured text;Berragan C;International Journal of Geographical Information Science,2022 3. Biswas, P., Sharan, A., & Kumar, A. (2015). AGNER: Entity tagger in agriculture domain. In 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom) (pp. 1134–1138). New Delhi: IEEE. https://ieeexplore.ieee.org/abstract/document/7100425. Accessed 21 December 2022 4. Bowden, K. K., Wu, J., Oraby, S., Misra, A., & Walker, M. (2018). SlugNERDS: A Named Entity Recognition Tool for Open Domain Dialogue Systems. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) (pp. 4462–4469). European Language Resources Association (ELRA). https://doi.org/10.48550/arxiv.1805.03784 5. Brandsen, A., Verberne, S., Lambers, K., Wansleeben, M., Calzolari, N., Béchet, F. (2020). Creating a dataset for named entity recognition in the archaeology domain. In Conference Proceedings LREC 2020 (pp. 4573–4577).
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
|
|