A deep learning approach to building a framework for Urdu POS and NER

Abstract

The study examines various studies on Named Entity Recognition (NER) and Part of Speech (POS) tagging for the Urdu language conducted by academics and researchers. POS and NER tagging for Urdu still faces obstacles in terms of increasing accuracy while lowering false-positive rates and labelling unknown terms, despite the efforts of numerous researchers. In addition, ambiguity exists when tagging terms with different contextual meanings within a sentence. Due to the fact that Urdu is an inflectional, derivational, morphologically rich, and context-sensitive language, the existing models, such as Linguistic rule application, N-gram Markov model, Tree Tagger, random forest (RF) tagger, etc., were unable to produce accurate experimental results on Urdu language data. The significance of this study is that it fills a gap in the literature concerning the lack of POS and NER tagging for the Urdu language. For Urdu POS and NER tagging, we propose a deep learning model with a well-balanced set of language-independent features as well as a survey of important Urdu POS/NER techniques. In addition, this is the first study to use residual biDirectional residual Long short-term memory (residual biLSTM) architecture trained on the Urmono dataset in conjunction with the randomly initialised word2vec, fastText and mBERT embeddings are utilised to generate word or character vectors.For each experiment, the paper also employs the evaluation methods of Macro-F1, precision, precision, and recall. The proposed method with mbert embedding as word vectors provides best results of F1 score for POS and NER at 91.11% and 99.11% respectively. Also, the accuracy, precision and recall for POS are reported at 94.85%, 91.79% and 90.77%. Similarly, the accuracy, precision and recall for NER of the proposed model are reported at 99.77%, 98.78% and 99.45% respectively, which are higher than baseline models.