Affiliation:
1. School of Computing, Gachon University, Seongnam 13120, Republic of Korea
Abstract
In the realm of the five-category classification endeavor, there has been limited exploration of applied techniques for classifying Arabic text. These methods have primarily leaned on single-task learning, incorporating manually crafted features that lack robust sentence representations. Recently, the Transformer paradigm has emerged as a highly promising alternative. However, when these models are trained using single-task learning, they often face challenges in achieving outstanding performance and generating robust latent feature representations, especially when dealing with small datasets. This issue is particularly pronounced in the context of the Arabic dialect, which has a scarcity of available resources. Given these constraints, this study introduces an innovative approach to dissecting sentiment in Arabic text. This approach combines Inductive Transfer (INT) with the Transformer paradigm to augment the adaptability of the model and refine the representation of sentences. By employing self-attention SE-A and feed-forward sub-layers as a shared Transformer encoder for both the five-category and three-category Arabic text classification tasks, this proposed model adeptly discerns sentiment in Arabic dialect sentences. The empirical findings underscore the commendable performance of the proposed model, as demonstrated in assessments of the Hotel Arabic-Reviews Dataset, the Book Reviews Arabic Dataset, and the LARB dataset.
Funder
National Research Foundation of Korea
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference63 articles.
1. Baniata, L.H., Park, S., and Park, S.-B. (2018). A multitask-based neural machine translation model with part-of-speech tags integration for Arabic dialects. Appl. Sci., 8.
2. Alali, M., Mohd Sharef, N., Azmi Murad, M.A., Hamdan, H., and Husin, N.A. (2022). Multitasking Learning Model Based on Hierarchical Attention Network for Arabic Sentiment Analysis Classification. Electronics, 11.
3. A survey of Arabic text classification;Salloum;Inter. J. Elctr. Comput. Engi.,2018
4. Machine translation for Arabic dialects (survey);Harrat;Inf. Process. Manag.,2019
5. Successes and challenges of Arabic sentiment analysis research: A literature review;Altrabsheh;Soc. Netw. Anal. Min.,2017