Affiliation:
1. Department of Information Technology, College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia
2. Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh 11653, Saudi Arabia
Abstract
Improving the quality of healthcare services is of the utmost importance in healthcare systems. Patient experience is a key aspect that should be gauged and monitored continuously. However, the measurement of such a vital indicator typically cannot be carried out directly, instead being derived from the opinions of patients who usually express their experience in free text. When it comes to patient comments written in the Arabic language, the currently used strategy to classify Arabic comments is totally reliant on human annotation, which is time-consuming and prone to subjectivity and error. Thus, fully using the value of patient feedback in a timely manner is difficult. This paper addresses the problem of classifying patient experience (PX) comments written in Arabic into 25 classes by using deep learning- and BERT-based models. A real-world data set of patient comments is obtained from the Saudi Ministry of Health for this purpose. Features are extracted from the data set, then used to train deep learning-based classifiers—including BiLSTM and BiGRU—for which pre-trained static word embedding and pre-training vector word embeddings are utilized. Furthermore, we utilize several Arabic pre-trained BERT models, in addition to building PX_BERT, a customized BERT model using the PX unlabeled database. From the experimental results for the 28 classifiers built in this study, the best-performing models (based on the F1 score) are found to be PX_BERT and AraBERTv02. To the best of our knowledge, this is the first study to tackle PX comment classification for the Arabic language.
Funder
Research Center of the Female Scientific and Medical Colleges, Deanship of Scientific Research, King Saud University
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference69 articles.
1. Defining Patient Experience;Wolf;Patient Exp. J.,2014
2. Patient experience or patient satisfaction? A systematic review of child- and family-reported experience measures in pediatric surgery;Ferreira;J. Pediatr. Surg.,2023
3. (2023, January 13). Lumeon’s Report. Available online: https://info.lumeon.com/patient-access-leadership-research-report.
4. (2023, January 03). Ministry of Health Saudi Arabia, Available online: https://www.moh.gov.sa/en/Pages/Default.aspx.
5. Alimova, I., Tutubalina, E., Alferova, J., and Gafiyatullina, G. (December, January 30). A Machine Learning Approach to Classification of Drug Reviews in Russian. Proceedings of the 2017 Ivannikov ISPRAS Open Conference (ISPRAS), Moscow, Russia.