Development of mobile CAT for patient feedback on pediatric consultations based on Rasch analysis of online techniques

Abstract

The Rasch Rating Scale Model (RSM) is widely used in questionnaire analysis, providing insights into how individuals respond to item-level stimuli. Existing software for Rasch RSM parameter estimation, while powerful, often presents a steep learning curve. An accessible online tool can greatly benefit novice users, particularly students and clinicians, by simplifying the analytical process. This study introduces an online tool, an intuitive online RSM analysis tool designed to facilitate questionnaire data analysis for applied researchers, students, and clinicians. The online tool employs the joint maximum likelihood method for estimation, yielding estimates, standard errors (SE), and fit statistics iteratively. A unique feature of the tool is its ability to visualize estimates on Google Maps with an opacity setting of 0, enhancing data interpretation through a user-friendly interface. This study outlines the estimation process and key features, employing data from 200 proxy participants who answered 20 5-point questions regarding doctor-patient and doctor-family interactions in pediatric consultations. Mobile computerized adaptive testing (CAT) was employed. The online tool offers 5 essential visual displays often utilized in Rasch analyses, including the Wright Map, KIDMAP, category probability curve, performance plot, and differential item functioning (DIF) graph. DIF analysis revealed that 2 items, concerning the doctor attentiveness and empathy toward the child illness, exhibited differences in female proxy participants’ responses, indicating lower satisfaction with pediatricians. The online tool emerges as a user-friendly and efficient RSM analysis tool with notable advantages for newcomers, improving data visualization and comprehension. Its capacity to pinpoint key areas of concern, such as gender-related satisfaction disparities among proxy participants, enhances its utility in questionnaire analysis. The online tool holds promise as a valuable resource for researchers, students, and clinicians seeking accessible Rasch analysis solutions.