Evaluation of Mobile Apps Used among Medical Students for Learning and Education: A Mixed-Method Concurrent Triangulation Approach

Abstract

Abstract Background The use of medical mobile applications (apps) to enhance learning is widespread in medical education. Despite the large number of medical apps used among medical students for learning, many apps have not been evaluated using validated instruments. Finding relevant and valuable apps for student learning might be difficult. Objective The objective is to evaluate four medical apps (AMBOSS, ISABEL, Medscape, and OSMOSIS) in improving just-in-time learning among medical students using the Mobile App Rubric for Learning (MARuL). Methods We employed a mixed-method concurrent triangulation approach. The study included the entire population of third-year medical students at King Saud University. These students were selected due to their use of medical apps for learning for at least 1 year. The MARuL, which consists of four measures: Teaching and Learning, User-centered, Professional, and Usability, was electronically distributed to medical students for assessment. Descriptive statistics were calculated for all measures, and thematic content analysis was applied to analyze responses to open-ended questions. Results The MARuL evaluation revealed that the OSMOSIS app received the highest Usefulness for Learning Score, with Usability Measures being the most positively evaluated measure. Following was the AMBOSS app, which scored highest in the Professional Measures, along with the Medscape and the ISABEL apps. We identified several key features and challenges from analyzing students' responses to open-ended questions regarding the use of the four medical apps. These included six themes: (1) study support and learning tools, (2) comprehensive information, (3) interface experience, (4) cost and accessibility issues, (5) learning methods and content limitations, and (6) user experience and technical issues. Conclusion Equipping medical students with the ability to evaluate and choose medical apps that facilitate just-in-time learning is a crucial element that should be integrated into the medical curriculum.