Automated Assessment of Knowledge and Skills at the National Russian Therapy Olympiad with International Participation in 2023

Abstract

The development of modern systems and technologies creates new requirements for the education system every day, provides new opportunities for the development of educational methods, consumer coverage and data science. The experience gained as a result of the transfer of the Therapy Olympiad in 2021 to a remote format proved its success and prompted the development of the Olympiad in this direction. On March 21–22, 2023, the III National Russian Therapy Olympiad with international participation in online format was organized. As a result, 2,120 students, residents and schoolchildren from Russia, Uzbekistan, Kazakhstan, Belarus, Kyrgyzstan, Tajikistan, Azerbaijan, and India took part in the Olympiad. This article analyzes the Olympiad in order to study the possibility of conducting an automated assessment of knowledge and skills formed by students of 4–6 courses of specialty and residents of the therapeutic profile and other medical specialties. The following evaluation tools were used: knowledge testing using a distance learning system and assessment of practical skills using a Dimedus computer virtual on-screen patient simulator. The analysis of the results showed that the base of the formed test mini-cases and clinical cases is valid, reliable and can be used for automated assessment of knowledge and skills of students in specialty and residency programs of therapeutic profile. Statistical data and feedback data showed the involvement in the process and the interest of students in the chosen assessment format.