Exploring Progression: A Case Study on Student Performance Using the National Clinical Assessment Tool in Emergency Medicine

Abstract

Entrustable Professional Activities-based (EPAs-based) assessments gained much interest among clinical educators, especially after the AAMC publication in 2014. In 2016, a standardized tool, the National Clinical Assessment Tool for Medical Students in Emergency Medicine (NCAT-EM), was developed at a national conference. Since 2018, the modified NCAT-EM has been used at Central Michigan University School of Medicine at shift ends, midway through clerkships, and upon completion of the clerkship. This empirical study analyzed student performance progression in order to enhance school assessment practices and inform future action plans. Descriptive and inferential statistics were calculated. During the 2021–2022 academic year, 89 faculty and residents assessed 97 students on 238 submission days. The students generally received multiple sets of daily shift feedback. Two domains, note writing and practice-based learning, showed significant differences between the mid-clerkship formative and summative scoring. Professionalism issues were evident with this cohort of students. The study provides some validity evidence regarding student performance and progression within the context. The NCAT-EM provides values and benefits as evidenced by the substantial volume of assessor feedback during its fourth year of implementation. This study provides directions for future action plans for faculty training, promising continuous improvement in emergency medicine assessment practices.