An Entrustable Professional Activities Model for Assessment of Undergraduate Competence in Anesthesia and Surgery: Performance of the Assessment Scheme and the Impact of Assessment Timing and Variation in Structure of Teaching Activities on Student Outcomes

Abstract

An entrustable professional activity (EPA) model was used to assess the anesthesia and surgery competence of year 4 students during elective neutering procedures over 3 academic years (cohort A, cohort B, and cohort C). Two competence thresholds were defined by an expert panel, the minimum acceptable standard (MAS) and the standard expected at the start of final-year rotations (SFR). The assessment scheme performed as expected, and the median level of supervision achieved by students either matched or exceeded the SFR for all EPAs except one, which matched the MAS. Semester of assessment was associated with student performance, with more students in semester 2 achieving the SFR. In the EPAs assessing pain management, documentation, and patient discharge, cohort A was associated with reduced student performance; this could be explained by changes in the delivery of teaching that enhanced performance in subsequent cohorts (academic years). For all EPAs combined and for EPAs 3, 5, 6, 8, and 9, student performance at the SFR was associated with academic year. For all EPAs combined and EPAs 3, 8, and 9, there was a reduction in the proportion of students achieving the SFR threshold in each successive year. At the MAS, the only association for all EPAs combined was with cohort C. This progressive reduction in performance may have been related to the negative effect of decreased time spent at the neutering clinic and loss of feedback opportunities outweighing the positive effects of increased staff:student ratio and improvements in the preparative phases.