Relationship Between “Simulated Patient Scenarios and Role-Playing” Method and OSCE Performance in Senior Anesthesiology Residents: A Correlation Assessment Study

Abstract

Background: “Simulated-patient scenarios and role-playing” and OSCE are among the many non-traditional education methods with variable results in different clinical settings. Objectives: This cross-sectional study was performed to assess the correlation between the results of these two methods in senior anesthesiology residents, with a special focus on four of the six ACGME core competencies. Methods: During two years, senior anesthesiology residents were subject to “simulated patient scenario and role-playing” sessions. Two faculty members took the role of the patient and one of the relatives. An objective checklist with 15 items was prepared to be rated by other department faculty members. Meanwhile, an ordered pattern of OSCE was prepared to cover four core competencies that were more related to this academic process (from a total of six core competencies). The mean and standard deviation of the score of each of the 15 items in the checklist were calculated. The correlation between cumulative checklist scoring results and OSCE exam results was assessed. A P value of less than 0.05 was considered significant. Results: A total of 40 senior anesthesiology residents, with 344 assessments by faculty members in 40 sessions, were enrolled in the study. The questionnaire’s Cronbach’s alpha reliability was 0.74. No statistically significant disparity was detected between the results of the two assessment methods, while the results of the two assessments had a significant correlation (two-tailed correlation coefficient = 0.886; P value < 0.001). Conclusions: There was an objective relationship between the results of “simulated patient scenario and role-playing” strategies and the results of OSCE exams using an observer-based rating method. Thus, they could be used as surrogates in the assessment of core clinical competencies of senior anesthesiology residents.