Efficacy and Efficiency of Webcast Orientations Versus Live Resident Orientations: Results of a 2-Year Survey

Abstract

Abstract Background Beginning a graduate medical education training program is associated with a steep learning curve for incoming residents. Objective To compare the efficacy and efficiency of live versus webcast formats for Institutional Orientation. Methods This 2-year non-blinded study, with a nonrandomized cohort, compares outcomes for trainees oriented Summer 2005 in a ‘‘live-lecture’’ format with trainees oriented Summer 2006 using a webcast format. Outcomes include posttest success, the time required, presentation quality and utility, and cost. Results In 2005, 249 trainees attended the live orientation. Of the 211 who completed the posttest; 132 (63%) passed it within 3 attempts. Of the 241 trainees in 2006, 236 completed the posttest. Of these, 215 (91%) passed it within 3 attempts. Compared to the live-lecture cohort, the webcast cohort rated the posttest as more difficult. Despite performing better, significantly fewer trainees in the webcast cohort rated the posttest as “appropriate” (χ2 =  5 28.57, df 5 1, P , .001). There were no significant differences between the 2 groups on their perceptions of quality and utility of the presentations. While the first year cost of the webcast exceeded that of live lectures, the amortized cost was nearly identical to the live-lecture costs. Discussion As corroborated by resident comments, the web-based approach was more effective because it provided trainees flexibility regarding when to study, options on how to view the material, and opportunities to review it if needed for mastery. We plan to continue using the webcast strategy, revising the content as needed.