Applicant Evaluation of Residency Programs in a Virtual Format: A Mixed-Methods Study

Abstract

Background and Objectives: The first all-virtual residency application cycle took place in 2021. Virtual programming can reduce cost, time, and travel burden; these may be especially beneficial to applicants with fewer resources and those from underrepresented backgrounds (URM). Little is known about how applicants evaluate key ranking factors, especially in a virtual format. This study aimed to assess how applicants evaluated programs in the virtual cycle. Methods: We surveyed 271 fourth-year students at three Chicago medical schools after rank-list submission and prior to receiving match results in March 2021. The survey included questions on online content and importance of different ranking factors as well as open-ended questions on how participants evaluated their most important factors. We analyzed quantitative data using descriptive statistics and χ2 tests. We analyzed qualitative data using thematic content analysis. Results: Applicants cited goodness of fit, geographic location, program reputation, fellowship opportunities, and work/life balance as the top-five most important factors. URM applicants were more likely to prioritize diversity at institution or location (P<.0001). Interactions with residents and faculty and opportunities to observe interprogram dynamics were key to assessing fit but were often limited by the virtual format. Additional emergent themes provided recommendations for future cycles. Program websites and videos were rated as the most important online content types. Conclusions: This study provides information about how applicants evaluated the factors they deemed most important in assessing and ranking programs, which can help residency programs improve their recruitment efforts.