Affiliation:
1. Division of Upper GI and General Surgery, Keck School of Medicine of USC, Los Angeles, CA, USA
2. Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, Los Angeles, CA, USA
3. Department of Surgery, Phoenix Health Sciences Campus, Creighton University School of Medicine, Phoenix, AZ, USA
Abstract
There are currently no studies examining differences in perceptions and expected impact of the Step 1 score change to pass/fail between surgical and non-surgical program directors (PDs). We conducted a systematic review in May 2023 of PubMed, Scopus, Web of Science, and PSYCInfo to evaluate studies examining PDs’ perspectives regarding the Step 1 score change. We performed random-effects meta-analyses to determine differences in perspectives among surgical and non-surgical PDs. Surgical PDs (76.8% [95% CI, 72.1%-82.0%], I2 = 52%) reported significantly greater rates of disagreement with the score change compared to non-surgical (65.1% [95% CI, 57.9%-73.1%], I2 = 69.7%) ( P = .01). Surgical PDs also reported significantly greater rates of agreement that the score change will increase the difficulty in objectively comparing applicants (88.1% [95% CI, 84.6%-91.7%], I2 = 16.4%), compared to non-surgical (81.0% [95% CI, 75.6%-86.8%], I2 = 72.6%) ( P = .04). There was less heterogeneity among non-surgical PDs (88.7% [95% CI, 86.2%-91.2%], I2 = 0%), compared to surgical (84.7% [95% CI, 79.0%-90.8%], I2 = 67.3%), regarding expected increases in emphasis on Step 2, although the difference in rates of agreement was not statistically significant. Overall, there is significant heterogeneity in the literature regarding expected changes in the residency application review process. Most PDs reported significant disagreement with the score change, greater expected difficulty in objectively evaluating applicants, and greater emphasis on Step 2, with surgical PDs reporting greater rates of disagreement, greater expected difficulty, and heterogeneity regarding expected increases in emphasis on Step 2, compared to non-surgical. Additionally, there is significant heterogeneity in the overall literature regarding expected changes in the residency application review process. Further research is needed to establish evidence-based guidelines that improve the overall residency application process for all stakeholders.
Reference50 articles.
1. USMLE step 1 transition to pass/fail only score reporting|USMLE. https://www.usmle.org/usmle-step-1-transition-passfail-only-score-reporting Accessed July 16, 2023.
2. 2021 PD Survey Report for. https://www.nrmp.org/wp-content/uploads/2021/11/2021-PD-Survey-Report-for-pdf Accessed June 13, 2022.
3. Current Views on the New United States Medical Licensing Examination Step 1 Pass/Fail Format: A Review of the Literature
4. Results of a National Survey of Program Directors’ Perspectives on a Pass/Fail US Medical Licensing Examination Step 1
5. Ottawa Hospital Research Institute. https://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed 10 July 2022.