Assessing the Accuracy of Otomatch.com Data for Individuals Applying to Otolaryngology Residency

Abstract

Objectives: Otomatch.com is an online forum for residency applicants to discuss the otolaryngology match process including academic metrics. The purpose of this study is to assess the accuracy of self-reported match data on Otomatch relative to official data reported by the National Residency Match Program (NRMP) and the Association of American Medical Colleges (AAMC). Methods: Data was collected from publicly editable Otomatch forums (2017-2018, 2018-2019, 2019-2020) and curated Otomatch survey responses (2018-2019, 2019-2020) whose results are released after Match Day. Aggregated data was collected from the NRMP 2018 and 2020 Charting Outcomes in the Match and AAMC Report on Residents (2017-2018, 2018-2019). Measures of interest included Step 1 scores, Step 2 CK scores, publications, number of interview invitations, number of interviews attended, and AOA status. ANOVA and 2 tailed T tests were performed to compare variables within each match year. Results: Average Step 2 CK score was significantly higher on publicly editable Otomatch forums than AAMC in 2017-2018 (257vs 253, P < .05) and 2018-2019 (258vs 252, P < .05). Interviews attended were significantly higher on Otomatch survey responses than the publicly editable forum in 2019-2020 (13vs 9, P-value < .05). Step 1 scores, interview invitations, and AOA status were not statistically significantly different when data was available. Conclusion: Applicant statistics from online forums, online surveys, NRMP, and AAMC are consistent, except for Step 2 CK scores. Self-reported data on the Otomatch forum is an accurate estimate of academic metrics of otolaryngology residency applicants.