Locality is the strongest predictor of expert performance in image-based differentiation of bacterial and fungal corneal ulcers from India

Abstract

Purpose: This study sought to identify the sources of differential performance and misclassification error among local (Indian) and external (non-Indian) corneal specialists in identifying bacterial and fungal keratitis based on corneal photography. Methods: This study is a secondary analysis of survey data assessing the ability of corneal specialists to identify acute bacterial versus fungal keratitis by using corneal photography. One-hundred images of 100 eyes from 100 patients with acute bacterial or fungal keratitis in South India were previously presented to an international cohort of cornea specialists for interpretation over the span of April to July 2021. Each expert provided a predicted probability that the ulcer was either bacterial or fungal. Using these data, we performed multivariable linear regression to identify factors predictive of expert performance, accounting for primary practice location and surrogate measures to infer local fungal ulcer prevalence, including locality, latitude, and dew point. In addition, Brier score decomposition was used to determine experts’ reliability (“calibration”) and resolution (“boldness”) and were compared between local (Indian) and external (non-Indian) experts. Results: Sixty-six experts from 16 countries participated. Indian practice location was the only independently significant predictor of performance in multivariable linear regression. Resolution among Indian experts was significantly better (0.08) than among non-Indian experts (0.01; P < 0.001), indicating greater confidence in their predictions. There was no significant difference in reliability between the two groups (P = 0.40). Conclusion: Local cornea experts outperformed their international counterparts independent of regional variability in tropical risk factors for fungal keratitis. This may be explained by regional characteristics of infectious ulcers with which local corneal specialists are familiar.