Efficacy and accuracy of artificial intelligence to overlay multimodal images from different optical instruments in patients with retinitis pigmentosa

Abstract

AbstractBackgroundRetinitis pigmentosa (RP) represents a group of progressive, genetically heterogenous blinding diseases. Recently, relationships between measures of retinal function and structure are needed to help identify outcome measures or biomarkers for clinical trials. The ability to align retinal multimodal images, taken on different platforms, will allow better understanding of this relationship. We investigate the efficacy of artificial intelligence (AI) in overlaying different multimodal retinal images in RP patients.MethodsWe overlayed infrared images from microperimetry on near‐infra‐red images from scanning laser ophthalmoscope and spectral domain optical coherence tomography in RP patients using manual alignment and AI. The AI adopted a two‐step framework and was trained on a separate dataset. Manual alignment was performed using in‐house software that allowed labelling of six key points located at vessel bifurcations. Manual overlay was considered successful if the distance between same key points on the overlayed images was ≤1/2°.ResultsFifty‐seven eyes of 32 patients were included in the analysis. AI was significantly more accurate and successful in aligning images compared to manual alignment as confirmed by linear mixed‐effects modelling (p < 0.001).A receiver operating characteristic analysis, used to compute the area under the curve of the AI (0.991) and manual (0.835) Dice coefficients in relation to their respective ‘truth’ values, found AI significantly more accurate in the overlay (p < 0.001).ConclusionAI was significantly more accurate than manual alignment in overlaying multimodal retinal imaging in RP patients and showed the potential to use AI algorithms for future multimodal clinical and research applications.