Grad-CAM-Based Investigation into Acute-Stage Fluorescein Angiography Images to Predict Long-Term Visual Prognosis of Branch Retinal Vein Occlusion

Abstract

Background/Objectives: The purpose of this study was to analyze relevant areas in acute-stage fluorescein angiography (FA) images, predicting the long-term visual prognosis of branch retinal vein occlusion (BRVO) based on gradient-weighted class activation mapping (Grad-CAM). Methods: This retrospective observational study included 136 eyes with BRVO that were followed up for more than a year post-FA. Cropped grayscale images centered on the fovea (200 × 200 pixels) were manually pre-processed from early-phase FA at the acute phase. Pairs of the cropped FA images and the best-corrected visual acuity (BCVA) in remission at least one year post-FA were used to train a 38-layer ResNet with five-fold cross-validation. Correlations between the ResNet-predicted and true (actually measured) logMAR BCVAs in remission, and between the foveal avascular zone (FAZ) area measured by ImageJ (version 1.52r) from FA images and true logMAR BCVA in remission were evaluated. The heat maps generated by Grad-CAM were evaluated to determine which areas were consumed as computational resources for BCVA prediction. Results: The correlation coefficient between the predicted and true logMAR BCVAs in remission was 0.47, and that between the acute-stage FAZ area and true logMAR BCVA in remission was 0.42 (p < 0.0001 for both). The Grad-CAM-generated heat maps showed that retinal vessels adjacent to the FAZ and the FAZ per se had high selectivity (95.7% and 62.2%, respectively). Conclusions: The Grad-CAM-based analysis demonstrated FAZ-neighboring vessels as the most relevant predictor for the long-term visual prognosis of BRVO.