An External Validation Study for Automated Segmentation of Vestibular Schwannoma

Abstract

Objective To validate how an automated model for vestibular schwannoma (VS) segmentation developed on an external homogeneous dataset performs when applied to internal heterogeneous data. Patients The external dataset comprised 242 patients with previously untreated, sporadic unilateral VS undergoing Gamma Knife radiosurgery, with homogeneous magnetic resonance imaging (MRI) scans. The internal dataset comprised 10 patients from our institution, with heterogeneous MRI scans. Interventions An automated VS segmentation model was developed on the external dataset. The model was tested on the internal dataset. Main Outcome Measure Dice score, which measures agreement between ground truth and predicted segmentations. Results When applied to the internal patient scans, the automated model achieved a mean Dice score of 61% across all 10 images. There were three tumors that were not detected. These tumors were 0.01 ml on average (SD = 0.00 ml). The mean Dice score for the seven tumors that were detected was 87% (SD = 14%). There was one outlier with Dice of 55%—on further review of this scan, it was discovered that hyperintense petrous bone had been included in the tumor segmentation. Conclusions We show that an automated segmentation model developed using a restrictive set of siloed institutional data can be successfully adapted for data from different imaging systems and patient populations. This is an important step toward the validation of automated VS segmentation. However, there are significant shortcomings that likely reflect limitations of the data used to train the model. Further validation is needed to make automated segmentation for VS generalizable.