e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score

Abstract

Introduction There is increased interest in the use of artificial intelligence-based (AI) software packages in the evaluation of neuroimaging studies for acute ischemic stroke. We studied whether, compared to standard image interpretation without AI, Brainomix e-ASPECTS software improved interobserver agreement and accuracy in detecting ASPECTS regions affected in anterior circulation LVO. Methods We included 60 consecutive patients with anterior circulation LVO who had TICI 3 revascularization within 60 minutes of their baseline CT. A total of 16 readers, including senior neuroradiologists, junior neuroradiologists and vascular neurologists participated. Readers interpreted CT scans on independent workstations and assessed final ASPECTS and evaluated whether each individual ASPECTS region was affected. Two months later, readers again evaluated the CT scans, but with assistance of e-ASPECTS software. We assessed interclass correlation coefficient for total ASPECTS and interobserver agreement with Fleiss’ Kappa for each ASPECTS region with and without assistance of the e-ASPECTS. We also assessed accuracy for the readers with and without e-ASPECTS assistance. In our assessment of accuracy, ground truth was the 24 hour CT in this cohort of patients who had prompt and complete revascularization. Results Interclass correlation coefficient for total ASPECTS without e-ASPECTS assistance was 0.395, indicating fair agreement compared, to 0.574 with e-ASPECTS assistance, indicating good agreement (P < 0.01). There was significant improvement in inter-rater agreement with e-ASPECTS assistance for each individual region with the exception of M6 and caudate. The e-ASPECTS software had higher accuracy than the overall cohort of readers (with and without e-ASPECTS assistance) for every region except the caudate. Conclusions Use of Brainomix e-ASPECTS software resulted in significant improvements in inter-rater agreement and accuracy of ASPECTS score evaluation in a large group of neuroradiologists and neurologists. e-ASPECTS software was more predictive of final infarct/ASPECTS than the overall group interpreting the CT scans with and without e-ASPECTS assistance.