Performance evaluation of a computer‐aided polyp detection system with artificial intelligence for colonoscopy

Abstract

ObjectivesA computer‐aided detection (CAD) system was developed to support the detection of colorectal lesions by deep learning using video images of lesions and normal mucosa recorded during colonoscopy. The study's purpose was to evaluate the stand‐alone performance of this device under blinded conditions.MethodsThis multicenter prospective observational study was conducted at four Japanese institutions. We used 326 videos of colonoscopies recorded with patient consent at institutions in which the Ethics Committees approved the study. The sensitivity of successful detection of the CAD system was calculated using the target lesions, which were detected by adjudicators from two facilities for each lesion appearance frame; inconsistencies were settled by consensus. Successful detection was defined as display of the detection flag on the lesion for more than 0.5 s within 3 s of appearance.ResultsOf the 556 target lesions from 185 cases, detection success sensitivity was 97.5% (95% confidence interval [CI] 95.8–98.5%). The “successful detection sensitivity per colonoscopy” was 93% (95% CI 88.3–95.8%). For the frame‐based sensitivity, specificity, positive predictive value, and negative predictive value were 86.6% (95% CI 84.8–88.4%), 84.7% (95% CI 83.8–85.6%), 34.9% (95% CI 32.3–37.4%), and 98.2% (95% CI 97.8–98.5%), respectively.Trial registrationUniversity Hospital Medical Information Network (UMIN000044622).