Comparing artificial intelligence to humans for endoscopic diagnosis of gastric neoplasia: An external validation study

Abstract

AbstractObjectivesArtificial intelligence (AI) uses deep learning functionalities that may enhance the detection of early gastric cancer during endoscopy. An AI‐based endoscopic system for upper endoscopy was recently developed in Japan. We aim to validate this AI‐based system in a Singaporean cohort.MethodsThere were 300 de‐identified still images prepared from endoscopy video files obtained from subjects that underwent gastroscopy in National University Hospital (NUH). Five specialists and 6 non‐specialists (trainees) from NUH were assigned to read and categorize the images into “neoplastic” or “non‐neoplastic.” Results were then compared with the readings performed by the endoscopic AI system.ResultsThe mean accuracy, sensitivity, and specificity for the 11 endoscopists were 0.847, 0.525, and 0.872, respectively. These values for the AI‐based system were 0.777, 0.591, and 0.791, respectively. While AI in general did not perform better than endoscopists on the whole, in the subgroup of high‐grade dysplastic lesions, only 29.1% were picked up by the endoscopist rating, but 80% were classified as neoplastic by AI (P = 0.0011). The average diagnostic time was also faster in AI compared with endoscopists (677.1 s vs 42.02 s (P < 0.001).ConclusionWe demonstrated that an AI system developed in another health system was comparable in diagnostic accuracy in the evaluation of static images. AI systems are faster and not fatigable and may have a role in augmenting human diagnosis during endoscopy. With more advances in AI and larger studies to support its efficacy it would likely play a larger role in screening endoscopy in future.