Author:
Okada Naoki,Umemura Yutaka,Shi Shoi,Inoue Shusuke,Honda Shun,Matsuzawa Yohsuke,Hirano Yuichiro,Kikuyama Ayano,Yamakawa Miho,Gyobu Tomoko,Hosomi Naohiro,Minami Kensuke,Morita Natsushiro,Watanabe Atsushi,Yamasaki Hiroyuki,Fukaguchi Kiyomitsu,Maeyama Hiroki,Ito Kaori,Okamoto Ken,Harano Kouhei,Meguro Naohito,Unita Ryo,Koshiba Shinichi,Endo Takuro,Yamamoto Tomonori,Yamashita Tomoya,Shinba Toshikazu,Fujimi Satoshi
Abstract
AbstractNumerous COVID-19 diagnostic imaging Artificial Intelligence (AI) studies exist. However, none of their models were of potential clinical use, primarily owing to methodological defects and the lack of implementation considerations for inference. In this study, all development processes of the deep-learning models are performed based on strict criteria of the “KAIZEN checklist”, which is proposed based on previous AI development guidelines to overcome the deficiencies mentioned above. We develop and evaluate two binary-classification deep-learning models to triage COVID-19: a slice model examining a Computed Tomography (CT) slice to find COVID-19 lesions; a series model examining a series of CT images to find an infected patient. We collected 2,400,200 CT slices from twelve emergency centers in Japan. Area Under Curve (AUC) and accuracy were calculated for classification performance. The inference time of the system that includes these two models were measured. For validation data, the slice and series models recognized COVID-19 with AUCs and accuracies of 0.989 and 0.982, 95.9% and 93.0% respectively. For test data, the models’ AUCs and accuracies were 0.958 and 0.953, 90.0% and 91.4% respectively. The average inference time per case was 2.83 s. Our deep-learning system realizes accuracy and inference speed high enough for practical use. The systems have already been implemented in four hospitals and eight are under progression. We released an application software and implementation code for free in a highly usable state to allow its use in Japan and globally.
Funder
Japanese Cabinet Secretariat
Publisher
Springer Science and Business Media LLC
Reference56 articles.
1. Binnicker, M. J. Challenges and controversies to testing for COVID-19. J. Clin. Microbiol. https://doi.org/10.1128/JCM.01695-20 (2020).
2. World Health Organization. Laboratory testing for coronavirus disease 2019 (COVID-19) in suspected human cases: Interim guidance (2020) https://apps.who.int/iris/bitstream/handle/10665/331329/WHO-COVID-19-laboratory-2020.4-eng.pdf.
3. Corman, V. M. et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. https://doi.org/10.2807/1560-7917.ES.2020.25.3.2000045 (2020).
4. Kanne, J. P., Little, B. P., Chung, J. H., Elicker, B. M. & Ketai, L. H. Essentials for radiologists on COVID-19: An update—Radiology scientific expert panel. Radiology 296, E113–E114 (2020).
5. Shi, H. et al. Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: A descriptive study. Lancet Infect. Dis. 20, 425–434 (2020).