Radiologists' Expectations of Artificial Intelligence in Pancreatic Cancer Imaging: How Good Is Good Enough?

Abstract

Background Existing (artificial intelligence [AI]) tools in radiology are modeled without necessarily considering the expectations and experience of the end user—the radiologist. The literature is scarce on the tangible parameters that AI capabilities need to meet for radiologists to consider them useful tools. Objective The purpose of this study is to explore radiologists' attitudes toward AI tools in pancreatic cancer imaging and to quantitatively assess their expectations of these tools. Methods A link to the survey was posted on the www.ctisus.com website, advertised in the www.ctisus.com email newsletter, and publicized on LinkedIn, Facebook, and Twitter accounts. This survey asked participants about their demographics, practice, and current attitudes toward AI. They were also asked about their expectations of what constitutes a clinically useful AI tool. The survey consisted of 17 questions, which included 9 multiple choice questions, 2 Likert scale questions, 4 binary (yes/no) questions, 1 rank order question, and 1 free text question. Results A total of 161 respondents completed the survey, yielding a response rate of 46.3% of the total 348 clicks on the survey link. The minimum acceptable sensitivity of an AI program for the detection of pancreatic cancer chosen by most respondents was either 90% or 95% at a specificity of 95%. The minimum size of pancreatic cancer that most respondents would find an AI useful at detecting was 5 mm. Respondents preferred AI tools that demonstrated greater sensitivity over those with greater specificity. Over half of respondents anticipated incorporating AI tools into their clinical practice within the next 5 years. Conclusion Radiologists are open to the idea of integrating AI-based tools and have high expectations regarding the performance of these tools. Consideration of radiologists' input is important to contextualize expectations and optimize clinical adoption of existing and future AI tools.