Affiliation:
1. Vrije Universiteit Amsterdam
2. Ghent University
3. University Hospital Cologne
4. Bushehr University of Medical Sciences
5. National Brain Mapping Laboratory
Abstract
Abstract
Various studies have shown that medical professionals are prone to follow the incorrect suggestions offered by algorithms, especially when they have limited informational inputs to interrogate and interpret such suggestions and when they have an attitude of relying on them. We examine the effect of correct and incorrect algorithmic suggestions on the diagnosis performance of radiologists when 1) they have no, partial, and extensive informational inputs for explaining the suggestions (study 1) and 2) they are primed to hold a positive, negative, ambivalent, or neutral attitude towards AI (study 2). Our analysis of 2760 decisions made by 92 radiologists conducting 15 mammography examinations show that radiologists' diagnoses follow both incorrect and correct suggestions, despite variations in the explainability inputs and attitudinal priming interventions. We identify and explain various pathways through which radiologists navigate through the decision process and arrive at correct or incorrect decisions. Overall, the findings of both studies show the limited effect of using explainability inputs and attitudinal priming for overcoming the unintended influence of (incorrect) algorithmic suggestions.
Publisher
Research Square Platform LLC
Reference36 articles.
1. Toward a sociology of machine learning explainability: Human–machine interaction in deep neural network-based automated trading;Borch C;Big Data & Society,2022
2. On the Interpretability of Artificial Intelligence in Radiology: Challenges and Opportunities;Reyes M;Radiol Artif Intell,2020
3. Konttila J, Väyrynen K (2022) CHALLENGES OF CURRENT REGULATION OF AI-BASED HEALTHCARE TECHNOLOGY (AIHT) AND POTENTIAL CONSEQUENCES OF THE EUROPEAN AI ACT PROPOSAL
4. Augmenting medical diagnosis decisions? An investigation into physicians’ decision-making process with artificial intelligence;Jussupow E;Inf Syst Res,2021
5. Benjamin M. Abdel-Karim Nicolas Pfeuffer K. Valerie Carl OH (2022) How AI-Based Systems Can Induce Reflections: The Caseof AI-Augmented Diagnostic Work. Management Information systems Quarterly