Affiliation:
1. Knowledge Media Institute, The Open University, United Kingdom
Abstract
Whereas most research in AI system explanation for healthcare applications looks at developing algorithmic explanations targeted at AI experts or medical professionals, the question we raise is: How do we build meaningful explanations for laypeople? And how does a meaningful explanation affect user’s trust perceptions? Our research investigates how the key factors affecting human-AI trust change in the light of human expertise, and how to design explanations specifically targeted at non-experts. By means of a stage-based design method, we map the ways laypeople understand AI explanations in a User Explanation Model. We also map both medical professionals and AI experts’ practice in an Expert Explanation Model. A Target Explanation Model is then proposed, which represents how experts’ practice and layperson’s understanding can be combined to design meaningful explanations. Design guidelines for meaningful AI explanations are proposed, and a prototype of AI system explanation for non-expert users in a breast cancer scenario is presented and assessed on how it affect users’ trust perceptions.
Publisher
Association for Computing Machinery (ACM)
Subject
Artificial Intelligence,Human-Computer Interaction
Reference111 articles.
1. Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and trajectories for explainable, accountable and intelligible systems: An HCI research agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 582.
2. Accenture. 2019. Responsible AI: A Framework for Building Trust in Your AI Solutions. https://www.accenture.com/us-en/insights/us-federal-government/ai-is-ready-are-we
3. Peter Achinstein. 1983. The Nature of Explanation. Oxford University Press on Demand.
4. Amina Adadi and Mohammed Berrada. 2020. Explainable AI for healthcare: From black box to interpretable models. In Embedded Systems and Artificial Intelligence. Springer, 327–337.
5. Herman Aguinis Isabel Villamor and Ravi S. Ramani. 2021. MTurk research: Review and recommendations. Journal of Management 47 4 (2021) 823–837.