Affiliation:
1. Purdue University, USA
Abstract
Autonomous systems that can assist humans with increasingly complex tasks are becoming ubiquitous. Moreover, it has been established that a human’s decision to rely on such systems is a function of both their trust in the system and their own self-confidence as it relates to executing the task of interest. Given that both under- and over-reliance on automation can pose significant risks to humans, there is motivation for developing autonomous systems that could appropriately calibrate a human’s trust or self-confidence to achieve proper reliance behavior. In this article, a computational model of coupled human trust and self-confidence dynamics is proposed. The dynamics are modeled as a partially observable Markov decision process without a reward function (POMDP/R) that leverages behavioral and self-report data as observations for estimation of these cognitive states. The model is trained and validated using data collected from 340 participants. Analysis of the transition probabilities shows that the proposed model captures the probabilistic relationship between trust, self-confidence, and reliance for all discrete combinations of high and low trust and self-confidence. The use of the proposed model to design an optimal policy to facilitate trust and self-confidence calibration is a goal of future work.
Funder
National Science Foundation
Publisher
Association for Computing Machinery (ACM)
Subject
Artificial Intelligence,Human-Computer Interaction
Reference77 articles.
1. 2018. Amazon Mechanical Turk. https://www.mturk.com/.
2. 2021. MATLAB Optimization Toolbox. https://www.mathworks.com/products/optimization.html#resources.
3. Kumar Akash. 2020. Reimagining Human-machine Interactions through Trust-based Feedback. Thesis. Purdue University Graduate School.
4. A Classification Model for Sensing Human Trust in Machines Using EEG and GSR
5. Human Trust-Based Feedback Control: Dynamically Varying Automation Transparency to Optimize Human-Machine Interactions
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Interpersonal and Human-Automation Trust in an Underwater Mine Detection Task;Proceedings of the Human Factors and Ergonomics Society Annual Meeting;2023-09