Effects of Imperfect Automation on Decision Making in a Simulated Command and Control Task

Abstract

Objective: Effects of four types of automation support and two levels of automation reliability were examined. The objective was to examine the differential impact of information and decision automation and to investigate the costs of automation unreliability. Background: Research has shown that imperfect automation can lead to differential effects of stages and levels of automation on human performance. Method: Eighteen participants performed a “sensor to shooter” targeting simulation of command and control. Dependent variables included accuracy and response time of target engagement decisions, secondary task performance, and subjective ratings of mental workload, trust, and self-confidence. Results: Compared with manual performance, reliable automation significantly reduced decision times. Unreliable automation led to greater cost in decision-making accuracy under the higher automation reliability condition for three different forms of decision automation relative to information automation. At low automation reliability, however, there was a cost in performance for both information and decision automation. Conclusion: The results are consistent with a model of human-automation interaction that requires evaluation of the different stages of information processing to which automation support can be applied. Application: If fully reliable decision automation cannot be guaranteed, designers should provide users with information automation support or other tools that allow for inspection and analysis of raw data.