Misuse of Automated Aids in Process Control: Complacency, Automation Bias and Possible Training Interventions

Abstract

One important aspect of automation misuse is reflected in an inappropriate monitoring or checking of automated functions, a phenomenon that commonly has been referred to as complacency. The present study investigates complacency effects in interaction with an automated aid in a process control simulation task, as well as its possible performance consequences, i.e. automation bias in terms of commission errors, and impairments of return-to-manual-performance in case of automation breakdown. Furthermore, the effect of a specific training intervention to reduce complacency by exposing participants intentionally to automation failures is investigated. The results provide clear evidence for complacency effects, reflected in an insufficient verification of recommendations provided by the automated aid. Yet, only very high levels of complacency were associated with commission errors, i.e. following an automated advice although it actually is wrong. Exposing operators intentionally to automation failures during training significantly reduced the complacency effect but did not prevent it completely.