The Challenge of Advanced Driver Assistance Systems Assessment: A Scale for the Assessment of the Human–Machine Interface of Advanced Driver Assistance Technology

Abstract

Despite driver assistance systems being engineered to enhance safety, recent studies show the potential for some of these systems and deficient human–machine interfaces to cause unintended consequences on safety. The NHTSA, the Alliance of Automotive Manufacturers, and the European Commission have all released best practices and human factors guidelines for the development and assessment of function-aspecific interfaces. However, given their broad scope, none of these documents provides a rating and benchmarking tool for assessing design aspects pertinent to a wide spectrum of assistance systems, ranging from rearview cameras to lane keeping assist systems. In this article we detail the development of a scale for assessing the human–machine interfaces of 10 different assistance systems. The scale contains 59 items, developed through multiple iterations, in which a total of 94 distinct assistance systems available on vehicles of different makes and models underwent evaluation. For each system included, we provide a description of its characteristics, a list of items for assessment, and relevant references. Widely accepted industry (ISO, SAE) standards, design guidelines, and assessment methodologies were considered for the development of this scale. The adoption of this scale required at least two evaluators to rate each system against specific assessment items using the following 4-point scale: No Concern (3 points), Minor Concerns (2 points), Serious Concerns (1 point), Not Applicable (0 points). Final ratings resulting from this evaluation will aid evaluators in the benchmarking process, and in determining what specific design aspects of the systems assessed merit further attention.