Effects of Urgency and Cognitive Load on Interaction in Highly Automated Vehicles-Reference-Cited by-同舟云学术

Effects of Urgency and Cognitive Load on Interaction in Highly Automated Vehicles

Published:2023-09-11 Issue:MHCI Volume:7 Page:1-20
ISSN:2573-0142
Container-title:Proceedings of the ACM on Human-Computer Interaction
language:en
Short-container-title:Proc. ACM Hum.-Comput. Interact.

Author:

Colley Mark¹^ORCID,Evangelista Cristina¹^ORCID,Rubiano Tito Daza¹^ORCID,Rukzio Enrico¹^ORCID

Affiliation:

1. Ulm University, Ulm, Germany

Abstract

In highly automated vehicles, passengers can engage in non-driving-related activities. Additionally, the technical advancement allows for novel interaction possibilities such as voice, gesture, gaze, touch, or multimodal interaction, both to refer to in-vehicle and outside objects (e.g., thermostat or restaurant). This interaction can be characterized by levels of urgency (e.g., based on late detection of objects) and cognitive load (e.g., because of watching a movie or working). Therefore, we implemented a Virtual Reality simulation and conducted a within-subjects study with N=11 participants evaluating the effects of urgency and cognitive load on modality usage in automated vehicles. We found that while all modalities were possible to use, participants relied on touch the most. This was followed by gaze, especially for external referencing. This work helps to further understand multimodal interaction and the requirements this poses on natural interaction in (automated) vehicles.

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)

Link

https://dl.acm.org/doi/pdf/10.1145/3604254

Reference62 articles.

1. Abdul Rafey Aftab and Michael von der Beeck. 2022. Multimodal Driver Referencing: A Comparison of Pointing to Objects Inside and Outside the Vehicle . In 27th International Conference on Intelligent User Interfaces ( Helsinki, Finland) (IUI '22). Association for Computing Machinery, New York, NY, USA, 483--495. https://doi.org/10.1145/3490099.3511142 10.1145/3490099.3511142 Abdul Rafey Aftab and Michael von der Beeck. 2022. Multimodal Driver Referencing: A Comparison of Pointing to Objects Inside and Outside the Vehicle. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI '22). Association for Computing Machinery, New York, NY, USA, 483--495. https://doi.org/10.1145/3490099.3511142

2. Abdul Rafey Aftab , Michael von der Beeck, and Michael Feld. 2020. You have a point there: object selection inside an automobile using gaze, head pose and finger pointing . In Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery , New York, NY, USA, 595--603. Abdul Rafey Aftab, Michael von der Beeck, and Michael Feld. 2020. You have a point there: object selection inside an automobile using gaze, head pose and finger pointing. In Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, New York, NY, USA, 595--603.

3. Touchscreen usability and input performance in vehicles under different road conditions

4. How to Interact with a Fully Autonomous Vehicle: Naturalistic Ways for Drivers to Intervene in the Vehicle System While Performing Non-Driving Related Tasks

5. Pradeep K Atrey , M Anwar Hossain , Abdulmotaleb El Saddik, and Mohan S Kankanhalli . 2010 . Multimodal fusion for multimedia analysis: a survey. Multimedia systems 16, 6 (2010), 345--379. Pradeep K Atrey, M Anwar Hossain, Abdulmotaleb El Saddik, and Mohan S Kankanhalli. 2010. Multimodal fusion for multimedia analysis: a survey. Multimedia systems 16, 6 (2010), 345--379.