Assessing the Value of Multimodal Interfaces: A Study on Human–Machine Interaction in Weld Inspection Workstations
Author:
Chojecki Paul1ORCID, Strazdas Dominykas2ORCID, Przewozny David1ORCID, Gard Niklas1ORCID, Runde Detlef1ORCID, Hoerner Niklas1ORCID, Al-Hamadi Ayoub2ORCID, Eisert Peter1ORCID, Bosse Sebastian1ORCID
Affiliation:
1. Fraunhofer HHI, 10587 Berlin, Germany 2. Neuro-Information Technology, Otto-von-Guericke-University Magdeburg, 39106 Magdeburg, Germany
Abstract
Multimodal user interfaces promise natural and intuitive human–machine interactions. However, is the extra effort for the development of a complex multisensor system justified, or can users also be satisfied with only one input modality? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and the use of multiple input modalities is valuable and that it is difficult to predict the usability of individual input modalities for complex systems.
Funder
Federal Ministry for Education and Research
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference51 articles.
1. Guidelines for multimodal user interface design;Reeves;Commun. ACM,2004 2. Ten myths of multimodal interaction;Oviatt;Commun. ACM,1999 3. Chojecki, P., Czaplik, M., Voigt, V., and Przewozny, D. (2018). DIVI Jahrbuch 2018/2019, Medizinisch Wissenschaftliche Verlagsgesellschaft. [1st ed.]. DIVI Jahrbuch. 4. Gross, E., Siegert, J., Miljanovic, B., Tenberg, R., and Bauernhansl, T. (2021). Design of Multimodal Interfaces in Human-Robot Assembly for Competence Development, Social Science Research Network. SSRN Scholarly Paper ID 3858769. 5. Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation, chapter AudioVisual and Multimodal Speech-Based Systems;Benoit;Kluwer,2000
|
|