Affiliation:
1. Collaborative Robotics and Intelligent Systems (CoRIS) Institute, USA
Abstract
Nonverbal sound offers great potential to enhance robots’ interactions with humans, and a growing body of research has begun to explore nonverbal sound for tasks such as sound source localization, explicit communication, and improving sociability. However, nonverbal sound has a broad interpretation and design space that can draw from areas such as machine learning, music theory, and foley. We sought to identify and compare use cases and approaches for nonverbal sound in human-robot interaction through a systematic review. A search of sound and robotics-related publisher databases yielded 148 peer-reviewed articles presenting systems, studies, and taxonomies. Differences in taxonomy and overlap of terminology with adjacent research fields such as speech, gaze, and gesture posed difficulties for the search, which we attempted to address through a multi-stage search process. Based on the reviewed articles, we developed a pair of taxonomies using scientific communication principles and analyzed study designs and measures for the creation of nonverbal robot sound. We discuss recommendations for the field, including the use of the new taxonomies; methods for design, generation, and validation; and paths for future research. Roboticists may benefit from incorporating nonverbal sound as a key component in multimodal human-robot interaction.
Publisher
Association for Computing Machinery (ACM)
Subject
Artificial Intelligence,Human-Computer Interaction
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. PepperOSC: enabling interactive sonification of a robot’s expressive movement;Journal on Multimodal User Interfaces;2023-09-09
2. Hearing it Out: Guiding Robot Sound Design through Design Thinking;2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN);2023-08-28
3. The Road Ahead: Advancing Interactions between Autonomous Vehicles, Pedestrians, and Other Road Users;2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN);2023-08-28