Affiliation:
1. Social Robotics Lab, Yale University, USA
Abstract
Social robots in the home will need to solve audio identification problems to better interact with their users. This article focuses on the classification between (a)
natural
conversation that includes at least one co-located user and (b)
media
that is playing from electronic sources and does not require a social response, such as television shows. This classification can help social robots detect a user’s social presence using sound. Social robots that are able to solve this problem can apply this information to assist them in making decisions, such as determining when and how to appropriately engage human users. We compiled a dataset from a variety of acoustic environments that contained either
natural
or
media
audio, including audio that we recorded in our own homes. Using this dataset, we performed an experimental evaluation on a range of traditional machine learning classifiers and assessed the classifiers’ abilities to generalize to new recordings, acoustic conditions, and environments. We conclude that a C-Support Vector Classification (SVC) algorithm outperformed other classifiers. Finally, we present a classification pipeline that in-home robots can utilize, and we discuss the timing and size of the trained classifiers as well as privacy and ethics considerations.
Funder
National Science Foundation
Office of Naval Research
NSF Graduate Research Fellowship
NASEM Ford Predoctoral Fellowship
Publisher
Association for Computing Machinery (ACM)
Subject
Artificial Intelligence,Human-Computer Interaction
Reference49 articles.
1. Speech and Music Classification and Separation: A Review
2. homeSound: Real-Time Audio Event Detection Based on High Performance Computing for Behaviour and Surveillance Remote Monitoring
3. Automatic Scene Recognition through Acoustic Classification for Behavioral Robotics
4. The fifth “CHiME” speech separation and recognition challenge: Dataset, task and baselines;Barker Jon Philip;Proceedings of the Interspeech Conference,2018
5. Classification of musical genre: A machine learning approach;Basili Roberto;Proceedings of the International Society for Music Information Retrieval (ISMIR’04),2004