Abstract
AbstractThe use of voice recordings in both research and industry practice has increased dramatically in recent years—from diagnosing a COVID-19 infection based on patients’ self-recorded voice samples to predicting customer emotions during a service center call. Crowdsourced audio data collection in participants’ natural environment using their own recording device has opened up new avenues for researchers and practitioners to conduct research at scale across a broad range of disciplines. The current research examines whether fundamental properties of the human voice are reliably and validly captured through common consumer-grade audio-recording devices in current medical, behavioral science, business, and computer science research. Specifically, this work provides evidence from a tightly controlled laboratory experiment analyzing 1800 voice samples and subsequent simulations that recording devices with high proximity to a speaker (such as a headset or a lavalier microphone) lead to inflated measures of amplitude compared to a benchmark studio-quality microphone while recording devices with lower proximity to a speaker (such as a laptop or a smartphone in front of the speaker) systematically reduce measures of amplitude and can lead to biased measures of the speaker’s true fundamental frequency. We further demonstrate through simulation studies that these differences can lead to biased and ultimately invalid conclusions in, for example, an emotion detection task. Finally, we outline a set of recording guidelines to ensure reliable and valid voice recordings and offer initial evidence for a machine-learning approach to bias correction in the case of distorted speech signals.
Publisher
Springer Science and Business Media LLC
Subject
General Psychology,Psychology (miscellaneous),Arts and Humanities (miscellaneous),Developmental and Educational Psychology,Experimental and Cognitive Psychology
Reference67 articles.
1. Abelin, Å., & Allwood, J. (2000). Cross linguistic interpretation of emotional prosody. International Tutorial and Research Workshop on Speech and Emotion (pp. 110–113). http://www.isca-speech.org/archive_open/speech_emotion/spem_110.html
2. Alsabek, M. B., Shahin, I., & Hassan, A. (2020). Studying the similarity of COVID-19 sounds based on correlation analysis of MFCC. 2020 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI) (pp. 1–5).
3. Amazon.com. (2017). Echo (2nd Generation) - Smart speaker with Alexa and Dolby processing. https://www.amazon.com/All-New-Amazon-Echo-Speaker-with-Wifi-Alexa-Dark-Charcoal/Dp/B06XCM9LJ4/Ref=sr_1_7?Crid=2QW0QIO5HS6BI&keywords=amazon+echo&qid=1671992865&sprefix=amazon+echo%2Caps%2C268&sr=8-7
4. Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015). Features and classifiers for emotion recognition from speech: A survey from 2000 to 2011. Artificial Intelligence Review, 43(2), 155–177.
5. Apple. (2022). iPhone 14 - Tech specs. https://www.apple.com/Iphone-14/Specs/
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献