Author:
Cornelio Patricia,Velasco Carlos,Obrist Marianna
Abstract
Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio–visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies and, thus, bring research in human–computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration.
Funder
European Research Council
Reference179 articles.
1. Integrating mid-air haptics into movie experiences;Ablart;Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video,2017
2. Bioessence: a wearable olfactory display that monitors cardio-respiratory information to support mental wellbeing;Amores;Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE,2018
3. Essence: Olfactory interfaces for unconscious influence of mood and cognitive performance;Amores;Proceedings of the 2017 CHI conference on human factors in computing systems,2017
4. A new gustometer: template for the construction of a portable and modular stimulator for taste and lingual touch.;Andersen;Behav. Res.,2019
5. You better eat to survive” exploring cooperative eating in virtual reality games;Arnold;Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction,2018
Cited by
42 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献