Abstract
AbstractIn the real and virtual world, we usually experience sounds in combination with at least an additional modality, such as vision, touch or proprioception. Understanding how sound enhances, substitutes or modifies the way we perceive and interact with the world is an important element when designing interactive multimodal experiences. In this chapter, we present an overview of sound in a multimodal context, ranging from basic experiments in multimodal perception to more advanced interactive experiences in virtual reality.
Publisher
Springer International Publishing
Reference64 articles.
1. Barrass, S.: Diagnosing blood pressure with Acoustic Sonification singing bowls. International Journal of Human-Computer Studies 85, 68–71 (2016).
2. Biocca, F., Kim, J., Choi, Y.: Visual touch in virtual environments: An exploratory study of presence, multimodal interfaces, and cross-modal sensory illusions. Presence: Teleoperators & Virtual Environments 10, 247–265 (2001).
3. Bregman, A. S.: Auditory scene analysis: The perceptual organization of sound (MIT press, 1994).
4. Bruce, V., Green, P. R., Georgeson, M. A.: Visual perception: Physiology, psychology, & ecology (Psychology Press, 2003).
5. Burr, D., Banks, M. S., Morrone, M. C.: Auditory dominance over vision in the perception of interval duration. Experimental Brain Research 198, 49 (2009).