Affiliation:
1. Society for Arts and Technology, Metalab, Montreal, QC H2X 2S6, Canada
2. Input Devices and Music Interaction Laboratory (IDMIL), Centre for Interdisciplinary Research in Music Media and Technology (CIRMMT), McGill University, Montreal, QC H3A 0G4, Canada
Abstract
A growing body of work on musical haptics focuses on vibrotactile feedback, while musical applications of force feedback, though more than four decades old, are sparser. This paper reviews related work combining music and haptics, focusing on force feedback. We then discuss the limitations of these works and elicit the main challenges in current applications of force feedback and music (FF&M), which are as follows: modularity; replicability; affordability; and usability. We call for the following opportunities in future research works on FF&M: embedding audio and haptic software into hardware modules, networking multiple modules with distributed control, and authoring with audio-inspired and audio-coupled tools. We illustrate our review with recent efforts to develop an affordable, open-source and self-contained 1-Degree-of-Freedom (DoF) rotary force-feedback device for musical applications, i.e., the TorqueTuner, and to embed audio and haptic processing and authoring in module firmware, with ForceHost, and examine their advantages and drawbacks in light of the opportunities presented in the text.
Funder
Natural Sciences and Engineering Research Council
Ministère de l’Économie et de l’Innovation du Québec
Subject
General Materials Science
Reference61 articles.
1. Beamish, Timothy, Maclean, Karon, and Fels, Sidney (, January April). Manipulating music: Multimodal interaction for DJs. Paper presented at CHI’04: CHI 2004 Conference on Human Factors in Computing Systems, Vienna, Austria.
2. The FireFader: Simple, Open-Source, and Reconfigurable Haptic Force Feedback for Musicians;Berdahl;Computer Music Journal,2013
3. Berdahl, Edgar, and Smith, Julius O. (, January April). An introduction to the synth-a-modeler compiler: Modular and open-source sound synthesis using physical models. Paper presented at 10th International Linux Audio Conference (LAC-12), Stanford, CA, USA.
4. Bello, Fernando, Kajimoto, Hiroyuki, and Visell, Yon (2016). Haptics: Perception, Devices, Control, and Applications, Springer International Publishing. Lecture Notes in Computer Science.
5. Gesture Control of Sound Synthesis: Analysis and Classification of Percussion Gestures;Wanderley;Acta Acustica United with Acustica,2010