Abstract
AbstractIn recent years, research on sonification has paid more attention to sound variations induced by expressive gestures. This chapter focuses on conducting gestures, emphasizing expressive gestures performed by the non-dominant hand. It is assumed that these gestures implicitly correspond to musical nuances partially encoded in the scores and convey a meaning based on a grammatical structure specific to gestural languages. We, therefore, propose to analyze these gestures in light of linguistic mechanisms that govern signed languages. In particular, we are interested in the processes of sign formation from the combination of elementary components and the inflection processes that apply to these components to efficiently generate rich and expressive sentences. Based on this grammatical theory underlying sign language and a sound-tracking methodology, we create and evaluate a new dataset of expressive conducting gestures.
Publisher
Springer Nature Switzerland
Reference34 articles.
1. Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence);F Bevilacqua,2010
2. Caramiaux, B., Montecchio, N., Tanaka, A., Bevilacqua, F.: Adaptive gesture recognition with variation estimation for interactive systems. ACM Trans. Interact. Intell. Syst. 4(4), 18:1-18:34 (2015)
3. Mathews, M.V.: The radio baton and the conductor program, or: pitch-the most important and least expressive part of music. Comput. Music. J. 15(4), 37–46 (1991)
4. Braem, P., Bräm, T.: A pilot study of the expressive gestures used by classical orchestra conductors. J. Conduct. Guild 22(1–2), 14–29 (2001)
5. Brizolara, T., Gibet, S., Larboulette, C.: Elemental: a gesturally controlled system to perform meteorological sounds. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 470–476 (2020)