Turning movement into music: Issues and applications of the MotionComposer, a therapeutic device for persons with different abilities

Abstract

The article discusses the ways in which the MotionComposer (MC), a newly developed device that turns movement into music, engages users with different abilities, so as to provide positive psychological and somatic effects. It begins with a case study – the story of one application of the device involving a young man with cerebral palsy. His experiences are typical of many others and provide some useful generalisations. The article then discusses a number of goals and related design principles that have been important in the development of the device, including a discussion of two conflicting strategies which must be reconciled: On the one hand, there is a need for clear causality. On the other hand, for such a device to remain interesting over time, there is a need for variation. A technical description of the hardware and software is given, followed by a discussion of general mapping issues pertaining to the different sound environments or interaction modes of the MC.