Pitch in non-verbal vocal input

Abstract

Recently, numerous prototypes of user interfaces have been presented that are based on interpretation of non-verbal sounds produced by the users, such as humming, whistling, or hissing. These sounds can be characterized by numerous properties, such as pitch, volume, or timbre. The user may intentionally change these properties while producing the sound. The properties (or their profiles over time) can be mapped to different actions. In order to trigger an action or modify an input value, the user produces a corresponding acoustic gesture.