Abstract
The appropriate use of non-speech sounds has the potential to
add a great deal to the functionality of computer interfaces. Sound
is a largely unexploited medium of output, even though it plays an
integral role in our everyday encounters with the world, one that
is complementary to vision. I argue that sound should be used in
computers as it is in the world, where it conveys information about
the nature of sound-producing events. Such a strategy leads to
auditory icons, which are everyday sounds meant to convey
information about computer events by analogy with everyday events.
Auditory icons are an intuitively accessible way to use sound to
provide multidimensional, organized information to users.
These ideas are instantiated in the SonicFinder, which is an
auditory interface I developed at Apple Computer. In this
interface, information is conveyed using auditory icons as well as
standard graphical feedback. I discuss how events are mapped to
auditory icons in the SonicFinder and illustrate how sound is used
by describing a typical interaction with this interface.Two major
gains are associated with using sound in this interface: an
increase in direct engagement with the model world of the computer
and an added flexibility for users in getting information about
that world. These advantages seem to be due to the iconic nature of
the mappings used between sound and the information it is to
convey. I discuss sound effects and source metaphors as methods of
extending auditory icons beyond the limitations implied by literal
mappings and speculate on future directions for such
interfaces.
Publisher
Association for Computing Machinery (ACM)
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Involving Hearing, Haptics and Kinesthetics into Non-visual Interaction Concepts for an Augmented Remote Tower Environment;Communications in Computer and Information Science;2020
2. Using Conceptual Metaphors to Represent Temporal Context in Time Series Data Sonification;Interacting with Computers;2019-11-01
3. Beyond audition;Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers;2017-09-11
4. Auditory display design—An investigation of a design pattern approach;International Journal of Human-Computer Studies;2009-11
5. Siren songs and swan songs debugging with music;Communications of the ACM;2003-07