A Sound-Image Coding Method Inspired by an Acousto-Optic Electronic Piano

Abstract

Abstract This paper firstly brings up a point that there seems to be a lack of a direct mapping bridge method for interconversion between sound and image, because many methods invented for scientific research on sound visualization are based on the sound characteristics of pitch, duration, loudness and timbre. Secondly, it designs an acousto-optic electronic piano which can possess both sound and color effects with the application of music visualization, and presents a sound-image coding method inspired by the previous design which can transform music note to picture pixel. Thirdly, it manages to transform a simple piece of music called “I am a painting master” into a corresponding picture with the mapping bridge method using Matlab software. More coding bits of the method should be added for complex music. The sound-image coding method exhibits a mapping bridge role for sound-image interactive design, which may help to find essential relationship between music and picture in mentality.