Visual Sound Synthesis

Louise Foo

Visual Sound Synthesis is a series of image-sound explorations of the meeting between graphic design and a program that turns the iPhone camera into an optical synthesizer that plays what it sees.


With roots in research about historical optical sound devices like the ANS synthesizer, Oramics, Sound-On-Film techniques and the Pattern Playback Synthesizer I asked myself – how can I experience this image-sound translation myself today with the technology available to me? and how can I share this with others? Through a process of programming, interface prototype design, listening to images and looking at sounds and finally through collaboration with graphic designer Martha Skou – the final outcome is a series of 'scores' played back by the viewer with the camera in the iPhone. The installation of those 'scores' explore how in many ways the visual and audible senses are related, but not necessarily synchronized.