Aquatic Synthesis is an interactive live performance of a musical instrument that modulates sounds in response to the characteristics of liquids as they mix and change, as a combination of randomness and human control.
Often in electronic music, randomness is added and finely tuned by composers to give the sound a more organic feeling. What happens when we replace this source of randomness with something that occurs in a natural or organic form? Aquatic Synthesis explores this concept by using cameras to detect the characteristics of different kinds of liquids and how they slowly change, and uses these changes as random values to modulate pitch, timbre, envelopes, and more in sounds. All of the sounds are synthesized live using highly accurate software reproductions of analog synthesizers, such as the Buchla 259e twisted waveform generator, to give it a more organic feeling and provide many knobs and degrees of control.
While this instrument was created for the NIME live performance, it can also be used as a platform or tool to allow different types of motion or changes in color to affect sound. In effect the audio is driven by the visuals.
The instrument was built using TouchDesigner for all visual aspects including motion and color change detection, and projection during the performance. TouchDesigner would then send Midi control values and pulses into Ableton, which acted as a host for a Softube Modular – a software based replica of hardware modular synthesizers. Ableton would use these midi values to turn knobs and send control voltages into Softube Modular. This way, the changes in what was viewed by the camera would instantly affect sounds in many different ways.
Because of the tight integration, the viewers brain can associate changes in visual and sound together, making the correlation clear. Additionally, the randomness that is sourced from these changes does not seem as computerized as if it was generated by a machine, but feels more natural as it's tied to something organic.
An experimental drawing tool and live looping instrument that records an audio sample from the computer's microphone every time you draw a line. Once you stop drawing, the sample starts to loop, slowly modulating and decaying over time. Drawing multiple lines lets you layer loops to create evolving ambient compositions.
Built with Tone.js and Three.js.
Drawing on Everything, New Interfaces for Musical Expression
The Fiber Optic MIDI Controller (FOMC) uses fiber optic cables to make modular connections between light sources and sensors, allowing the performer to make tactile routings of synthesizer control signals. Each control signal causes the connecting cable to briefly illuminate, in turn helping the performer play the synthesizer “patch” by clearly highlighting the routing of each connection and timing of each signal as it operates. The illumination also acts as a tightly synchronized visualization of the music, as the illumination itself is the control signal creating it, rather than a representation of the music.
High power LEDs communicate in two ways: Through pulses, acting as gates within analog synthesizers, and through brightness, acting as control voltage, another standard within analog synths.