AV Brush presents a new computer interface metaphor for the real-time and simultaneous performance system of visual and sound. AV Brush is a musical instrument as well as a new drawing tool. A user can draw using real world materials by "picking up". As the user is drawing, generative sound comes out from this AV Brush system. Impromptu movement is expressed like an action painting. Continual sound is generated from these gestural abstractions.
This project is based on the concept of Visual Music, the idea of synaesthesia served to mediate between Art and Music since 1900 and proven essential to the development of abstraction.


I established a company, Media Art Lab co.ltd., in 1998. The first project was academic research and making of software applications. The AV Brush is based on a Study on the Cyber Visual Music Library. The study was sponsored by the Korean Ministry of Information and Communication(1998-1999). At Media Art Lab, researchers, engineers, designers, and artists founded this project, which included the creation of the software applications the AV Composer and the AV Visualizer. The AV Brush is more developed version of the AV Composer.
Visual Music occurred different areas like paintings, photographs, color organs, films, light shows, installation, and digital media. Visual Music refers to the use of musical structures in visual imagery, which can also include silent films or silent Lumia work. It also refers to methods or devices which can translate sounds or music into a related visual presentation. An expanded definition may include the translation of music to painting. Visual music also refers to systems which convert music or sound directly into visual forms, such as film, video or computer graphics, by means of a mechanical instrument, an artist\'s interpretation, or a computer. The reverse is applicable also, literally converting images to sound by drawn objects and figures on a film\'s soundtrack. Filmmakers working in this latter tradition include Oskar Fischinger (Ornament Sound Experiments), Norman McLaren, and many contemporary artists. Visual music overlaps to some degree with the history of abstract film, though not all Visual music is abstract. There are a variety of definitions of visual music, particularly as the field continues to expand. Visual music has also been defined as a form of intermedia.
I found Golan Levin\'s master thesis ,Painterly Interfaces for Audiovisual Performance, this semester. As this AV Brush has more musical instrument function, I realized sound part is more important than visual.


Audience are from kids to adults.
AV Brush system\'s audience are who trust synaesthhesia in art and music. In addition to, opposite people are possible. Sometimes, an insensitive sense person is audience. For example, he is unkeen of seeing or hearing. Specially she has an insensible sense. AV Brush system will help these audience.

An user takes up with AV Brush in front of easel.
An user is picking up real world color as the user press button.
An user draws circle and the user can hear sound in according with the drawing. As circle draws bigger and bigger, sound also continually high frequency. An user draw speedily, velosity expresses loud.


I will prepare several brushes. This brushes embedded IR leds. According different brush, users can expect different effects. This AV Brush system build up gesture drawing. Sound is related with user\'s gesture.

AV Brush was made using Max/MSP(Jitter). MSP is a strong program about sound part. I comprehended some parts in vast sound area as well as realized generative sound.