Wendy Louise Coutau

Modulotron

The Modulotron is a wearable remote control for controlling video parameters in a digital environment by means of body movements.

http://www.aoeworldwide.com/Thesis2007.htm

Our bodies are made to move. The kinetic energy used in our daily movements allows us to get from place to place, dance and express ourselves. I want to use our body movements as an input control for manipulating video imagery.
I'm creating a modular system that will bring sensor and wireless technologies to a wearable device allowing the performer freedom of movement.
The Modulotron system is a potentially useful tool for capturing body movement and make use of them in a digital environment to influence, change, modify certain desired aspects of visual imagery. It is intended for use in addition to the computer and any other equipment performers would need. The fabric used is merely a support for the array of sensors, which allows wearability and portability. The array of sensors is selected on their functionality and usability. Their placement on the body is in function to body movement and where they will be the least obtrusive yet work effectively and optimally. Amongst many, my goal is to make it as easy to use as possible, as plug & play as possible.
I envision the use of the Modul-O-Tron system as either in a live or informal setting. But of course, as it is designed to bring importance and value to body movement in the musical environment, it should be used in such a way that the interactivity between movement and output is clear.

These sites have great relevance and are sources, amongst others, for my research:
http://www.sonami.net/
http://www.sensorband.com/
http://www.csl.sony.fr/~atau/
http://crackle.org/
http://www.musik-kons.dk/english/diem/research.php

visual performers, dancers, anyone interested in moving images maniputated by the user\'s movements.

A user, let\'s calling him Bob, slips on the wearable modules: one on his elbow, one on the right wrist and one on his left knee. He doesn\'t need to wear all 6 modules. He goes to the computer to plug in the wireless base module to the USB port and launch the Max/MSP application. He opens the appropriate Max patch( the program where all the incoming data will be treated and used). He then chooses a few video loops to play with, after turning on the patch buttons. The serial communication should establish itself on its own. He may choose some music to play along with. Once the patch is ready, Bob can start moving around and see the effects on the video being generated by his movements. Bob starts with small movements of just the wrist or bending his elbow to get a sense of what is happening to the image in correlation to his movement. A the same time, he can adjust the colors and intensity of the colors with a click of the mouse. There is a portion of the Max patch that is dedicated to recording the video that\'s being manipulated, so that Bob can review or use it at a later time.


This project delves into the realms of wearable technology. It works with a program called Max/msp/Jitter and makes use of emerging technologies such as MaxStream\'s Xbee modules and sensor input devices as accelerometers, IR range sensors, touch/ capacitive sensors, and more.
The sensors are mounted on soft, stretchable fabric to accommodate comfort and freedom of movement. The Max patch I created is the main interface for the system, where data comes in and altered video images come out.
It is a modular system because a user may wear one or more modules, or two peolpe can interact with each other by each wearing a module. A gestural language is developed where certain video effects are mapped to specific gestures.

As I advance into the world of imagery and digital interfacing, I realize that the complexity of the subject is immense and yet quite inviting. On many levels, technology is spawned through creativity and need.
While developing my thesis project, I learned that electronics should be approached with great patience and tidiness. Sensors are very tricky and not always as easy to work with as it may seem.
It took me many iterations to get something to work and probably many more. Making this project for Thesis is only the beginning of my research.
But more importantly, developing an idea for thesis is as important as defending it. A thesis candidate must be able to defend his or her point-of-view with valid and researched arguments, be philosophical and passionate, and be able to parse criticism.
If i were given the chance, I would do it all over again to keep up with the evolving world of interactive arts.

[?]