Begin Live Image
I am in the process of installing Jitter. Then I'll start making patches.
For the class i am mostly interested in the audio quality of the interactive performace but i am also curious about creating a reactive environment for a possible performance/dance piece I have in mind.
Patches for future performances
The class patches so far have been great, lots of imformation to absorb but the patch that cross fades one video into an another with the mouse movement can easily be substituted with a sensors and it could be an interesting effect for performance.
Something funny.
POSSIBLE PERFORMANCE FOR LIVE IMAGE PROCESSING
I have been struggling with the idea of having a performance on the Tsunami for quite some time. At first i thought of an interactive installation, then a dance piece and now that I am working on building a tiny mock of a tsunami detection system, i thought it would be a great interface for site-specific performances wherever there is water or an ocean.
The prototype (it will just give a rough idea of some of the components necessary for the Tsunameter system) will include for now:
-GPS receiver (for position, speed and altitude)
-Accelerometer (possible for wave ondulation)
-Hydrophone (to "listen" to the ocean)
-Depth Sounder/Fish Finder (for point of reference and wave height calculations)
-Later a Zigbee Radio, or Bluetooth or Cellphone module (for wireless datalogging)
-Microcontroller to handle the signals
What I am hoping to achieve for the class is to write a series of simple Jitter patches that can:
-use the accelerometer information maybe for some data vizualization of the roughness of the water;
-use the hydrophone sound to add a site-specific and acoustic element to the performace;
-use the data from the sensors to move the images-video in a non linear way during my performance which might still be a mixture of dance, theatre and typical sri lankan or local dancing.
I would ideally like to add some instruments like percussion and have the space interact with me in a very effective but quite simple way.
Example of wave visualization:
Example of possible video manipulation (obviously a little bit more complex than this one, just to give hte idea!):
GPS AND ACCELEROMETER DATA IN MAX
Thanks to Luke's help, I managed to get the serial data parsed out in Max. I am starting to visualize the data to try to make some sense of it. This is my first patch for this project. Many more to follow.
ATTEMPT IN MAX TO SMOOTH OUT X,Y,Z AND OPEN GL
I have been trying to smooth out the signal coming in from the accelerometer. I started by dividing by 2, although i think i will remove that part. Then i made the average between the new and old value. I will apply a simple averaging or moving averaging math to the Arduino program or I will do it in MAX. I can't figure out which one is more reliable and less energy consuming. I think MAX would be the best option, but with Serial data sometimes i have seen it crash.
Then I started playing with the plane with Open GL objects, but i am still far from a good result. I will see what i can do.
FINAL L.I.P.P. PERFORMACE
The final performance involved a water tank with my device. The floating wireless device included an accelerometer, a bluetooth module (BlueSmirf) and a GPS device.
The X, Y, Z axis readings would change the Fading of the 2 videos, the Tolerance and the Luminosity.
The hydrophone, in the water tank, would change the audio and also the color saturation of the second video.
This is a bad picture of the patch:
Videos coming soon