December 14, 2007
final: compform
note: to see all my homework/midterm/final for compform- or any other class, click on the menu at left to see the class specific work for each semester.
Using openframeworks with opencv and rtaudio I was interested in creating an alternative interface for visual creations in music and art possibly for performance work 'off the screen'
Here is a screen shot to give you an idea of the final project- I managed to get the audio working by preloading the files, the code then checks the previous pixel against the new pixel for change, if the area has changed, it plays a note- if the area hasn't changed it plays nothing.
I also got it running in a non-pixelated version for cubit (see images below) using finger and blob tracking on a defused illumination screen (eg multitouch), however after spending a lot of time around 8-bit music the last two weeks, I wanted to create something that was more a tribute to raw data and blown pixels.. thus my final was born.
I am really happy with the end result and am hoping to show it at the next blip fest in 2008.
Posted by itp at 01:16 PM | Speak to me (0) | Remember (0)
December 06, 2007
success!
progress on the application!
its now running on the multitouch display, now I just have got to get the damn octave ranges or sounds 'tuned'.
video of current process to follow
Posted by itp at 09:46 PM | Speak to me (0) | Remember (0)
December 04, 2007
final: expressing information
heres a few screen shots of the projection based application I wrote. The text is currently being pulled from xml into openframworks dynamically displaying in real time peoples answers to the question 'what would you take if you could only take one object out of a fire?'
the interface is then being projected onto a wooden board where I have laser cut a floorplan of the typical american house. The answers shift around depending on activity on the blog and gender specific answers (boys are black, girls pink)
the installation is ideally show vertically although for the final, I will be presenting it in a horizontal fashion for the sake of time during the pre-class set up
Posted by itp at 11:59 AM | Speak to me (0) | Remember (0)
November 26, 2007
week 10- thanksgiving
wahooo!
finger tracking and contour tracking is working
using proximity and assigning ids to fingers, in the .h, I figure out the 'error' for all blobs in current frame and error is then defined as the distance between the current frame blobs and the last frame. I found that simply optimizing for the least change in distance allowed for fastest and cleanest tracking without lag.
By generating a matrix of all the possible points, e.g. if we know there are four points last frame and 6 points this frame, then 2 id's will be -1 and can calculate the error and pick up the matric that has the lowest error, the more points the slower this seems to be :(
Awesomely enough there aren't usually many points to deal with, and to rememdy the cpu time that grows with higher numbers of points, i can assume that the chosen ID is from one of the top 4 closest points.
more to come.
Posted by itp at 11:57 AM | Speak to me (0) | Remember (0)
November 25, 2007
the wind is telling secrets again.
i want the deep, down silent things that are locked in your heart.
the beautiful innuendos of future, the streaming bittersweet decline, the inanimate objects we call home. my discarded, heartless ramblings, destined to never see seriousness until the light at the end of the tunnel flickers out.
the hovering bird goes to sleep.
go back to bed.
all i want is to put my hands between your ribs and know that i'm somewhere in there.
Posted by itp at 06:35 PM | Speak to me (0) | Remember (0)
compform final presentation
For my compform final project I am working with OpenCV , OpenFramworks and multitouch hardware (hardware developed with Stefan H).
I am interested in the intersections of sound, cv and touch to create alternative interfaces for visual creations in music and dynamic art.
Here is a screen shot to give you a rough idea of a mid way point (using the isight camera, you can see my face).
Mapping the pitch to the coordinates of fingers on the display allows the user to play higher notes higher up from the 0,0 origin and closer to the origin, lower notes. Ultimately it will, in theory, work like a small piano or keyboard with a few octave ranges or tone ranges.
Posted by itp at 06:14 PM | Speak to me (0) | Remember (0)
November 15, 2007
week 9
Posted by itp at 10:43 PM | Speak to me (0) | Remember (0)
week 9- working on the final
heres the finger tracking on the multitouch working, notice it recognizes the finger as a vector not a pointer! woot!
anyhow, more to come. code isn't open yet, but working with Zach Libermann at the moment to get some applications OS on OpenFrameworks
Posted by itp at 01:14 PM | Speak to me (0) | Remember (0)
November 13, 2007
expressing personal narratives as data
I am interested in the exploration of why people keep what we do and how those artifacts of our history define who we are as a society or more specifically a gender.
I originally wanted to create a book format, then settled on a projection. I like the physical and virtual marriage of medium. The words and text are dynamic, the wood, static. The words and objects seen in the projection are peoples answers when they were asked 'what would you take, if you had only a minute to save something from your burning home?' Users post their answers at tokori.livejournal.com and the answers are updated in the projection to the specific area which the object 'lived' within the homes architecture via xml parsing.
I am interested in the exploration of human artifacts, why do some object survive moves and others are discarded? Why do we choose to keep what we keep or what is the meaning we hold within the object?
The projection of words is projected on a piece of wood where they fall into where they 'lived' within their domestic environments. The floorplan of a house has been burned onto the wood symbolic of fire.
Posted by itp at 08:08 PM | Speak to me (0) | Remember (0)
November 07, 2007
week 8
(I am quite proud of my alpha on the sides of the mnt)
multiple vertical distortions
waves in two directions on x/z axis
Posted by itp at 10:11 PM | Speak to me (0) | Remember (0)
November 01, 2007
3d meshes
heres my second attempt at using 3d meshes for Ai to use in Af.
Each part of the body is a layer which can be manipulated or animated (head, beak, tail, wings, feet, body and head feathers)
Posted by itp at 04:59 PM | Speak to me (0) | Remember (0)
homework.. week um..
part 1:
part 2:
and I also managed to get my original idea for the midterm project running, although I found the lines were too complex for the eye to follow so I reworked the UI a bit and went with a more easy to 'read' piece.
On the y-axis you see a collection of tangible information (date, gender and value) some of the information was estimated based on other information found about similar works by the same artist, regardless you can compare dynamically different art works, by moving them closer to other pieces you can see how high different values are in comparison to their neighbors.
I'm interested in mapping this information dynamically in some sort of UI. Ideally so that anyone can manage a large collection as if to curate an entire museum . . . on their own terms.
here is a movie to give you an idea of how it works-- code is also provided behind the cut..
Continue reading "homework.. week um.."
Posted by itp at 04:55 PM | Speak to me (0) | Remember (0)
October 26, 2007
midterm
The radius of the circle is determined by the last mouse position. The stroke is drawn around the radius of circle with the radius center being determined with the mousedown.
if you want to see the code, you'll have to ask nicely.
Posted by itp at 08:54 AM | Speak to me (0) | Remember (0)
October 25, 2007
my first attempt at using meshes
heres my first attempt at meshes. Its not pretty but I managed to get them to work enough.
Posted by itp at 01:16 AM | Speak to me (0) | Remember (0)
October 20, 2007
a. 6.0
we decided to calculate intersection points and use the light sensor on the laptop to create another set of parameters which to control the stroke opacity with.
code is below cut
Posted by itp at 08:45 PM | Speak to me (0) | Remember (0)
