
For my Physical Computing and ICM finals, I am aiming to do one big project which will incorporate processing code and an installation using sensor data to manipulate a video experience. The code I have worked on so far (with lots of help from Patrick Hebron) can be seen here/here. We started off by making a sketch that can switch between videos with a keypress, which works more or less, though the size and ordering of videos is something I will have to figure out.
The project itself is a kind of driving simulator, where someone sits down in a drivers seat, complete with a steering wheel, accelerator pedal and gear shift, each of which has a function in manipulating the experience of the videos which are project on 3 screens, placed to represent two side windows and the front windshield. I hope to construct this with some real car parts to make it feel real, though the screens will likely not be car windows. I will have to map the projection of these three videos to the screen, and wire it up such that the gas pedal contains a force-sensing resistor, which will send data to the Processing sketch and increase the playback speed of the videos. The steering wheel will be the video switch, so that you have the impression of “swerving” into another video. There will, therefore, be a leftSwitch and a rightSwitch function, and the videos will be organized into groups in an array list. The last aspect of this will be a gearshift, which hopefully will be able to switch between groups or types of videos, so that you could shift gears and all the videos would then be at night, or underwater, shift up and all the videos would be indoors, or static for example. I am trying to lay out the code to have a structure which I can then fill in with video files. I have been working on sifting through my video archive to pick out the videos I would like to use. Here are some examples of my videos.
I plan to: buy parts, work on the code and pick more videos. then I have to figure out projection mapping and fabrication. bombs away









This is really cool idea. I love it! Can’t wait to see it come together.
Thanks for explaining it so thoroughly and adding sketches. Super excited to see it progress! B_