Interactive Pattern Generator

Mathura Govindarajan

Pattern generator based on patterns seen in nature.


This project tries to create art out of maths and physics that we see around us everyday but don't realise it. For instance, it uses fractals and motion of gas in air to create art. The interaction will be touch based and users will have the option of creating art and uploading/mailing it to themselves.


Introduction to Computational Media

Animated Annotations

Daniel Silber-Baker

A platform for animated annotations that produce interactive multi-media comprehension explorations and experiences.


My project aims to leverage emerging technologies to produce new forms of meaning and meaning making. By 'plugging in' text sources to the nebulous web of knowledge accessible through the massive production of multi-media and resources available online, we work to create an interactive and interconnected form of comprehension which reflects the dynamic and rhyzomatic structures of information and meaning in our world today.

The project leverages jquery for a flipping effect, allowing users to dive into each sentence in more and connected detail. Currently the types of interactions available are supplemental video, animated sequences produced through Adobe After Effects, interactive activities that connect to the reading; produced on Codepen, SVG animations using the Vivus.js library, and user text input boxes using jquery. In addittion to the card flipping animation, a secondary model of accessing additional information or interactions is through an accordion style drop-down also coded with jquery.


Introduction to Computational Media

Music Composer Machine

Nikolaj Petersen

An algorithm that learns by listening to- and analyzing a number of songs (input), and outputs and print out a new song (or song phrase) on the basis of that input.


Using Markov Chain, the machine progresses a new and unique song by predicting functional harmony from a sources of existing songs.
Using Context Free Grammar, melody is written by following rules formed by the input melody’s relation to the chords.
Generating text as such often turns into gibberish.

The human memory of context in music is shorter and more volatile than in textual or verbal communications.
And the variables are fewer:
Almost any pop/rock song written since 1950’s are structured around 3 or 4 different chords.


Programming from A to Z


Leon Eckert

Our typing pattern can be captured and used against us. KEYPRINTS explains how this works visually and proposes a way to protect our privacy.


The subject of this project are keystroke patterns and their use as unique identifiers to individuals online.Our personal data is in high demand and collected by both government and companies. Free services making our lives easier or simply more fun are the main incentive we receive in exchange, yet for the most part we are unaware of that trade.
Of increasingly high interest in that context, is behavioural and biometric data an example of which is our keystroke pattern. The keyboard is arguably the most central interface of computers and we all use it in slightly different ways. The rhythm in which we type, the frequency we use individual keys and other details can be measured, recorded and stored in data sets which can identify us in a similar way our fingerprint does in the physical world.
The project *Keyprints* intents to explain this concept through visualisation on the one hand as well as proposes a way of protecting ourselves from data collectors on the other. For that, a physical intervention intercepts the signal between keystroke and computer and adds a randomised or intentionally defined delay.


The Stratosphere of Surveillance, Introduction to Computational Media

Rube Telephone

Chino Kim, Aaron Montoya-Moraga

A Rube Goldberg telephone that tangibly processes and translates conversation between two people, creating a fun audiovisual experience using various old and new communications technologies and producing unexpected outcomes.


Using Morse code, language translation and optical character recognition, our contraption processes and manipulates conversation between two hacked rotary phones. Each step in the chain reaction is a tangible experience and occasionally distorts the message as it passes it along.

A one-way transmission may look like this:

Someone speaks into phone 1 > their sentence gets tapped out on a Morse key by a solenoid > the resulting Morse code gets translated back to English and then to Spanish > the Spanish string is spoken by the machine and then gets translated back to English > the resulting sentence gets printed out by a thermal printer, a camera takes a photo of the printed text and the text gets pulled out of the image using OCR. Both the camera view and the OCR output would be shown on a display > the resulting sentence is then spoken through the earpiece of phone 2.

To do:

– Reverse the signal flow when going from phone 2 to phone 1.

– Use audio thresholds to control the direction of transmission and properly route audio signals.

– Play hold music in phone earpieces while message is being processed.

– Improve OCR (crop photo, error handling).

– Implement autocorrect so that words mangled by Morse or OCR get converted to actual words before they’re passed off to the next step (Google search suggestions API).

– Code ringer behavior – if one phone is picked up, the other rings (we are already able to make the phones ring, we just need to program the Arduino to control them).

– Build/buy stands and mounts for each “station” (two phones, Morse, translation, OCR).

– Write an Arduino program that will control a light bulb progress bar (we already have the relays and wiring in place for this).

– Write a Morse code program that will convert the signals tapped out on the Morse key back to English (this isn’t a priority since we can fake it and use the English string from the previous step).


Introduction to Computational Media, Introduction to Physical Computing

Sound Boxing

Yuan Gao, Yuchi Ma

Experience sonification and visualization when practicing boxing punches


Our main sensors are put into the boxing gloves, they include accelerometer and gyroscope. Then in the show, we give users this pair of boxing gloves and a Thai Pad to play with each other, basically asking them to punch like a professional boxer practicing. We will use the data sent out from boxing gloves (through bluetooth) to control the Spot Light, which is set up on top of the show area, and Sound Effect (speaker connected to laptop) around this area. Let user experience the spot light changing (colours, strobe) and sound beats changing according to the punching gestures they made.


Introduction to Computational Media, Introduction to Physical Computing

The Clock Project

Zhuoxi Song

A beautiful website enlivened by gorgeous scenes from our beloved hometowns across the globe


The Clock Project is a website that reminds us of how far we've been aways from our beloved hometowns. With a clock showing current local time in a remote hometown, followed by videos consisted of hometown scenes that used to be easy to see but now thousands of miles away, viewers will feel the distance to beloved homes.


Art Strategies, Introduction to Computational Media

The ITP's Mind

Michelle Hessel

An interactive ITP brain sketch that will allow user to understand what moves/intrigues each of the 1st year student.


The “inQuery” is a project from ITP's Applications Class in which all the 1st year students must write a blog post about a topic that they are curious about. This is an opportunity in which we are invited to talk about anything that we feel passionated or indignant about. Throughout the semester I found myself very interested in what people were saying and because of that I made a javascript interactive screen visualization of this data. The sketch has the shape of a brain in which nodes move around. The idea is that user will be able to touch the brain nodes and discover each inquiry, its author's name and e-mail. User can also search for specific terms or names. My intention is for people to find interests in common, connect with each other and discuss more about it, whether the user is from ITP or not.


Applications, Introduction to Computational Media

Clean-Up Drive

Anne Goodfriend, Nilomee Jesrani

Clean-Up Drive is a foot controlled, arcade style, video game experience that educates players about the harmful effects of Global Warming.


Clean-Up Drive is a video game that educates children about the harmful effects of littering the planet, and how this is affecting the Ozone layer. The game is a race against time to collect all the trash on the surface of the Earth, before the Ozone layer is destroyed.


We designed a balance-board style game controller. The player uses the controller by standing on it and shifting their weight in one of 8 directions.

We also designed a corresponding arcade style video game where the player wanders around a post–apocalyptic world collecting trash. As they collect each item they slowly heal a disintegrating ozone layer. If the player collects all of the trash, and heals the ozone layer, they win by saving the world.


Introduction to Computational Media, Introduction to Physical Computing


Angela Perrone

With BarkArt you can track your dog's barking and turn it into a unique work of art, while discovering ways to ease his/her anxiety. It's Bark Therapy for the whole family.


Whether it is separation anxiety or other triggers, dogs can suffer from emotional distress just like humans. BarkArt can help you find daily patterns and track the times of high anxiety for your pup, which will allow you the opportunity to find a way to ease the stress.

Before leaving your house, set up BarkArt on a computer in a location near your dog's favorite spot. When your dog barks, BarkArt will add a paw on the canvas, with the size based on duration of the bark.

You will arrive home to a full painted canvas of paws of all sizes and colors. Click on an individual paw to find out the time of the bark. You can end the sketch by clicking on “end.” Check out BarkData to see a linear visual of the day's barking and track patterns over time.

On the lighter side, you can save the unique daily artwork by “saving BarkArt.” And don't forget to share your pup's BarkArt on Instagram!


Introduction to Computational Media