Hadar Ben-Tzur

A game controlled by scattered black beans.


A version of the original Skifree game from 91'. The game is controlled by scattered black beans – a controller which is not binary, without buttons. The tactility of the beans and the monster that lurks around the corner creates a funny experience that ranges from a sense of control to complete release.


Introduction to Computational Media


Max Horwich

Beautiful music and hypnotic animation are at your fingertips. With fiveSquare, if you can bend your fingers, you can play a song!


fiveSquare is a musical instrument for people who don’t play music. A glove connected to a digital synthesizer enables the user to create beautiful, expressive sounds, regardless of musical knowledge or skill level. While our product is not the first glove for making music, it is the first designed explicitly for users with no musical background. If other wearable music controllers are Adobe Photoshop, fiveSquare is Instagram.

Our web-based digital audio workstation is a simple grid where users can trigger loops and play melodies accompanied by hypnotic animated visuals. Click or tap each of four smaller squares on the left to build a beat out of drum and synthesizer samples and drag your finger or mouse across the larger square on the right to play melodies over it. Then with our specially designed fiveSquare Glove connected, the music literally comes alive in your hand. Flex sensors in each finger control parameters for different instruments, and by bending their fingers, users can adjust the tempo of the drums, the pitch of the bass, or cycle through chords on an arpeggiated synthesizer.

For demonstration at the 2017 ITP Winter Show, fiveSquare has minimal demands on space and equipment. All we need is a few square feet of space for a laptop or tablet and a small mixer (multiple headphone outputs will allow users to perform for an audience without overwhelming an already loud space with noise from speakers). An external recording device will capture audio of the entire evening’s interactions, and participants will be invited to leave an email address where we can send them the recording of their experience.


Introduction to Computational Media, Introduction to Computational Media, Introduction to Physical Computing, Prototyping Electronic Devices

Anger Flanker

Krizia Fernando, Ridwan Madon, Vidia Anindhita

Anger Flanker is an arcade game-inspired interactive space that invites users to relieve anger, through physical gestures of smashing and screaming to break a virtual surface.



Anger Flanker is a game that aims to encourage a cathartic experience of relief through physical gestures and interaction with the machine.

Anger Flanker is run using serial communication and sensors. It is a space for users to scream and smash controllers in order to break digital surfaces. The different levels is represented in textures of a mirror, a wall and wood and the user will be cued to keep breaking the surface.

We used p5.sound and a force sensing resistor to be enclosed in 36-wide wooden enclosure and 2 controller panels.


Introduction to Computational Media, Introduction to Physical Computing, Introduction to Physical Computing


Chengtao Yi, Huiyi Chen, Jiyao Zhang

a human camera



Camrobot is a project where I transfer my body to a picture-taking machine.

With a screen and lens mounted on my body, I will walk around and provide service to anyone. People can press my head to take pictures. The pictures will then uploaded to Instagram and displayed on a screen on my body.

“Huiyi” Camera is so far the most intelligent camera. It adjusts with you wills, automatically add filter for your pictures and upload to Instagram for you.

“Camerobot” plays with the idea that machines — camera in particular, are mediating and even dominating our senses and the way we experience the world.


Introduction to Computational Media, Introduction to Physical Computing

Pattern and Sound Series

Katya Rozanova

This is a series of minimalist, meditative pattern and synth compositions that respond to input (in this case the movement of one's right arm, perceived by a Kinect ) by reconfiguring temporarily and generating soothing or energizing noise that matches in style the visual elements of the piece.



Using P5Js I am crating a series of interactive compositions. The visual elements will create patterns on an input from a person (mouseover or in response to the movement of one's head or eyes) and generate soothing or energizing sounds that are modulated by the same input. Currently I am collaborating with Dan Oved to set up eye tracking for one of these compositions. For the rest, I plan to use p5 js face recognition as the input that triggers visual and sonic change. 


I'm uising Tone.js, written by Yotam Man.


The simple grid-like designs I am creating are inspired by Agnes Martin's paintings. 

Minimalist and sometimes intricate but always geometric and symmetrical, her work has been described as serene and meditative. Martin believed that abstract designs can illicit abstract emotions from the viewer, like happiness, love, freedom. Her work reminds me of music for that reason.


Introduction to Computational Media

Flappy Shadow

Kai-Che Hung, Tong Wu

A project that revivifies and sets free shadow puppets from your childhood memories



“Flappy Shadow” was inspired by Tong and Kai's memories about playing shadow puppet game before sleep as little kids. It also explores the philosophical relationship of human with their shadow. The project uses Kinect to track users' hand position, and turn the bird shadow made by an user into a flying animated “shadow bird”. It now has successfully let users control the direction and the scale of the animated bird by waving and leaning closer to or farther from the Kinect. The next step will be finishing and optimizing gestures detection to give users more freedom to create and set free the shadow bird.


Introduction to Computational Media

Museum of Plastic Age

Carrie Wang

Museum of Plastic Age is a future museum of mysterious artifacts from the 21st century.



Museum of Plastic Age is an interactive exhibit of artifacts from the heyday of the Plastic Era (approximately A.D. 1950s – 2120s). Museum goers are encouraged to interact with the objects to find out more about life in the late 20th century and early 21 century. By controlling the two knobs on the box, people can toggle between artifacts, access illustrations of different views, and watch short documentaries about life in the Plastic Age.


Introduction to Computational Media, Introduction to Physical Computing


Huiyi Chen, Hee Gyung Sun

"A time that's changing all the time – it's time to go to time!" – DHMIS



What's time? Is time a logical thing? A project “Time” started from throwing simple questions about time and its standard – eventually evolving into the combination of physical piece and digital visualization about different time zones. The physical piece is consisted of two parts: inner cylinder that represents UTC Time Zone map, and outer sphere that is rotatable and contains light source. As the user rotates the outer sphere, and it creates movement in light. While the light is moving, the inner cylinder that has 24 light sensors for each longitude reacts to the changing brightness.

The physical piece will be installed on transparent and round table that I personally own, which approximately has 40” diameter and 30” height. People should be able to walk around the table and see the cylinder time zone map inside the sphere. The digital visualization will be projected from underneath the table; due to its transparency, the table is able to directly show the visualization on is top surface. In this way, people can view both physical and digital piece without being distracted.

When the light shifts from one time zone to another, the digital visualization reflects the movement as well by changing gallery of skylines. Those skylines are from survey towards ITP community regarding which cities they came from, and organized according to the longitude location.


Intro to Fabrication, Introduction to Computational Media, Introduction to Physical Computing


Chengchao Zhu, Yifan Liu

A project that turns dancing into a fun game.



This is a project that encourages, tracks and artistically represents dancing movements. Interaction is created through visual effects triggered by body motion. Sound visualization is part of the project as well. While standing in front of the projected image, people are encouraged to dance and wave their arms, involving their full body by the desire to trigger the interactions. Techniques involved in this project includes motion capture using Kinect and p5.js programming.


Introduction to Computational Media

Project Wings

Chengtao Yi, Meicheng Jia

Our project is a physical wing that let users wear and experience the 'flying' movement in the space.



This project is a 'Space Flying Simulator' created by Meicheng Jia and Chengtao Yi that can enable users to navigate through a virtual space. The simulator will be a physical 'wing backpack' that let users wear and experience the 'flying' movement using the accelerometer and gyroscope. The whole experience is accompanied with a space ambient music to let the user meditate while gliding through the virtual galaxy.


Introduction to Computational Media, Introduction to Physical Computing