Air drawing

Juan José Egúsquiza

Draw in the air


Using Leap Motion and Processing, I created a draw tool, that let you draw in a canvas using your fingers. Using the index an middle fingers together, you can draw lines and if you want to change the color of those lines, you just have to split them and unite them again.


Introduction to Computational Media


Ruta Kruliauskaite, Shir David, Xiwei Huang

Fun toy to introduce a three year old to the concepts of electronics.


Stacklight is an educational toy for kids to introduce electronics in the appealing hands-on way.

The goal of the game is to introduce electronics through big objects, colors and shapes. We want to encourage kids to recognize patterns, organize and play by stacking the objects.

User age: ~3 year old.

How does Stacklight work? Each of the Stacklight pieces light up as the kids stack them.

The full brief can be found here:

Stacklight presentation:

Full documentation:

Project members: Xiwei Huang, Shir David, Ruta Kruliauskaite.

Implemented in the Intro to Physical Computing Class by Benedetta Piantella.


Introduction to Physical Computing

Balans Mat

Jordan Frand

The Balans Mat is a yoga mat that gives you audio feedback to help you achieve a balance throughout your yoga practice.


The Balans Mat is a yoga mat that gives you audio feedback to help you achieve balance throughout your yoga practice. Force sensors embedded in the mat send information about the distribution of your weight to a Max MSP program, which in turn adjusts the volume in the four speakers surrounding the mat. The force sensors are constructed from Velostat, a soft material which allows the mat to be rolled up, stored, and easily carried. The sensors are located in four quadrants of the mat so that, whether you're in a balancing posture, inversion, seated position, etc., at the front, middle, sides, or back of the mat, the speakers surrounding you will help you find your center and encourage you to stay there. The vestibular system is the strongest contributor to human balance and is located in the inner ear. It is for this reason that the Balans Mat uses audio-biofeedback instead of visual. This installation of the mat requires a MOTU Traveler and four speakers


Introduction to Physical Computing

Drawing Melodies

Manxue Wang

Let everyone drawing melodies through browser together


It's an website for collaborate drawing melodies. Everything the user drew on the canvas can generate notes(music) User's drawing elements have interactions each other. Every elements in that world have rigid body and have gravity and may also have collide effect with other elements. Every time they collide each other, sound generated.


Live Web


Jared D Friedman

A new musical instrument made out of four walkmen and a broken guitar.


The Skronkophone is an attempt to recycle old music technology into a new instrument. The user plays a guitar with no strings, just position sensors on the neck and force sensors on the body. The output is four modified walkmen and four modified sets of computer speakers. Each walkman is loaded with a cassette with a loop of tone corresponding to the “string” it is reproducing: E2, A2, D3, G3. The position of the player's finger on the “string” determines the speed of the walkman's motor – as the player moves his or her finger up the neck, the motor goes faster and the pitch of the note changes correspondingly. Then the FSR data is used to control the volume of the speakers – when the player is not pressing on a button, that string is silent, and the loudness can then be fairly accurately manipulated by pressing harder or softer. Additionally, switches on the headstock will allow the player to choose whether the output is chromatic (i.e. touching at or behind a fret will make the note associated with that fret) or not (so every tiny movement of a finger will make a tiny change).


Introduction to Physical Computing

Music Composer Machine

Nikolaj Petersen

An algorithm that learns by listening to- and analyzing a number of songs (input), and outputs and print out a new song (or song phrase) on the basis of that input.


Using Markov Chain, the machine progresses a new and unique song by predicting functional harmony from a sources of existing songs.
Using Context Free Grammar, melody is written by following rules formed by the input melody’s relation to the chords.
Generating text as such often turns into gibberish.

The human memory of context in music is shorter and more volatile than in textual or verbal communications.
And the variables are fewer:
Almost any pop/rock song written since 1950’s are structured around 3 or 4 different chords.


Programming from A to Z

Semaphore Jacket

Zoe Bachman

A wearable that uses visual symbols and gesture to communicate peaceful messages and confront discrimination.<br />


I’ve been thinking a lot about the current refugee crisis, specifically why many Americans see refugees as violent instead of peaceful. As someone who used to work with refugees, I know they struggle to disprove stereotypes, particularly since English isn’t their first language.

Many people are working to design solutions for the refugee crisis, so I thought, what could I create that would give refugees a way to communicate peace?

I started brainstorming a wearable, since clothes have a history of carrying messages. I thought about the different ways one could illustrate “we come in peace”, like the act of waving a white flag. Communicating with flags reminded me of semaphore, a maritime language used between ships, which seemed appropriate given that many refugees are traveling by boat. There’s a precedent of using semaphore to illustrate peace – the peace sign is actually the letters N and D (for nuclear disarmament) in a circle. Semaphore is also a programming term relating to access – quite appropriate, given the refusal of many Governor’s (including Larry Hogan of Maryland) to let refugees into a country.

The wearable is a rain jacket that has LEDs at the bottom of the sleeves that are programmed and arranged to look like flags. The user turns on the LEDs by closing a snap in the middle of the jacket.

Once the user is wearing the jacket, they’ll stand in front of a camera and perform a message using the semaphore alphabet. The images will be stitched together into a .gif and uploaded to the blog as a record of their message.

For the show, a video tutorial on how to communicate with semaphore will be displayed to instruct users on how to communicate using the language. The collection of gifs created during the show will be displayed alongside.

Users can also take a print out that has information about the refugee crisis, the semaphore alphabet and the website where they can view their gifs and the rest taken at the show.

It should be said that this object is gesturing at these ideas rather than providing a solution. I’m interested in interrogating alternative forms of communication while using symbols related to this specific narrative, while bringing awareness to this very serious situation.


Introduction to Physical Computing

The Fantastic World of Mr. Phelps

Dalit Shalom

By digging around the dusty archives of the New York Public Library and connecting the dots, a remarkable character was revealed. This is a story about discovery and becoming close to someone I never knew through analog Big Data.


2 months ago, I came across an eclectic collection of postcards at the New York Public Library. After spending hours sorting them, I realized that 60 of them belonged to the same person. These postcards were sent from all around the world, written in very close dialog, and I felt destined to find out who this person was. By connecting the dots through the texts I read, and digging in the right archives at NYPL, I was able reveal many links and information about this mystery man.

Postmark: Discovering Mr/ Phelps is an exhibition about discovery and analog archived Big Data. It's about social networks that have existed prior to Facebook and Twitter, and about how interlaced recordings of data have been around for decades.

This exhibition is part exploratory (visuals and clues posted on a wall) and part experiential (getting in the shoes of Mr Phelps) through fantastic worlds created as collages out of the original postcards. This experience will be viewed in VR.


Cabinets of Wonder, In Their Shoes

Fibonacci Galaxy

Joakim G Quach, Ondina E Frate

I created a Fibonacci Galaxy, or a celebration of the Universe and Fibonacci.


The idea to combine Fibonacci with the universe came to me when I researched online and found out that the sum of the rotation of each two planets is a Fibonacci number, which I thought is fascinating. Both the p5 sketch and the fabrication parts are Fibonacci sequences. The user spins the turntable which creates changes the sketch. This can also work as a touch screen project.


Introduction to Computational Media, Introduction to Physical Computing

Hyper Headphones

Dhruv Damle, Viniyata Pany

A playful twist to an ordinary product! These headphones not only play, but also pan and boost the music you love.


In addition to just playing music, hyper headphones respond in real time when the user tilts head to left, right, front and back. The left and right tilt maps linearly to the left and right audio channel panning, while the front and back tilt changes the volume levels.

The product houses a sensor that measures the X and Y rotation. A microcontroller, also encapsulated inside the product, then maps these parameters to volume levels and channel panning. This project transforms ordinary headphones into an interactive and playful gadget. Use it as a wearable that accompanies you wherever you go, or use it as a cool head-banging gadget when you listen to the albums by your favorite band!


Introduction to Physical Computing