Alejandro Matamala

p5ML PONG EMOJI • Machine Learning Pong Game in the browser. <br />



This project is an interactive game build with the p5ML, a library for doing machine learning in the browser. In this case, in order for the user to be able to play, the user will have to train, in realtime, a neural network as the controller to play a game using a set of assigned emojis as reference. This project aims to educate users on how machine learning tasks are trained through a fun gaming experience


Live Web

Good Vibrations

Barak Chamo, Jenna Xu

Enter the mind of a monk in our pan-sensory brain entrainment dome.



Meditation requires years of practice to be fruitful, but entrainment may be a shortcut to less stress. Our dome is an immersion into in a four-minute, pan-sensory experience that we hope will reproduce the brain activity found in advanced meditation practitioners. Users wear a headset that measures their brain activity during the session, so they will be able to see how the experience affected their brainwaves afterwards.


Introduction to Computational Media, Introduction to Physical Computing


Scott Reitherman

A mixed reality app that augments Vinyl LPs.



Continuing with Alex Fast on our mixed reality quest to augment LPs, we will pursue new features not yet explored in our midterm and refine things like API integration and video surfaces that are already key ingredients.

We have discussed putting this project into the ITP Winter Show, presented as a sort of AR record store pop-up shop, so we'll need to augment a handful of records. So we'll add to the list of albums and pursue refining the Radiohead and Bowie records that we began with.

Big New Things: integrated 3D objects to provide contextual information in more spatial ways, as well as implement some element of the Google Resonance spatial audio SDK.


Magic Windows and Mixed-Up Realities


Michael Simpson

A physical object that exhaustively displays every English word that can be displayed using the limited alphabet provided by 7-Segment character displays.



7-Segment character displays are primarily suited for displaying numbers and most characters in the English alphabet. However, there are certain character which simply cannot be displayed in a way or would be indistinguishable from another character. Inspired by Allison Parrish's everyWordBot, this project exhaustively displays every English word that is capable of being displayed using 7-Segment displays.


2 Minute Hate

Fanni Fazakas

The power to destroy a physical entity by the human mind.



I want to give an audience the opportunity to try out the brainwave sensor and also the joy of being destructive as a child. Just as when you demolish a sand castle which somebody else have built up carefully. We all know that feeling. It is childish, selfish, dark but on the other hand also very ecstatic.

I hope they will understand that these sensors are actually getting more and more accurate and they really give a raw data straight from your brain which other people can interpret. I also want them to stay focused in a cruel way and after trying the installation out feel a bit ashamed and guilty.

This is a participatory and time based installation where multiple people can try to destroy a physical entity by their thoughts. The time I provide them is exactly 2 minutes just as the “Two minute hate” in Orwell’s 1984. Within this time frame they have the opportunity to focus on destroying a castle cube made by sugar cubes. If they concentrate hard enough it means a motor arm will take action and start whipping black oil paint on the cube. I decided to use this material because its also nice visually if one person is doing it but by the end of the Winter Show I hope more people will destroy the cube entirely.

The cube itself will symbolise power. I decided not to give it a real form but just a general image which everyone can interpret as they wish for. The paint has to be oily and not only water based otherwise it collapses too early.


Digital Self-Defense- Security for Everyone, Introduction to Physical Computing, Mindfulness and Transformative Technologies


Cristobal Valenzuela, Jennifer Lim, Scott Reitherman

An immersive 24-hour web documentary about a bodega in Queens, NY.<br />



Bodega is a 24-hour web documentary that captures the everyday interactions and transactions of a small neighborhood business. As viewers settle into the real-time audio soundscape of the store, 3D models of purchased items rotate on screen. Bodega is a meditation on commerce, labor, and the relationships between locals in a changing neighborhood.
For the Winter Show, we’d like to present Bodega as a multimedia installation. The project will be projected on the wall, with headphones available for individual viewers. A table will display an array of the goods that were purchased during filming and scanned into the project.


Alt Docs: Inventing New Formats for Non-fiction Storytelling

lego sound sequencer

Katherine Wu

Program the sounds of your everyday world into Lego blocks.<br />



The idea behind this toy was inspired by Seymour Papert's thoughts on learning programming in the 1960s. One of his most powerful ideas for me was that objects in our physical world are embedded with concepts about math, programming, and logic.

Legos are well known as good primers to math thinking , even programming. Each block is a discrete modules that contain information: color, size. In this toy, people can shuffle blocks on a board, and a speaker plays different sounds depending on the color of the block.

People can also “program” their own sounds into Lego colors, by pushing buttons on the dashboard. Instead of computery, sine wave sounds, I thought about how fun and open it feels to play with your voice, and your surroundings as a kid. Through found sounds, this makes physical what kids naturally do already: find patterns in sounds–even words– and in those patterns, music.

How does it work? It is important to me that this is an open system, where you don't need special bricks to play. There is no circuitry in the bricks or even on the board itself. A webcam reads the image of the board, and using p5.js graphic functions, the computer can discern discrete shades of red, yellow, green, blue. In the future version, you can even record your own colors for new bricks to play.


Introduction to Physical Computing

Into the Darkness

Heng Tang

Explore the darkness of the universe with a brave heart!



I play games a lot but I am so used to keyboards and joysticks. I was thinking how fun it would be if video games had more interactivity.

I watch movies a lot and I am a fan of Star Trek. Into the Darkness is one of my favorite sequel. So I decided to make a game with space elements and physical interactions.

I believe it would be best and intuitive for players to control a spaceship on the screen with a physical spaceship in the real world. In my project, players will explore the dangerous and mysterious space with their wit and mind. I used distance sensor to detect the altitude of the spaceship and map it into the three.js program.

Space is an eternal subject for humans so I believe my project would interest lots of people!

Thank you for your time and I would be really appreciated if my project is chosen.


Applications, Introduction to Computational Media, Introduction to Physical Computing

ViD3o Mashup

Rebecca Skurnik

A fun way to create your own abstract digital 3D art using physical controls<br />



I wanted to create a fun medium where people can create their own abstract digital video art in 3D.

How it works:
Structured as a retro old school arcade game, the first step is for players to select a set of their 3D abstract video from 4 different 3D sets that I created. The next step is for player to select an abstract background music for their 3D abstract video from 4 different songs that Lu Wang, my classmate composed and allowed me to borrow for this project. Once players have selected both the set and music of their piece, they can then manipulate (change and/or add) elements in their set. There are 6 different potentiometers that change 6 different elements in each video set. It’s up to players to play and figure out which potentiometers control which elements in their video, and create their own art accordingly.

For example, players can change the color of their set by turning one potentiometer, or add a bunch of 3D toilets to their video by turning another potentiometer.


Introduction to Computational Media, Introduction to Physical Computing

Guerilla Vogue Society

Ari Melenciano

A 360 degree immersive audio visual experience to explore the art of protesting.



Photos of protestors from the 60s in comparison to today's photos of protestors, are nearly indistinguishable. The issues activists are fighting for, have been cyclical, for generations. And, various forms of activism have taken on a similar roles to fashion, a major indicator in one's identity as well as being a main source for artistic expression. In Guerilla Vogue Society, I intentionally use analog material (“polaroids”) in conjunction with emerging technologies (Augmented Reality and Projection Mapping) to explore the cyclical behavior of injustice and protest in avant-garde times. I then explore high aesthetics in representation of data to explore the fashion of activism, data art, and the future of protesting.


Data Art