Sound Boxing

Yuan Gao, Yuchi Ma

Experience sonification and visualization when practicing boxing punches

https://vimeo.com/148029990

Description

Our main sensors are put into the boxing gloves, they include accelerometer and gyroscope. Then in the show, we give users this pair of boxing gloves and a Thai Pad to play with each other, basically asking them to punch like a professional boxer practicing. We will use the data sent out from boxing gloves (through bluetooth) to control the Spot Light, which is set up on top of the show area, and Sound Effect (speaker connected to laptop) around this area. Let user experience the spot light changing (colours, strobe) and sound beats changing according to the punching gestures they made.

Classes

Introduction to Computational Media, Introduction to Physical Computing

True Love Tinder Robot

Nicole He

Literally put your love life in a robot's hands.

http://nicole.pizza/itp/tag/tinder-robot/

Description

The True Love Tinder Robot will find you love, guaranteed. With Tinder open, you put your phone down front of the robot hand. Then you place your own human hands on the sensors. As you are looking at each Tinder profile, the robot will read your true heart's desire through the sensors and decide whether or not you are a good match with that person based on how your body reacts. If it determines that you're attracted to that person, it will swipe right. If not, it will swipe left. Throughout the process, it will make commentary on your involuntary decisions.

In a time when it's very normal for couples to meet online, we trust algorithms on dating sites to find us potential partners. Simultaneously, we use consumer biometric devices to tell us what's going on with our bodies and what we should do to be healthy and happy. Maybe it's not a stretch to consider what happens when we combine these things.

This project explores the idea that the computer knows us better than we know ourselves, and therefore it has better authority on who we should date than we do. In a direct way, the True Love Tinder Robot makes the user confront what it feels like to let computers make intimate decisions for us.

The robot is built with an Arduino, servos, a text-to-speech module, LEDS, a couple sheets of metal acting as galvanic skin response sensor, a bunch of wires, a box, and a speaker. The code is available on Github. You can also find my in-progress documentation on my ITP blog.

This is my final project for my Intro to Computational Media and Intro to Physical Computing classes during fall of 2015 at NYU ITP. Special thanks to my teachers, Tom Igoe and Lauren McCarthy.

Classes

Introduction to Computational Media, Introduction to Physical Computing

Sound collider

Marcelina A Nowak

Creative representation of music on screen

http://itp.marcelanowak.com/icm-final-project-sound-vision/

Description

The goal of my project was to create something expressive using Openframeworks.
The project combines visual effects and sound. It depicts a connection between a piece of music and its visualization. My goal was to mimic the collisions in the video, replicating the way the audio responded to these collisions in my own way.
First, I created a spiraling wave made out of turquoise spheres. Then, I drew another set of spheres (white ones) floating around the wave. My goal was to give them random speeds and positions, so that they could touch turquoise line at its different parts and moments. The moment when the two sets touch each other triggers a random note, so that they create some sort of music. There are 8 different types of sounds, which appear in a random order every time the floating spheres collide with the main wave.

By dragging the mouse the user can observe the whole scenery from a different perspective. Moreover, the ‘Y’ position of the mouse sets the size of the main (long) wave. By pressing certain keys we’re able to add more waves and later connect them together with thin lines. The whole project focuses on creating both a visually and sonically pleasing effect. For the show I’d love to steer the effects either by motion, or sensors. I think it could look really nice displayed on a screen. Even without sound the effect the whole work might be a nice interactive background displayed on the screen.

Classes

Introduction to Computational Media

VRTRIP

Corbin Ordel

VRTRIP is the experience of self reflection, isolation, truth, and self actualization.

https://youtu.be/VBDwHX1hlGw

Description

ROAD TRIPPERS! Follow your heart friends! Get in the car! Do you have any gas or peanut money? Whatever, it doesn't matter. Holy shit, that- You're Tot's friend right? Good thing we saw you here, we were about to split for the beach. “honestly tho, do u kno this prsn?” Anyway– oh, well, we don't know when were coming back honestly – we're just hopped up freaked out hippies! It's righteous! I bought these pink slacks from a thrift store the other days, only cost me 10 buckaroos!. I think I saw you outside Drones Club last week, right? You were looking pretty cute. I think you're Blake's age right? Are you also in Cyberactive Media Studies at U of M? That's what someone told me… Anywys, it's weird that we like know each other and also because your Jayy's little bro's age, also. I guess thats what happens in a small scene. What are you working on these days, we talked last weekend, what you did that day and you said that you had a good day, that you woke up and wrote a bit, then you got lunch and then you described the lunch in lots of detail and that you got a really good coffee and that the lunch was really yummy. Honestly I was really happy to talk to you, you seem interesting forsure, “but I'm not sure if your my type, to be honest I have no idea who you are but you seem different than most of the people who hang out around here”. DO you know Amanda? oh god, yea she's way older and from Alberta, she talks so much shit about everyone. It's cool if you go back home during the summer, we all do.

Classes

Introduction to Physical Computing, Introduction to Computational Media

SurveillAnts

Gal Nissim, Leslie E Ruckman

This project is created to evoke curiosity about non-human life, and wonder in emergent intelligence and systemic patterns.

Description

This collaboration is inspired by a deep interest in the way people perceive non-human animals and questioning the similarities that can be drawn between humans and all living creatures. The main theme of our project is seeing the unseen. We aim to communicate this in three different ways. First, through the structure we have built, we allow a view into the unseen, underground tunnels of ants. Second, through computer vision tracking and projection mapping, we visualize the chemical pheromone trails ants leave behind as they explore their space in real time. Third, we record and collect the paths of the ants in order visualize movements over time. Through the data collected, viewers are invited to explore the movement of the ants over time, revealing colorful drawings and potentially, unseen patterns in the daily activities of ants.

Classes

Introduction to Physical Computing, Introduction to Computational Media

Cheeks, Chin, Eyes, Nose, Lips and the rest of US

Ella Dagan Peled

an interactive deconstructing photobooth/image maker

http://www.ella-dagan.com/cheeks-chin-eyes-nose-lips-and-the-rest-of-us/

Description

an interactive portrait photo-booth like experience in which the face of the person who is using it deforms and dissolves with each click over time.

Eventually, if the person clicks enough times, the portrait will resemble all other portraits in it’s disintegration. Every mouse click on the canvas takes a picture and the more clicks, the more pieces the portrait divides into. When hovering over the canvas, the pieces change and exposed pieces from previous pictures. When pressing on the CONTROL key the sketch gets reload, and when pressing on the ENTER key the canvas is saved.

Classes

Introduction to Computational Media

The Clock Project

Zhuoxi Song

A beautiful website enlivened by gorgeous scenes from our beloved hometowns across the globe

http://theclockproject.net/

Description

The Clock Project is a website that reminds us of how far we've been aways from our beloved hometowns. With a clock showing current local time in a remote hometown, followed by videos consisted of hometown scenes that used to be easy to see but now thousands of miles away, viewers will feel the distance to beloved homes.

Classes

Art Strategies, Introduction to Computational Media

A Flash in the Pan

Yiting Liu, Yue Hu

Grabbing the star and evoking magic effects.

Description

The basic idea of the project is to evoke lives by grabbing the falling stars and dragging them to the particular positions. The lives are in both virtual and physical world in several forms. To clarify, in virtual world, when gamers grab a star and put it on the tree, the flowers will blossomed. Another, when gamers drag the star to the stone in virtual world, the stone in physical world will be evoked as well.

Through this project, we would like to show that life is short, like the flash in the pan, the meteor shot across the sky. However, life is also infinite and powerful since it could be transformed into various forms and last forever.

In the project, leap motion was used to detect the hand positions and gestures. Moreover, we used Processing to code the virtual effects and Arduino to build the connection within the virtual and physical world.

Classes

Introduction to Computational Media, Introduction to Physical Computing

The ITP's Mind

Michelle Hessel

An interactive ITP brain sketch that will allow user to understand what moves/intrigues each of the 1st year student.

http://www.techaboom.com/theitpbrain/

Description

The “inQuery” is a project from ITP's Applications Class in which all the 1st year students must write a blog post about a topic that they are curious about. This is an opportunity in which we are invited to talk about anything that we feel passionated or indignant about. Throughout the semester I found myself very interested in what people were saying and because of that I made a javascript interactive screen visualization of this data. The sketch has the shape of a brain in which nodes move around. The idea is that user will be able to touch the brain nodes and discover each inquiry, its author's name and e-mail. User can also search for specific terms or names. My intention is for people to find interests in common, connect with each other and discuss more about it, whether the user is from ITP or not.

Classes

Applications, Introduction to Computational Media

Clean-Up Drive

Anne Goodfriend, Nilomee Jesrani

Clean-Up Drive is a foot controlled, arcade style, video game experience that educates players about the harmful effects of Global Warming.

http://annekgoodfriend.com/final-project-the-process/

Description

Clean-Up Drive is a video game that educates children about the harmful effects of littering the planet, and how this is affecting the Ozone layer. The game is a race against time to collect all the trash on the surface of the Earth, before the Ozone layer is destroyed.

——

We designed a balance-board style game controller. The player uses the controller by standing on it and shifting their weight in one of 8 directions.

We also designed a corresponding arcade style video game where the player wanders around a post–apocalyptic world collecting trash. As they collect each item they slowly heal a disintegrating ozone layer. If the player collects all of the trash, and heals the ozone layer, they win by saving the world.

Classes

Introduction to Computational Media, Introduction to Physical Computing