https://youtu.be/z4tKGAlZrvk

Description

I want to simulate a immersive experience about walking on the water(from my imagination). In my original plan I will use projector to post my project on the floor. And if the user walk on it there will be water ripples and piano sound for each step. And there will also be some jellyfishes swim around the player's feet. But since I am not in NYC right now, I can't borrow any equipments from the lab. So I transform it into a online version, and player can interact with it via mouse.

ITPG-GT.2000.00001, IMNY-UT.101.003

Applications, Creative Computing

Accessible

https://vimeo.com/491766360

Description

The Mr. Scribbles Dancing Drawing Robot was created to help people feel more comfortable about their bodies, about their movements — about being weird sometimes. Dancing Drawing Robot is a robot, controlled using dance poses.

ITPG-GT.2301.00006, ITPG-GT.2048.00002

Intro to Phys. Comp., ICM – Media

Machine Learning,Play/Games

https://vimeo.com/489257121

Description

zoom link:

https://nyu.zoom.us/j/91942675074?pwd=Sm13YzQyVm9abEFUOXlFdUsrSk8rUT09

GO TO
https://midi-sender.herokuapp.com/
OR CLICK PROJECT WEBSITE TO PLAY THE DRUMS YOURSELF!

I have collected, arranged, and hung 7 percussive and sonic objects in and array around the listener's ear, be it a human or electronic eardrum. To each object is attached a solenoid motor which will strike the object, and I will control this striking both live with buttons and by creating rhythmic MIDI clips in Ableton Live. I'll then explore the vocabulary of sounds possible with my room-sized instrument, incorporating it into musical performance, perhaps on its own, played and manipulated by multiple people, and with other sound sources, for instance a pitch-detecting harmonizer I created, or just an acoustic instrument like the bass clarinet. If I have time and luck I'll make it possible for spectators to trigger the sculpture over the web.

ITPG-GT.2301.00006, ITPG-GT.2994.001, ITPG-GT.2048.00005

Intro to Phys. Comp., The Neural Aesthetic (Online), ICM – Media

Sound,Performance

https://youtu.be/i3Ywkyw1BDQ

Description

Space-mapper car is a tiny car––less than 5×9″ large––that uses IR distance sensors to detect walls and objects in its surrounding area and map them out on screen. Using two N20 encoded gear motors, the car can accurately track its movement speed and angle and transmit them through serial communication to p5.js, which can use the information, along with the data from its 2 Sharp IR distance sensors, to gradually piece together a rough map of the space.

The user can choose between 2 modes, each curating a different interaction between the physical space and the on-screen map. In the first mode, the car will fill out a map of its surrounding space on screen, as described above. In the second, more entertaining mode, a path will be drawn on screen for the robot to follow, and a series of lines will be drawn parallel to the prescribed path. The user will have to place a series of objects along the car's physical path in order to match the on-screen map as best as possible. The two modes therefore allow for bi-directional interaction between the car's physical space and its on-screen replication; the physical space dictates the on-screen map in the first mode, and vice-versa in the second mode.

ITPG-GT.2233.00002, ITPG-GT.2301.00006

ICM, Intro to Phys. Comp.

VR\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\AR,Play/Games

https://www.loom.com/share/24a6f868f52d4ee09a4a4307ab9700f0

Description

Haunt that House is a many vs one player ghostly arcade game where several ghosts in a digital space compete against one human in a physical space. As the ghosts float around and interact with digital objects, they trigger real world effects like changing the color of a lamp to a ghastly green or making household objects rattle and shake.

The human, meanwhile has a handy dandy ghost detector which they can point at objects to detect the presence of the paranormal and which can be used to ZAP the ghosts and kick them out of the objects. The ghost detector communicates with the haunted household objects which enables for a very reliable “scanning” effect which reveals the presence of the paranormal.

The ghosts have 3 minutes to haunt 2 of the 3 objects in the humans house an the human is just trying to keep all the ghosts at bay! Things still in development for the project are a “fancier ui” for the ghost and a little bit clearer feedback for the ghost hunter, but the underlying communication and interactions are really solid. We are very happy with how reliable the interactions are between the humans and the ghost, now it's just a matter of adding a little bit of polish which we are very confident we can do in the time remaining!

While the game is on the surface quite silly, we were really drawn to the questions like “how can you make a game that is playable across a digital and physical divide?” With so many ITP students in various parts of the globe, we hope that our spooky little experience can bring folks together in a new and interesting way.

ITPG-GT.2233.00002, ITPG-GT.2301.00006

ICM, Intro to Phys. Comp.

Play/Games

https://youtu.be/QO6_gEb_1EA

Description

Our idea is to generate a meditative form of Mark Rothko-like paintings that reflects viewers’ inner state with two controllable nobs that are connected to the led painting.

ITPG-GT.2301.00006

Intro to Phys. Comp.

Art,Product Design

https://www.youtube.com/watch?v=b4IBhfVDbu0&feature=emb_logo

Description

The project will mainly be about giving the user the opportunity to manipulate the sound through a musical note based mainly on converting the values sent from the sensor to the three-color RGB while moving images and color prints and the output will be unexpected and prior to manipulation, besides the sound as a result we will use the same values to build visual areas moving And display it on the wall facing the user.

ITPG-GT.2301.00006, ITPG-GT.2048.00007

Intro to Phys. Comp., ICM – Media

Sound,Performance