Haunt That House!

Have you ever wanted to be dead and haunt the house of an actual human? Well today's your lucky day!

David Currie, John Bezark

https://www.loom.com/share/24a6f868f52d4ee09a4a4307ab9700f0

Description

Haunt that House is a many vs one player ghostly arcade game where several ghosts in a digital space compete against one human in a physical space. As the ghosts float around and interact with digital objects, they trigger real world effects like changing the color of a lamp to a ghastly green or making household objects rattle and shake.

The human, meanwhile has a handy dandy ghost detector which they can point at objects to detect the presence of the paranormal and which can be used to ZAP the ghosts and kick them out of the objects. The ghost detector communicates with the haunted household objects which enables for a very reliable “scanning” effect which reveals the presence of the paranormal.

The ghosts have 3 minutes to haunt 2 of the 3 objects in the humans house an the human is just trying to keep all the ghosts at bay! Things still in development for the project are a “fancier ui” for the ghost and a little bit clearer feedback for the ghost hunter, but the underlying communication and interactions are really solid. We are very happy with how reliable the interactions are between the humans and the ghost, now it's just a matter of adding a little bit of polish which we are very confident we can do in the time remaining!

While the game is on the surface quite silly, we were really drawn to the questions like “how can you make a game that is playable across a digital and physical divide?” With so many ITP students in various parts of the globe, we hope that our spooky little experience can bring folks together in a new and interesting way.

ITPG-GT.2233.00002, ITPG-GT.2301.00006
ICM, Intro to Phys. Comp.
Play/Games

iWind_

Use your body control to play with the wind

Binyan Xu,

https://youtu.be/xytzRsYMmDE

Description

My project is iWind.

You can use the rotation of your head to drive the Arduino to control the character’s flying in a simulated real world, like wind passing over forests and lakes.And you can also try to swim in the universe.

Arduino is installed on an action camera accessories/helmet and connected to Unreal Engine.

(iWind is designed and made by Michelle Xu and Wei Wu)

ITPG-GT.2301.00007, ITPG-GT.2079.00001
Intro to Phys. Comp., Virtual Production (Online)
Play/Games,Wearables

VIBROTACTILE

An instrument that can feel the music with vibrations for the hearing impaired

Keunjung Bae

https://vimeo.com/491830031

Description

In general, music is perceived as art by sound, and we think that if there is a problem with hearing, we will not be able to hear it. Beethoven, a composer who became deaf in his later years, can be viewed with pity, but on the contrary, it can be seen as a human victory overcoming adversity.

But, just because they can't hear music on their ears, Does it mean they can't play music at all? The important thing is that the source of sound is vibration.Then, even if we can't feel the vibration with our ears, we would it be possible to feel it with other organs of our body.

When listening to a low sound through a loud speaker in a place like club, we can experience the vibrations all over our body. This is a stimulus that can be sensed by a person with a hearing problem because the transmitted stimulus is felt by other sensory organs as well as the ear.

The purpose of this 'VIBROTACTILE' project is a device that makes it possible to recognize and feel music through tactile experiences through vibrations for the hearing impaired.

How would the world of music look like through the sound of strings transmitted to the fingers through several vibrating motors?

VIBROTACTILE makes them feel the music through vibration through the sense of tactile transmitted to the strings through vibration motors. Through the vibration of the motor that vibrates automatically according to the song of the p5 sketch, we can check which keyboard of the p5 sketch video connected with the vibrating motor is what note. Therefore, even if we can not listen to the piano sound, we can check which note is played with only the vibration.

project webstie: http://www.keunjungbae.com/2020/12/09/pcom-week-14/

ITPG-GT.2301.00002
Intro to Phys. Comp.
Education,Accessible

Smart Tiles

A letter block board with text-to-speech engine designed for tangible learning.

Brandon Roots

https://vimeo.com/489237628

Description

Smart Tiles is a block board that recognizes wooden letter tiles to generate speech and play games. It operates entirely offline. The project was designed with my 4 year old niece and nephew in mind. They both enjoy playing with educational smartphone apps but I had a hard time finding any really compelling educational tangible toys for learning letters and words. This is my attempt to fill that gap. The letter tiles are designed to be familiar, like the wooden alphabet blocks I had growing up, and CNC milled from eco friendly Green-T Birch plywood. I have pushed to make the technology as “invisible” as possible to bring some magic to the user experience. Both English Braille and print characters are engraved on each block to be inclusive for tangible learners.

ITPG-GT.2845.001, ITPG-GT.2301.00005, ITPG-GT.2048.00002, ITPG-GT.2536.00001
Prototyping Electronic Devices , Intro to Phys. Comp., ICM – Media, Programming from A to Z (Online)
Education,Play/Games

CHOCOLATE FACTORY

Do you fancy some chocolate?

Chenyan Yu, Jane Meng, Zhiyue Huang

https://youtu.be/CZI2s5pUyp0

Description

With the finals approaching, do you find yourself feeling down or eagerly need some rest? Are you uncousiously tapping your table out of anxiety? Now, we've created a good place to vent your negative emotion, and… Turn these feelings into something sweet, such as chocolate! In our chocolate factory, we take users' tapping pattern as input, do a rough classification of emotion, and generate a chocolate recipe accordingly. Tah-dah! Time for a tea break!

ITPG-GT.2301.00008
Intro to Phys. Comp.
Health,Product Design

The Trace.

The Trace is the project combined ICM and PC, and I try to capture the proof of existence with this project.

En-Tung Liu

https://www.youtube.com/watch?v=064WTEDT5nI&feature=youtu.be

Description

This project comes from questions: how can people exist, and how can existence be proven? So I combine the idea of long-exposure in photography with the p5 sketch and set the installation in a dark place. When the audience triggers the sketch, it will start to capture the audience's movement and draw the light trace on the dark canvas, and when the audience leaves, the trace will disappear.

ITPG-GT.2301.00002, ITPG-GT.2048.00005
Intro to Phys. Comp., ICM – Media
Performance,Art

KameHameHa Ball

The KameHameHa Ball is an interactive sphere that inspired by Dragon Ball Z.

Chenyou Lee

https://vimeo.com/489948512

Description

How to use:

1. Put your left hand on the hand shape of the sphere. Starting from your thumb to your little finger one at a time, pressing down the sensor on the finger tips.

2. When pressing down the sensor, it will activate one set of the LED inside the sphere. And also activate the animation on the monitor.

3. Each sensor controls one set of LED and a clip of the animation. At the end when you are pressing down all five of them, you will complete the “Kame Hame Ha.”

ITPG-GT.2301.00001
Intro to Phys. Comp.
Performance,Play/Games

Sensor Battle (Star Wars Edition)

Remotely controlled synchronous RC car battle entertainment

Minyoung Bang, Rui Shang, Sara Ro, Yifei Gao, Zhaozhi Liu

https://vimeo.com/488984000

Description

In the spirit of COVID-19 remote learning, we wanted to create synchronous entertainment done remotely – the first ITP Sensor Battle. We are a group of 5 members located in 13-hour-difference time zones and we created a live sensor battle entertainment connected via UDP server. This is a match among 3 players to determine the best and strongest sensor. 3 players, in the USA, are battling with 3 different sensors – joystick, gesture and muscle sensors – connected to the battle (UDP) server to control their respective RC cars in Beijing battle ground. The battle ground and competing RC cars are in Beijing and players and their sensors are in the USA.

The team ideated 4 different gameplays to determine the battle, but after putting to the vote to the ITP class of 2022, we decided on the Paintball gameplay. Each RC car has a canvas and a paint gun mounted; and the players eliminate the others by shooting the paint on the other players’ mounted canvases.

Technicality aside, we imagined ourselves as extraterrestrial beings representing different sensor communities. The Sensor Battle is taking place at Star-dium stadium on the remote frontier planet of Batuu. Hope you enjoy! *Vulcan Salute*

ITPG-GT.2734.00001, ITPG-GT.2301.00004
Live Web (Online), Intro to Phys. Comp.
Performance,Play/Games

Sound and Visual Bender

Bending sounds, color and form with our bodies.

Natalie Fajardo, Rebecca Melman

https://vimeo.com/489637134

Description

In Sound and Color Bender, we explore the relationship between the movements of our bodies, color, form and sound. This project is the beginning of what we would like to be a tool for performers to use to create music and visual art simultaneously. What is the connection of the gestures of an arm moving, to the frequency of a melody, to a visual pattern on a screen? While we are based on opposite sides of the country, Natalie and I worked together to create a glove that responds to the movement of the user’s hand. We used the micro controller’s built in accelerometer and gyroscope to measure the tilt and acceleration of the hand, which sent those values to audio and visual software. The project’s current state provides a meditative space, with stimulating visuals and an airy, atmospheric audio experience.

ITPG-GT.2301.00002
Intro to Phys. Comp.
Performance,Wearables

Building Blocks

Building Blocks deals with the effects that every building and its height creates on the surrounding area

Dalit Steinbrecher

https://youtu.be/I8vpF_c4TmA

Description

Walking in the streets of New York made me think a lot about cities. Every building that is there (especially the big ones) has a direct effect on me: the light that I see or don't, wind that I feel, small or big shadows in hot days – are all effects of the size and height of every building and their position.

Building Blocks deals with the effects that every building and its height creates on the surrounding area of the city. Does it block the sun and because of that the street is darker? Or colder? Does it block the air? Is there less grass because of it? In my project every wooden block can block something essential.

The project is divided into two diminutions: The screen and the physical dimension. The

The physical dimension was a surface and 12 wooden blocks that presented buildings. The screen was an illustration of a “city” without buildings and air and light graphs. The physical dimension effect directly on the screen. Each and every building that the viewer will put on the surface changes the illustration on the screen. The light, the air and the grass will be reduced with each building that will be put on the surface. The building heights and location also affect the illustration on the screen.

This project talks about communication between the physical and the computer. In Building Blocks I want to illustrate the effect of buildings to show the effects and change the height building has on essentials that we do not always see but can affect us as people that live or

ITPG-GT.2301.00007
Intro to Phys. Comp.
Culture,Play/Games