water imagination

Simulate the environment in my day dreaming

https://youtu.be/z4tKGAlZrvk

Description

I want to simulate a immersive experience about walking on the water(from my imagination). In my original plan I will use projector to post my project on the floor. And if the user walk on it there will be water ripples and piano sound for each step. And there will also be some jellyfishes swim around the player's feet. But since I am not in NYC right now, I can't borrow any equipments from the lab. So I transform it into a online version, and player can interact with it via mouse.

ITPG-GT.2000.00001, IMNY-UT.101.003
Applications, Creative Computing
Accessible

WallTap

Control your room and computer with a sensor so intuitive, you can use it in your sleep!

Sean Zhu

https://szhu.github.io/itp-blog/files/2020-09-pcomp/week-13/1_project_3/process/IMG_9117.opt.mp4

Description

Control your room and computer with a sensor so intuitive, you can use it in your sleep!

WallTap is a wired capacitive touch sensor that is easily mountable on any wall, or any other fixed surface. It has a huge surface area gives the user a very easy-to-reach control that can be programmed to do anything they want, and is something that they can activate without looking at a display — or at anything at all!

The current prototype must be attached to a computer and all touch actions must be initiated from the computer. The eventual goal would be for the device to be able flip switches, and to communicate with smart home devices. But even with the current limitations, WallTap has completely changed my bedtime experience, allowing me to control my music and turn off my “lights” without getting up, or worse, starting at a brightly-lit display.

WallTap has a secondary goal. The modern concept of smart home devices has become entangled with the concepts of luxurious pricing, wireless connectivity, and online accounts. With WallTap we attempt to buck these trends by creating “dumb smart home device” that is just as functional, without concerns of price, interference, or privacy.

IMNY-UT.103.001
Quick Introduction to Physical Computing
Tool\Service,Accessible

VIBROTACTILE

An instrument that can feel the music with vibrations for the hearing impaired

Keunjung Bae

https://vimeo.com/491830031

Description

In general, music is perceived as art by sound, and we think that if there is a problem with hearing, we will not be able to hear it. Beethoven, a composer who became deaf in his later years, can be viewed with pity, but on the contrary, it can be seen as a human victory overcoming adversity.

But, just because they can't hear music on their ears, Does it mean they can't play music at all? The important thing is that the source of sound is vibration.Then, even if we can't feel the vibration with our ears, we would it be possible to feel it with other organs of our body.

When listening to a low sound through a loud speaker in a place like club, we can experience the vibrations all over our body. This is a stimulus that can be sensed by a person with a hearing problem because the transmitted stimulus is felt by other sensory organs as well as the ear.

The purpose of this 'VIBROTACTILE' project is a device that makes it possible to recognize and feel music through tactile experiences through vibrations for the hearing impaired.

How would the world of music look like through the sound of strings transmitted to the fingers through several vibrating motors?

VIBROTACTILE makes them feel the music through vibration through the sense of tactile transmitted to the strings through vibration motors. Through the vibration of the motor that vibrates automatically according to the song of the p5 sketch, we can check which keyboard of the p5 sketch video connected with the vibrating motor is what note. Therefore, even if we can not listen to the piano sound, we can check which note is played with only the vibration.

project webstie: http://www.keunjungbae.com/2020/12/09/pcom-week-14/

ITPG-GT.2301.00002
Intro to Phys. Comp.
Education,Accessible

Accessible maze game

The accessible maze game: test your hearing senses and increase your awareness of visual impairment in a playful format.

Kseniia Balaenkova

https://youtu.be/Nqdl1HFtyFw

Description

Me and another ITP student Wendy Wang created a maze that was made with visually impaired people in mind. The player can be guided through the maze only by sounds. For people, whose vision is not affected, the game offers an opportunity to understand how difficult it can be to rely just on hearing sense. At first, it is challenging and confusing to navigate through maze but once you get used to it, it becomes a fun and interesting challenge. The maze is generated randomly every time, and its complexity can be easily changed in the code. The player’s movement is controlled with the arrow keys on the keyboard. Sounds are played in a list format and the player can't move until the sounds are finished playing. All the sounds are easily distinguishable, and left and right sounds were made stereo so that they can be played in a left ear or right ear respectively. To understand the game easier, the greetings and instructions are played when the person first loads the game and can be listened again at any point by pressing Shift key.

ITPG-GT.2301.00004, ITPG-GT.2048.00004
Intro to Phys. Comp., ICM – Media
Play/Games,Accessible

Musical gloves

Trying to interpret sign language in an artistic way

Jiayuan Li

https://vimeo.com/489352538

Description

Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.

projection version:https://vimeo.com/491080270

digital version:https://vimeo.com/489352538

ITPG-GT.2301.00004, ITPG-GT.2233.00007
Intro to Phys. Comp., ICM
Accessible