Description
I want to simulate a immersive experience about walking on the water(from my imagination). In my original plan I will use projector to post my project on the floor. And if the user walk on it there will be water ripples and piano sound for each step. And there will also be some jellyfishes swim around the player's feet. But since I am not in NYC right now, I can't borrow any equipments from the lab. So I transform it into a online version, and player can interact with it via mouse.
Sean Zhu
Description
Control your room and computer with a sensor so intuitive, you can use it in your sleep!
WallTap is a wired capacitive touch sensor that is easily mountable on any wall, or any other fixed surface. It has a huge surface area gives the user a very easy-to-reach control that can be programmed to do anything they want, and is something that they can activate without looking at a display — or at anything at all!
The current prototype must be attached to a computer and all touch actions must be initiated from the computer. The eventual goal would be for the device to be able flip switches, and to communicate with smart home devices. But even with the current limitations, WallTap has completely changed my bedtime experience, allowing me to control my music and turn off my “lights” without getting up, or worse, starting at a brightly-lit display.
WallTap has a secondary goal. The modern concept of smart home devices has become entangled with the concepts of luxurious pricing, wireless connectivity, and online accounts. With WallTap we attempt to buck these trends by creating “dumb smart home device” that is just as functional, without concerns of price, interference, or privacy.
Keunjung Bae
Description
In general, music is perceived as art by sound, and we think that if there is a problem with hearing, we will not be able to hear it. Beethoven, a composer who became deaf in his later years, can be viewed with pity, but on the contrary, it can be seen as a human victory overcoming adversity.
But, just because they can't hear music on their ears, Does it mean they can't play music at all? The important thing is that the source of sound is vibration.Then, even if we can't feel the vibration with our ears, we would it be possible to feel it with other organs of our body.
When listening to a low sound through a loud speaker in a place like club, we can experience the vibrations all over our body. This is a stimulus that can be sensed by a person with a hearing problem because the transmitted stimulus is felt by other sensory organs as well as the ear.
The purpose of this 'VIBROTACTILE' project is a device that makes it possible to recognize and feel music through tactile experiences through vibrations for the hearing impaired.
How would the world of music look like through the sound of strings transmitted to the fingers through several vibrating motors?
VIBROTACTILE makes them feel the music through vibration through the sense of tactile transmitted to the strings through vibration motors. Through the vibration of the motor that vibrates automatically according to the song of the p5 sketch, we can check which keyboard of the p5 sketch video connected with the vibrating motor is what note. Therefore, even if we can not listen to the piano sound, we can check which note is played with only the vibration.
project webstie: http://www.keunjungbae.com/2020/12/09/pcom-week-14/
Kseniia Balaenkova
Description
Me and another ITP student Wendy Wang created a maze that was made with visually impaired people in mind. The player can be guided through the maze only by sounds. For people, whose vision is not affected, the game offers an opportunity to understand how difficult it can be to rely just on hearing sense. At first, it is challenging and confusing to navigate through maze but once you get used to it, it becomes a fun and interesting challenge. The maze is generated randomly every time, and its complexity can be easily changed in the code. The player’s movement is controlled with the arrow keys on the keyboard. Sounds are played in a list format and the player can't move until the sounds are finished playing. All the sounds are easily distinguishable, and left and right sounds were made stereo so that they can be played in a left ear or right ear respectively. To understand the game easier, the greetings and instructions are played when the person first loads the game and can be listened again at any point by pressing Shift key.
Jiayuan Li
Description
Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.
projection version：https://vimeo.com/491080270
digital version：https://vimeo.com/489352538