Musical gloves

Trying to interpret sign language in an artistic way

Jiayuan Li

https://vimeo.com/489352538

Description

Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.

projection version:https://vimeo.com/491080270

digital version:https://vimeo.com/489352538

ITPG-GT.2301.00004, ITPG-GT.2233.00007
Intro to Phys. Comp., ICM
Accessible

Visual translator

The Relationshin between what is visual and what is Auditory.

Ahmed Mostafa

https://www.youtube.com/watch?v=b4IBhfVDbu0&feature=emb_logo

Description

The project will mainly be about giving the user the opportunity to manipulate the sound through a musical note based mainly on converting the values sent from the sensor to the three-color RGB while moving images and color prints and the output will be unexpected and prior to manipulation, besides the sound as a result we will use the same values to build visual areas moving And display it on the wall facing the user.

ITPG-GT.2301.00006, ITPG-GT.2048.00007
Intro to Phys. Comp., ICM – Media
Sound,Performance

Star Machine

Catch a star and turn it into a star candy with the Star Machine✨

Sihan Zhang

https://youtu.be/6uFFp6LMZZA

Description

Experience the joy of catching a star with the Star Machine! When you stand in front of the Star Machine, the computer will track your right hand through webcam using the PoseNet machine learning model. If your hand position reaches a star on the projection, the star is “captured” and it will follow your hand. When you place the star inside the crystall ball of the Star Machine, the star will gradually disappear and a star candy will fall out.

ITPG-GT.2301.00005, ITPG-GT.2465.001
Intro to Phys. Comp., Machine Learning for the Web (Online)
Machine Learning,Play/Games