ITP/IMA/IMA Low Res
Merry Christmas!
This is an interactive season's greeting card. Please enable your web camera, and move around your hands or your head to complete the card! The hints of the tasks are listed on the right. If you're still confused about how to interact, please check the video documentation =P And… Merry Christmas!!
An interactive experience tells how we see the world via biological processes.
We have different sensory systems obtaining the perception. But do you know what happened inside our bodies, leading us to perceive the world? When the light goes into our eyes, how do we get the vision from it?
“I want to see the world” is an interactive experience during which users help the person(with eyes, hand, and brain) to see. This project is an overview of how we see the world via the biological processes. When light enters the eyes in the darkness, a critical cell signaling pathway, called phototransduction, starts in cells in our eyes. The sodium channel is closed so Na+ could not enter the cell. Then, everything else helps us to see could occur. Information is sent from the eyes to the brain via nerves and more visual information processing happens in the brain, indicated by LED lights and drawings. The computational drawings simulate a biological technique, fluorescence imaging.
Hands are responsible for all the interactions. Users do some hand gestures to the “hand,” implying that when we cannot see, other sensory systems, such as touch, help us. First, users wave to the “hand” to let this person know that users are around. Second, users move their hands up and down to the “hand” to let the person know that they wish to help. Third, users follow the instructions shining the light on the “eyes.” And last, users wave the hand again to let the eyes see the final image.
Trying to interpret sign language in an artistic way
Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.
projection version：https://vimeo.com/491080270
digital version：https://vimeo.com/489352538
Let Deep Dream bring you to the deep ocean, you sink in it slowly, like the water want to bring you somewhere.
Deep Dream is a creative coding project base on the ICM sound assignment I made with Sihan.
The code is mainly divided into two parts: sound and visual picture. The background sound is created by p5.Oscillator and the bubbles sound is controlled by the overlapped bouncing balls. As for the visual part, the wave reacts to the Oscillator's frequency. The stock of fish and bubbles are controlled by the teachable machine, which can identify bubbles sound.
NOTICE! It works better if you change your audio input from microphone to computer audio speaker.(Or you could make bubble sound with your mouse, see if it works.)
Code link: https://editor.p5js.org/Lea-0821/sketches/n_EVbM6Ty
Elements: p5.Js, Sound, Music Visualization, Teachable Machine
Reference:
https://www.openprocessing.org/sketch/891024
https://www.openprocessing.org/sketch/802077