Posted on

The Genesis

Create a new universe by your hands.

Minjun Kim, Zi Xun Meng

https://www.youtube.com/watch?v=QnJPcQUxpCM

Description

We created an experiential project with dynamic visual effects and sounds from the deep universe. Everything in the universe comes from the singularity and first cause and first cause. The player will act as the creator of the universe, giving the universe its first driving force and deeply participating in its construction.

ITPG-GT.2233.00007, ITPG-GT.2048.00007
ICM, ICM – Media
Music,Play/Games
Posted on

You and I Don't See The Same World

We each see the world through our own filter – literally.

Wendy Wang

https://youtu.be/mM-xqNZBNcU

Description

So much of how we view the world depends on what we see. But is the world really an objective truth that's just for everyone to eventually see it? This could be something for the audience to think about while exploring the diversity of animal vision. From finding out how your pet sees you, to learning extraordinary ways different animals see the signals that we could not observe, it's a fun experience to explore how we all see the world a little differently.

*This project aims to show the diversity of color vision. However, as some animals perceive aspects of light that we cannot see, and may perceive colors with a higher dimension of complexity, these visualizations are my speculation of what could be.

ITPG-GT.2233.00007
ICM
Education,Narrative/Storytelling
Posted on

Soundrop

A poetic interactive painting of rain that reflects the viewers through splendid colors

Bei Hu, Junoh Yu

https://www.youtube.com/watch?v=My7IVEd98w0&feature=emb_title

Description

“Soundrop” is a poetic interactive painting of rain that reflects the viewer through splendid colors. In this piece, we focused on ‘rain’ and ‘meditation’. So through conversation, we decided to write a poem about rain as a part of the process of making. We tried hard to create a relaxing and meditative visual-sound experience for the viewer. Through using PoseNet and Webcam, we can capture the viewer’s position and present the shape of the viewer with rain. When the viewer stands in front of the P5.js painting with rain falling from the top, the white raindrops turn into rainbow colors as soon as they pass through the viewer’s body outline. The changing color of rain will be updated according to the body movement of the viewer. The speed of the rain and the volume of the rain sound could be changed according to the position of the viewer's body. We want people to experience the rain in a new way as they are standing in the rain, and listening to our self-written poems. (Co-created by Junoh Yu and Bei Hu)

ITPG-GT.2233.00007
ICM
Sound,Narrative/Storytelling
Posted on

A Shining Tree

This project aims to create a poetic and embodied experience of nature and growth by letting people grow shining trees using their body.

Chenyan Yu, , Zairan Liu

https://youtu.be/EweHTKCm43M

Description

The Shining Tree combines Posenet to detect human and p5.js for the growing tree itself. Our purpose is to remind people the magical and beautiful nature and its amazing arrangement of the circle of life and at the same time, make it a calm and peaceful process for people to experience by themselves as a way of meditation and reflection. In the chaotic time of Covid-19, not only social interactions are partially impeded, but our connection to nature. A shining tree seems to be a great solution to the anxiety we are facing now and can help us to reconnect with the most basic yet wonderful experience of living and the hope it carries within the circle of life.

ITPG-GT.2233.00007
ICM
Narrative/Storytelling,Play/Games
Posted on

abracadabra

Magicians! Create your own magic circle now!

Hanlin Liu, Jane Meng

https://youtu.be/ssSIcM7tqTk

Description

Have you ever dreamed of becoming a magician and having the power to make some magic stuff? Both Alina and I love all magical things. Getting inspiration from Card Captor Sakura, we planned to build a magic circle generator. The basic interaction of this generator is that users input their birthday and the generator will create a unique magic circle for him or her. Every magic circle is formed by four parts: a rotating 3D magic stone, a unique pattern, a special song and a sentence of the day. Hope you can enjoy this sparkling and glowing visual effect.

ITPG-GT.2048.00007
ICM – Media
Posted on

Ripple Inside

Tell me your feeling, I hear, and I feel you.

Eden Chinn, Rui Shang

https://youtu.be/AsxloEstQ4U

Description

As humans, our existence is defined by different emotional states. When we feel an emotional impulse, it's like a ripple is dropped inside of us. This ripple flows outward and is reflected in how we perceive the world around us, as well as how we act within it.

For this project, we wanted to visualize emotional states using colors, shapes, and sounds in a poetic way.

The first thing we did is dividing all emotion words into 6 classifications: happy, content, sad, angry, shocked, afraid and then used p5.speech to recognize words instead of training words myself in the teachable machine because it’s far more accurate and for now this project can recognize over 110 emotion words.

We create a flowing 3d object and use sin() function to generate a beautiful ripple. More importantly, we generate multiple filters for one song in response to different emotions, and the amplitude of the song will affect the frequency of the ripple. For the visual part, we believe matching colors and custom shapes to different emotion words based on color and shape psychology could give people an immersive experience.

Tell me your feeling with one word.

I hear you, I feel you.

ITPG-GT.2048.00007
ICM – Media
Machine Learning,Music
Posted on

Musical gloves

Trying to interpret sign language in an artistic way

Jiayuan Li

https://vimeo.com/489352538

Description

Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.

projection version：https://vimeo.com/491080270

digital version：https://vimeo.com/489352538

ITPG-GT.2301.00004, ITPG-GT.2233.00007
Intro to Phys. Comp., ICM
Accessible
Posted on

Visual translator

The Relationshin between what is visual and what is Auditory.

Ahmed Mostafa

https://www.youtube.com/watch?v=b4IBhfVDbu0&feature=emb_logo

Description

The project will mainly be about giving the user the opportunity to manipulate the sound through a musical note based mainly on converting the values sent from the sensor to the three-color RGB while moving images and color prints and the output will be unexpected and prior to manipulation, besides the sound as a result we will use the same values to build visual areas moving And display it on the wall facing the user.

ITPG-GT.2301.00006, ITPG-GT.2048.00007
Intro to Phys. Comp., ICM – Media
Sound,Performance
Posted on

Cycle of the Universe

An interactive visual simulation of the universe from Big Bang to the heat death… then all over again and again.

Jack Chen

https://vimeo.com/487420451

Description

I took inspiration from “The Last Question” by Isaac Asimov – a short science fiction story published in 1956 about humanity’s inability to prevent the eventual heat death of the universe. I was blown away by the story’s ambitious setting along with its philosophical approach in exploring the limits of existence on a cosmic scale.

Inspired by Asimov's story, my project is an interactive simulation of a universe where the user can initiate the “Big Bang” of their own universe, then look around while modifying attributes of their universe before it reaches the end of its life span. The simulated microcosm of the universe provides an opportunity to consider our existence on a cosmic scale – a perspective not often conjured up when preoccupied with the routines of day to day living.

This project was created using P5.js with WebGL. It is best experienced in full screen with the sound turned on, as the music will react to the user input alongside the visual elements, formulating an immersive interactive experience.

ITPG-GT.2048.00007
ICM – Media
Narrative/Storytelling,Play/Games