Posted on

During Quarantine

Interactive light installations about our quarantine time.

Hanlin Liu, Jiahui Zhu

https://vimeo.com/489248750

Description

This year was so special. Standing at the end of 2020 and looking back, COVID was THE topic that no one could ignore. Study remotely and being alone changed the experience of studying in ITP. However, this special experience triggered my inspiration for making something of this topic. Two projects were made with the idea of During Quarantine. One is called New York Sunrise. I made a Sun of the real-time in New York. Due to the time difference, a lot of classes were given at midnight in Beijing. So I was thinking about making another Sun for myself. The other is the Life Cell. It is an interactive light installation that has several light 'cells'. Each cell will light up when audiences get closer to it and reveal a person's life in the cell. When the light inside is off, the audience can see nothing but a blank light shade. We want to use the interaction, getting closer, to express how people long to be connected with others during the quarantine.

ITPG-GT.2301.00001, ITPG-GT.2040.001
Intro to Phys. Comp., Time
Art,Product Design
Posted on

Musical gloves

Trying to interpret sign language in an artistic way

Jiayuan Li

https://vimeo.com/489352538

Description

Sign language is a different way of communication and it is a special language. This way of communication is silent. When I see people using sign language, I feel sign language is very mysterious, and it is very beautiful.In this project, I am trying to interpret sign language in an artistic way. I used sign language to create music and visuals so that I can provide musical performance for the audience. This project aims to combine touch, visual, and auditory to create a multi-dimensional sensation for users when they use sign language.

projection version：https://vimeo.com/491080270

digital version：https://vimeo.com/489352538

ITPG-GT.2301.00004, ITPG-GT.2233.00007
Intro to Phys. Comp., ICM
Accessible
Posted on

Deep Dream

Let Deep Dream bring you to the deep ocean, you sink in it slowly, like the water want to bring you somewhere.

Jingyuan Li

https://youtu.be/l8WtFeFsc1I

Description

Deep Dream is a creative coding project base on the ICM sound assignment I made with Sihan.
The code is mainly divided into two parts: sound and visual picture. The background sound is created by p5.Oscillator and the bubbles sound is controlled by the overlapped bouncing balls. As for the visual part, the wave reacts to the Oscillator's frequency. The stock of fish and bubbles are controlled by the teachable machine, which can identify bubbles sound.
NOTICE! It works better if you change your audio input from microphone to computer audio speaker.(Or you could make bubble sound with your mouse, see if it works.)
Code link: https://editor.p5js.org/Lea-0821/sketches/n_EVbM6Ty
Elements: p5.Js, Sound, Music Visualization, Teachable Machine
Reference:
https://www.openprocessing.org/sketch/891024
https://www.openprocessing.org/sketch/802077

ITPG-GT.2233.00003
ICM
Sound,Machine Learning
Posted on

A Journey to the past: Poisonous gas Pandexperience
 2088-2107

In the year of 2107, we're looking back in the past and trying to understand what brought us here living in isolation to each other.

Daniel Otero Sendas, Jingyuan Li, Zhiyue Huang

https://www.youtube.com/watch?v=eTJdHMo22yg&feature=youtu.be

Description

This project retells the story of Icarus and Dadaelous in a sci-fi fashion. The story and the main characters are brought to a parallel world, which has a metaphorical connection with the 2020 pendemic event.

In this project, we also present a fictional museum which contains scattered pieces of clues about Icarus and Dadaelous. The audience are museum visitors in the future who try to excavate the truth from the exhibits.

ITPG-GT.2076.001, ITPG-GT.2076.001
Out of Order: Storytelling + Technology (Online), Out of Order: Storytelling + Technology (Online)
Narrative/Storytelling
Posted on

Secret Forest

A Secret Forest for musical co-creation of nature inspired music by connecting user's minds and bodies on a shared performance.

Enrique García Alcalá, Yiru Lu

https://vimeo.com/488357609

Description

Secret Forest brings the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
Secret Forest is conceived as a way for exploring the web browser as a musical instrument, integrating different technologies, it allows real time connection for video which is analyzed with a pose detection machine learning model translating body position to sound.

IMALR-GT.201 , IMALR-GT.201
Connections Lab, Connections Lab
Sound,Machine Learning
Posted on

Visual translator

The Relationshin between what is visual and what is Auditory.

Ahmed Mostafa

https://www.youtube.com/watch?v=b4IBhfVDbu0&feature=emb_logo

Description

The project will mainly be about giving the user the opportunity to manipulate the sound through a musical note based mainly on converting the values sent from the sensor to the three-color RGB while moving images and color prints and the output will be unexpected and prior to manipulation, besides the sound as a result we will use the same values to build visual areas moving And display it on the wall facing the user.

ITPG-GT.2301.00006, ITPG-GT.2048.00007
Intro to Phys. Comp., ICM – Media
Sound,Performance
Posted on

Star Machine

Catch a star and turn it into a star candy with the Star Machine✨

Sihan Zhang

https://youtu.be/6uFFp6LMZZA

Description

Experience the joy of catching a star with the Star Machine! When you stand in front of the Star Machine, the computer will track your right hand through webcam using the PoseNet machine learning model. If your hand position reaches a star on the projection, the star is “captured” and it will follow your hand. When you place the star inside the crystall ball of the Star Machine, the star will gradually disappear and a star candy will fall out.

ITPG-GT.2301.00005, ITPG-GT.2465.001
Intro to Phys. Comp., Machine Learning for the Web (Online)
Machine Learning,Play/Games
Posted on

Interactive Comic – Sunlight Taxing

A comic about a high-tech world where people are charged for enjoying the sunlight.

Clover Zhou

https://vimeo.com/488015371

Description

Summary: In a high-tech world, floating AR equipment and light rail cover the entire sky, blocking all the sunlight in residential areas. Citizens start to be charged for going to “Sunshine City” to enjoy the sunlight.

Directions: feel free to click on the page to interact with the contents. Image and animation work together to illustrate the life of the protagonist and the world view.

Core Idea: Although people's life becomes seemingly more convenient under high technology, they have a very low quality of living as a natural human. For example, if citizens suddenly see the sunlight, they would come up with the opinion that “I need to get away from this place since sunlight is expensive.” People also need to lines up to make an appointment and pay a lot to get sunlight.

ITPG-GT.2072.001
Experiential Comics: Interactive Comic Books for the Fourth Industrial Revolution (Online)
Narrative/Storytelling
Posted on

The Honeycomb

A kinetic stage dance performance

Adam Krebs

https://www.dropbox.com/s/qbnjufynrjsvo07/out.mp4?dl=0

Description

A concept for a dance performance stage in 3 parts – miniature, digital, and full-sized. The Honeycomb is a stage made up of 37 individual hexagons on risers, laid out in a spiral pattern similar to a beehive. The set is capable breaking up an image in large form using individual riser platforms and then creating finer-grained details in the projection mapping. For example, we could have an ocean of waves, a throne for a king, an Escherian staircase, or a craggy mountain. The mocapped dancers complete the piece, telling a story of hierarchy and time set in a backdrop of ecology and movement.

I also physicalized the stage in miniature to showcase the projection mapping, and enlisted the help of Ben Moll to build a full sized hexagon platform.

ITPG-GT.2890.001
Designing for Digital Fabrication
Art,Tool\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\Service
Posted on

2.5% miracle and gust sound

A project that you can see a whale at a rate of 2.5% by combining natural force and human force gently.

Another project is making the sound using the gust data from ITP New York weather station.

Lu Lyu

https://www.youtube.com/watch?v=3ikAnjM0UHw&t=31s

Description

This is a wind sculpture with moire effect. I design a moire effect that when 2 pieces are at the right angle, a whale tail shape would appear in its moire effect. I made one side of the sculpture driven by wind and another side driven by human beings. People could only see the whale moire effect at a rate of 2.5%. The miracle of life is even in a smaller percentage. People would try to rotate the sculpture to chase after the whale tail shape. But when people are too close to the sculpture, they would not see the whale clearly. The whale could only be seen at a distance when wind and gravity are fine. I want to use this sculpture to show the rareness of the appearance of a living creature.

The gust sound installation is creating an ambient and long sound that is using the gust data. It is part of the projects for ITP weather band club. It starts when I stepped onto an old pavilion in the yard, the pavilion would shake all the materials. There are 2 metal pieces I put as waste material and suddenly I discover the sound is actually very intriguing. So I start to make a weather instrument with it.https://www.youtube.com/watch?v=nqevrx9pFSo

ITPG-GT.2890.001, ITPG-GT.99999.001
Designing for Digital Fabrication, ITP Weather Band
Art