Category: Machine Learning

Posted on

Deep Dream

Let Deep Dream bring you to the deep ocean, you sink in it slowly, like the water want to bring you somewhere.

Jingyuan Li

https://youtu.be/l8WtFeFsc1I

Description

Deep Dream is a creative coding project base on the ICM sound assignment I made with Sihan.
The code is mainly divided into two parts: sound and visual picture. The background sound is created by p5.Oscillator and the bubbles sound is controlled by the overlapped bouncing balls. As for the visual part, the wave reacts to the Oscillator's frequency. The stock of fish and bubbles are controlled by the teachable machine, which can identify bubbles sound.
NOTICE! It works better if you change your audio input from microphone to computer audio speaker.(Or you could make bubble sound with your mouse, see if it works.)
Code link: https://editor.p5js.org/Lea-0821/sketches/n_EVbM6Ty
Elements: p5.Js, Sound, Music Visualization, Teachable Machine
Reference:
https://www.openprocessing.org/sketch/891024
https://www.openprocessing.org/sketch/802077

ITPG-GT.2233.00003
ICM
Sound,Machine Learning
Posted on

Secret Forest

A Secret Forest for musical co-creation of nature inspired music by connecting user's minds and bodies on a shared performance.

Enrique García Alcalá, Yiru Lu

https://vimeo.com/488357609

Description

Secret Forest brings the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
Secret Forest is conceived as a way for exploring the web browser as a musical instrument, integrating different technologies, it allows real time connection for video which is analyzed with a pose detection machine learning model translating body position to sound.

IMALR-GT.201 , IMALR-GT.201
Connections Lab, Connections Lab
Sound,Machine Learning
Posted on

Star Machine

Catch a star and turn it into a star candy with the Star Machine✨

Sihan Zhang

https://youtu.be/6uFFp6LMZZA

Description

Experience the joy of catching a star with the Star Machine! When you stand in front of the Star Machine, the computer will track your right hand through webcam using the PoseNet machine learning model. If your hand position reaches a star on the projection, the star is “captured” and it will follow your hand. When you place the star inside the crystall ball of the Star Machine, the star will gradually disappear and a star candy will fall out.

ITPG-GT.2301.00005, ITPG-GT.2465.001
Intro to Phys. Comp., Machine Learning for the Web (Online)
Machine Learning,Play/Games