Category: Projects

Posted on

ITP Weather Band: Introduction

ITP Weather Band is an experimental band creating music, interactive objects, and visuals with weather data collected from a DIY weather station. Come meet the band and learn about our weather system.

Atchareeya Name Jattuporn, Lu Lyu, Cy Kim, Schuyler DeVos, Siyuan Zan, Sihan Zhang, Yiting Liu, Yeseul Song

https://youtube.com/playlist?list=PLivoY25uYfN_zJ3dkhvGiS7i4OoCJO5qt

Description

ITP Weather Band is an experimental band creating music, interactive objects, and visuals with weather data collected from a DIY weather station. We built a DIY weather station system and created experimental instruments that turn the environmental data into music and visuals. We explore new ways of delivering information and stories about our immediate environment through the auditory and visual sense. We’re growing into an open source project.

The band consists of faculties, alums, and graduate students at New York University’s Interactive Telecommunications Program (NYU ITP) and beyond. We started the weather station project in 2019 as a sub-group of ITPower and launched the band in January 2020.

See here for the details and full credits https://github.com/ITPNYU/weather-band.

We had a special collaborator, Yichan Wang (https://yichanwang.me/) pursuing her MFA in Design and Technology at Parsons School of Design, for the weather band website.

At the winter show 2020, we're introducing:

* ITP Weather Station System by ITP Weather Band
A DIY weather station system that posts data to the web to be accessed from anywhere in the world for creative projects.

* Weather Data Visualization Interfaces by Yiting Liu, Atchareeya Name Jattuporn, and Cy Kim
On this website, you get to see the visualization of all the data or select a specific part of data based on dates, id numbers, and categories.

* Weather Band Website by Yichan Wang (New School, visual system design) and Schuyler W DeVos (development).
A visual system and website with a graphical weather mobile that sensitively reacts to the real-time weather data.

* Weather Instruments made by the band members, including

Meteor Shower by Sihan Zhang
: A p5 sketch that generates a meteor shower scene and relaxing music using wind and rain data

Gust Sound by Lu Lyu (shown at a separate spot on Yorb)
https://itp.nyu.edu/shows/winter2020/2-5-miracle-and-gust-sound/

Leaf Dance by Siyuan Zan (shown at a separate spot on Yorb)
https://itp.nyu.edu/shows/winter2020/leaf-dance/

ITPG-GT.2808.001, ITPG-GT.2301.00004, ITPG-GT.99999.001
Understanding Networks, Intro to Phys. Comp., ITP Weather Band
Sound,Sustainability
Posted on

Pixel Topographies

Pixel Topographies uses machine learning to generate elevation maps based on Connecticut topography, then creates a tangible 3D representation of that data.

Philip Cadoux

https://vimeo.com/488813688

Description

My family sold the house I grew up in this year, which was very sudden, but for the best. I had never really been that connected to my home state, but when I discovered I may never go back there, I realized that I had come to really appreciate it as a place to grow up. We ended up renting a house not too far from where I grew up to get through the pandemic, but it made me think about what it was that caused me to become so nostalgic. What kept popping into my head was that it is a beautiful place. It has lovely forests, beautiful colors, coastal towns, and even a few mountains. Then, I stumbled across a site which shows the elevation in CT using colors.

This inspired me, I created an ElevationGAN and used Runway's hostel model feature to grab the images generated. I then used p5.js to process down the images into a pixel grid. From there, I used serial communication to send the elevation data to an Arduino, which actuated pixels in and out to reflect these values. This is a proof of concept piece that could be scaled up to create 1:1 representations of elevation maps – ultimately creating wooden topographies. I have plans to elaborate on this ML model and try new things. 

ITPG-GT.2301.00002, ITPG-GT.2465.001
Intro to Phys. Comp., Machine Learning for the Web (Online)
Art,Machine Learning
Posted on

Channeling to self

“Channeling to self” is the reinterpretation of Rothko, we focused on “light” and “emotions” as a meditation installation.

Bei Hu, Minjun Kim

https://youtu.be/QO6_gEb_1EA

Description

Our idea is to generate a meditative form of Mark Rothko-like paintings that reflects viewers’ inner state with two controllable nobs that are connected to the led painting.

ITPG-GT.2301.00006
Intro to Phys. Comp.
Art,Product Design
Posted on

Equilibrium

Find the inner peace and present it physically by sound and light

Jezzy Zheng Lu

https://vimeo.com/491142330

Description

Equilibrium is a light and sound sculpture, using glass beads as the main medium to change light and sound through human breathing. Equilibrium is an experience and a self introspective journey. It invites the audience to take some time to get back in touch with themselves.

The interaction is as follow: First the FSR that is under the rug senses when a person sits down and keeps still, the time of flight sensor starts to detect the person’s breathing frequency by detecting the person’s chest fluctuations. The time of flight sensor picks up different distances within a given threshold between insufflation and inspiration, and this frequency is mapped into the range of LED and vibration motor, to change the brightness and vibration frequency. Different amplitude values cause the glass bead to change position, thereby changing the light path and creating sound through friction. Simultaneously, the servo continues to perform regular movements of up and down, allowing the glass beads to fall from a high place to a low place; repeating this process continuously, it produces a sound similar to wind/rain in nature. This white noise quality of the sound helps audiences gradually gain inner peace. On one hand, Equilibrium attempts to visualize the subtle change of human consciousness, giving it physical properties, from intangible to tangible. On the contrary, the attributes of light and sound are relatively abstract comparing to concrete objects.

Equilibrium's entire device is also pursuing a balance, whether it is the teeter-totter structure that keeps repetitive motion or the continuous and stable state of brightness and amplitude with the steady flow of human breathing.

ITPG-GT.2301.00008
Intro to Phys. Comp.
Sound,Art
Posted on

abracadabra

Magicians! Create your own magic circle now!

Hanlin Liu, Jane Meng

https://youtu.be/ssSIcM7tqTk

Description

Have you ever dreamed of becoming a magician and having the power to make some magic stuff? Both Alina and I love all magical things. Getting inspiration from Card Captor Sakura, we planned to build a magic circle generator. The basic interaction of this generator is that users input their birthday and the generator will create a unique magic circle for him or her. Every magic circle is formed by four parts: a rotating 3D magic stone, a unique pattern, a special song and a sentence of the day. Hope you can enjoy this sparkling and glowing visual effect.

ITPG-GT.2048.00007
ICM – Media
Posted on

Prosthetic Biomagnetic

Enhance your perception dimension, no need to wait until 2077

Jingxi Guo

https://youtu.be/jFEUR7Vr76o

Description

I have always been interested in how the human body reacts to magnetic fields. I made an assumption about the biomagnetic field of the human body serval years ago. I thought that modern human's body (includes the brain) had the ability to sense the magnetic field from the earth as the other animal does. We had that ability when we were an infant. But nobody told us that there is a feeling of the magnetic field is the feeling of the magnetic field. As we grow, we lost the ability to recognize the ability, because without correct guidance.

This device is a wearable device. It detects the direction of the magnetic field through a magnetometer, and at the same time converts the direction of the magnetic field into vibration, which is transmitted to the user through the skin, allowing the user to distinguish the direction of the magnetic field through the vibration signal.

In terms of technology, I used Seeduino XIAO, a smaller Arduino board, and BNO-055 as my sensor. The current version uses an ordinary vibration motor. Before the start of the winter show, I might replace the motherboard on the back with a PCB board so that it will become smaller. Attach part uses flexible 3D printing materials.

ITPG-GT.2301.00008
Intro to Phys. Comp.
Wearables
Posted on

Mulan

Did Mulan even confused about who she really is? Is she a daughter, a wife of someone, or a warrior, a soldier of herself.

Hanlin Liu, Jiayuan Li,

https://vimeo.com/470811330

Description

Because of Mulan‘s bravery and her great achievements in the war, she won the emperor‘s highest award. She has two choices now, one is to return to the life of a normal girl, to marry someone, to become a wife, a mother. The other is to be a female general. She is hesitating between these two choices, so she dives into her unconsciousness and listens to the truest voice in her heart.

In this story, Mulan will see her own life story from a third person's view. From when she decided to take her father's place in the conscription army, to her came back from the war and got the emperor's highest honor. By going through these memories, Mulan realized she had already made the decision deep in her heart.

This is a loop journey. Every time Mulan successfully collects all memories clips from one room, she will be sent back to the start room. After complete her journey in all three rooms, Mulan then goes through the fourth door to go back to the real world.

ITPG-GT.2001.00001
CL – Video and Sound
Narrative/Storytelling
Posted on

Entering the Deep

Entering the deep via a curated web experience. Taking on a journey through seeing deep creatures with an immersive spotlight feature. A easy fun multiplayer game of cleaning up the ocean is awaiting!

Po-Wen Shih

https://vimeo.com/488989136

Description

The deep is a mysterious and colorful place. A place of cold and hot, dark and high pressure. What is it like to be in the deep sea and… is it possible to get there? I asked myself. In fact, more people have traveled into space than have traveled to the deep ocean realm…

This immersive exploration and multiplayer game combines my research in Critical Experience Studios and web development tools learnt from Connections Lab in fall term 2020.

I wish to share my observations with you to the deep sea ecosystem. Please join me in entering the deep and see an imaginative and curated experience.

IMALR-GT.202, IMALR-GT.201 , IMALR-GT.201 , IMALR-GT.202
Critical Experiences, Connections Lab, Connections Lab, Critical Experiences
Posted on

AM, PM

AM, PM is a light and sound installation which creates a safe space for people who suffer from timezone differences under pandemic to connect, heal and reconstruct, by delivering an intimate story of two lovers in a public intermediary.

Echo Xuan Tang, Esther Xinxin Zhang

https://youtu.be/_Tc_LMa4sHI

Description

12, is how New York and Shanghai share their time difference, a motif we experience and accommodate everyday as a Go Local student under pandemic. This mulled into AM, PM.

In AM, PM, audiences are able to enter, stay, sit, lie down and meditate in a cozy living room space and to interact with breathing lights to fill up space with an audio story. The dual-track audio clip mumbles white noises from daily routines, with the breathing lights giving out clues of time-shifting and differences.

We expect that amid speculating the storyline, of two lovers separated in different timezones, intertwined feelings of bittersweet, and twisted comfort can be revealed to our audience. We made a bold try to push the boundary of exposing private emotions, feelings, and trivial life bits to relatively public space but not too much compromise comforts of participants. We expect our audiences are not only observers outside but participants in this private world and feel empathetic to some extent.

We sincerely invite you into this couple's world and imprint your trace, as “this is not defeating an impossible nor pushing limits, but assuring capabilities within us and being able to continue.”

Time lags, but love doesn't.

ITPG-GT.2301.00001, ITPG-GT.2301.00004
Intro to Phys. Comp., Intro to Phys. Comp.
Sound,Narrative/Storytelling
Posted on

" "

Hurt was always accumulated little by little until it became permanently incurable.

Yiran Wang

https://www.youtube.com/watch?v=UUjiu_47WGk&t=3s

Description

The project title “ ” is blank, meaning something was existed but hidden and missing at some point in time. In this piece, I recall my memory and choose an object—classroom locker—which is traumatic for me when I was in senior school.I created a black box which has the similar shape with classroom locker and put paper and stepper motor inside. I try to concern about the mental state and emotion when people experienced repressive and despairing moments, expressing the feelings that the hurt was always accumulated little by little until it became permanently incurable. Paper is fragile, floundering and easy to be distorted and broken, as well as human beings.

ITPG-GT.2301.00004
Intro to Phys. Comp.
Art