Category: Projects

Posted on

Microhabitat

A microhabitat is a virtual open-door to a tiny habitat that can be seen only through a microscope.

Jung Huh

https://vimeo.com/488923446

Description

A microhabitat is a virtual open-door to a tiny habitat that can be seen only through a microscope. It welcomes audiences to a tiny room of a person living in NYC. The tour is not as big and fancy as you see in many of YouTube's’ open doors. Comparing the size of the room to that of other open door videos, it may feel like looking into microscope slides where details are only visible via a microscope.

The work brings the housing problem the 20s and 30s are facing. Finding a habitat has become more difficult. The more you get close to the central part, such as NYC or Seoul, the more expensive rents get making it tougher to find a place, and the smaller the room becomes. However, no matter how small the room may be, there lives a person with their own unique story and a big dream.

The audience peeks into the small room of a person through a microscope that has two controllers. Using the knob on the right side, a stage controller, the audience can look around the room as it rotates the camera situated at the center of the microhabitat. Using the knob on the left side, coarse adjustment, the user can look into the details on specific objects located in the room. Each object contains a personal story of the person living there as if you see the product details of objects that YouTube has in one's open-door video.

Virtual Experience
https://editor.p5js.org/jhuh3226/present/ErsWzJ5mn

ITPG-GT.2301.00008, ITPG-GT.2048.00003
Intro to Phys. Comp., ICM – Media
Narrative/Storytelling,Social Good/Activism
Posted on

The Bar

The Bar is a multiplayer VR application that allows users to date and send hints to other players in Virtual Reality.

Wen Chen, Stacy Yuan

https://www.youtube.com/watch?v=nXi6GcZNWH0

Description

Can we be more than friends in VR? The practice of dating changes by time and the evolution of mediums, VR, as a new platform and medium, still leaves room for exploring. In this application, we would like to discover how can people share their intimacy and affection with other players through gestures and interactions. The venue includes a bar and a dance room, and each character is equipped with some basic social features, such as “buy a drink”, “flirt”, “activate social bubble”. Through this project, we would like to expand the horizon of digital intimacy and the application of social Virtual Reality.

ITPG-GT.2461.001
Desert of the Real: Deep Dive into Social VR (Online)
VR\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\AR
Posted on

You can't touch my balloon

Preserve your balloons digitally

Michael Zhou

https://youtu.be/gxtMdJnkkNw

Description

After coming to the states, I was shocked and excited when I learned there are stores that sell and only sell balloons. For someone who will stop crying if he could get a double-layered balloon outside the hospital before seeing the doctor, that's like the best place in the world. Maybe after the shops only sell candies. Of course, when I still was a child, I don't cry before seeing a doctor now. I enjoyed the satisfaction of blowing a tiny rubber into a large ball. It felt great when you consider blowing a balloon as capturing air, the thing we cannot touch or see. However, a balloon pops and deflates. And you can't get all the colors you want; even you own a balloon shop. So I wanted to create a device that can provide the same physical sensation of blowing a balloon while providing countless colors and preserving each balloon made.

The physical device contains a pressure sensor and several RGB LEDs while connecting to a p5 sketch on the laptop. The size of the digital balloon reacts to the physical one in real-time. The user can press the button on the top to pick a color and then blow up the balloon through the device. To push the button again, users can release the digital balloon they just created.

Since each balloon is unique in size and color, the user who created the balloon will feel the balloon belongs to them; even it is only a digital one. They will be satisfied to see their balloon safely floating in the virtual space. Hence to the title, You can't touch my balloon.

ITPG-GT.2301.00007
Intro to Phys. Comp.
Play/Games
Posted on

Leaf Dance

The shadows of plants are dancing in the wind.

Siyuan Zan

https://youtu.be/SnFboZt_c9E

Description

I inspired by the reflection of plants reflected on the curtains on a bright afternoon. They are swaying with the wind according to the wind speed which seem to be swaying with the melody. The color of the reflection will change according to the plant itself and the light.So for this light installation,I try to use weather data to create a light and shadow experience that the shadows of plants are dancing in the wind.
I will use the real-time wind data in the weather station to drive the gear motor to control the speed and direction of the motor. At the same time, I use led rings as the light source, and simulate the visual effect of the swaying and dancing of the plants through the rotation and distortion of the special shape of the diffusive material.

ITPG-GT.99999.001
ITP Weather Band
Art
Posted on

Weather Journals

Weather Journals uses data visualization and machine learning to put people in touch with their surroundings and with each other.

Schuyler DeVos

https://youtu.be/gm49Qnp8RBg

Description

Weather Journals is an attempt to put people in touch with their surroundings and with each other. The whole thing is powered by OpenAI's GPT2 algorithm, which is a machine learning algorithm that generates human-like text.

First, submit a reflection of the weather where you are in the box on the top left. This can be whatever you want: what do the clouds look like? How does the weather make you feel? Does it remind you of another time?

After you've put in your reflection, adjust the length and the creativity of the text you'd like the weather to write you in return. Then hit the button and wait.

At the end of the day, everything that everyone has written for that day is used to train the machine learning model. What that means is that every day into the future, the model reflects all the reflections of all the days before it, growing and evolving with the weather.

Art,Machine Learning
Posted on

Handy

Handy is a wearable interface interpreting tangible interaction to intangible experiences.

Peiling Jiang

https://vimeo.com/379383886/52f9b9d41f

Description

Handy is a wearable interface interpreting tangible interaction to intangible experiences, using EMG signal and machine learning. Unlike current popular hand-tracking interfaces, including those based on LiDAR and infrared camera, that we need to consciously pose our body for, on-body sensing based on EMG signals allows more intuitive and relaxed interactivity.

IMNY-UT.224.001
Introduction to Machine Learning for the Arts (Online) (UG)
Wearables
Posted on

Mindful Breathing

The competitive meditation game that yells at you if you are not being mindful enough.

Michael Morran

https://vimeo.com/489113320

Description

Inspired by a tendency to take meditation way too seriously, Mindful Breathing challenges users to accumulate breaths, add upgrades, and wager their progress on the journey to transcendence. Using ml5 and PoseNet, participants' bodies are tracked in order to log breaths and transform what is, at first, a simple interface into a claustrophobic cacophony of 'mindfulness enhancers.' After a certain amount of progress, players are able to measure their success against the self-actualization of others and bet their breaths for the chance to surpass the competition.

This project is inspired by Universal Paperclips by Frank Lantz. Big thanks to Mathura, Craig, Ellen, Lisa Jamhoury, Lisa Sokolov, and all my classmates for their help!

IMALR-GT.201 , IMALR-GT.201
Connections Lab, Connections Lab
Machine Learning,Play/Games
Posted on

3D_land

A 3D video chat experience to interact and explore virtual spaces with others.

Jake Sherwood

https://www.youtube.com/watch?v=o45ApWF5CpE&feature=youtu.be

Description

Much of our post Covid19 life is now spent online in video conference settings.

How can we make those experiences more exciting and engaging?

3D_land is an exploration of webrtc, peer2peer, and threejs technologies and how they can be used to create a more exciting video chat experience.

Can this template be used for more engaging remote learning?

Can it be used for video conferencing?

Or is it just a place to explore with friends?

3D_land sets you in the world of a 3D space island. Participants can explore the world on their own or converse and explore with each other.

They can change their appearance by applying various video filters.

Proximity to other participants allow for improved audio and allow participants to “tattoo” or give gif gifts to other nearby participates.

Full experience here:

https://jps772.itp.io/

ITPG-GT.2734.00001
Live Web (Online)
Art,Play/Games
Posted on

PComp Mountain

Theme parks, especially rollercoasters are incredibly inaccessible during the pandemic, so I built a model coaster complete with effects to simulate the excitement of going on a rollercoaster.

Zachary Kampf

https://www.youtube.com/watch?v=df2GxTO9iXE&feature=emb_logo

Description

Using K'nex (a children's construction toy) I built a fully working model rollercoaster. In addition to the coaster, I set up the track with lights and sound/animation triggers to bring home the fun and excitement of riding a rollercoaster while theme parks are largely inaccessible during the pandemic.

ITPG-GT.2301.00002
Intro to Phys. Comp.
Play/Games
Posted on

Fluidity

We are geographically scattered in different time zones, but we share the same sun.

Esther Xinxin Zhang

https://youtu.be/Q23ll5Rs1nM

Description

This is a soothing and warm place for people to visualize sunrise and sunset time of different locations. The dynamic gradient colors and lights aesthetically simulate the flow from sunrise to sunset.

ITPG-GT.2734.00001
Live Web (Online)
Art,Tool\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\Service