Category: Projects

Posted on

Alive & Well @ the Chelsea Hotel

This project seeks to collapse configurations of time to access the spatial memory and rich cultural legacy of NYC's historic Chelsea Hotel in a networked virtual afterlife.

Douglas Goldstein

https://vimeo.com/488819756

Description

Check into the Hotel Chelsea for a social VR experience that expands the legacy of NYC's historic landmark into a virtual venue & maker-space, where users are invited to take up residence in its haunted rooms to explore its storied past and craft legends anew within its hallowed halls.

This project will animate the poetry, art, and music scarred into the Chelsea's walls and renew the bohemian dream of a space that cultivates and nurtures creativity, birthing a new virtual afterlife for the physical space that has been silenced by the city's merchant greed.

My approach will pick up the torch from the Chelsea Hotel community in Second Life's digital twin of the building, both architecturally and ideologically, where its authentic spirit still glows with occasional events and exhibitions. Upon that framework, the VR Chelsea will enable creative practices in visual and performing arts, and deepen dimensions of presence for remote users. This platform can also be used to explore solo standalone storytelling experiences that dive into the lives, times, and secrets with immersive embodied narratives that tap into spatial memory.

ITPG-GT.2461.001
Desert of the Real: Deep Dive into Social VR (Online)
VR\\\\AR,Culture
Posted on

Ripple Inside

Tell me your feeling, I hear, and I feel you.

Eden Chinn, Rui Shang

https://youtu.be/AsxloEstQ4U

Description

As humans, our existence is defined by different emotional states. When we feel an emotional impulse, it's like a ripple is dropped inside of us. This ripple flows outward and is reflected in how we perceive the world around us, as well as how we act within it.

For this project, we wanted to visualize emotional states using colors, shapes, and sounds in a poetic way.

The first thing we did is dividing all emotion words into 6 classifications: happy, content, sad, angry, shocked, afraid and then used p5.speech to recognize words instead of training words myself in the teachable machine because it’s far more accurate and for now this project can recognize over 110 emotion words.

We create a flowing 3d object and use sin() function to generate a beautiful ripple. More importantly, we generate multiple filters for one song in response to different emotions, and the amplitude of the song will affect the frequency of the ripple. For the visual part, we believe matching colors and custom shapes to different emotion words based on color and shape psychology could give people an immersive experience.

Tell me your feeling with one word.

I hear you, I feel you.

ITPG-GT.2048.00007
ICM – Media
Machine Learning,Music
Posted on

Moving On :||

A real-time solo performance that builds on top of itself.

Marcel Truxillo

https://drive.google.com/file/d/1-vZOIY_taekskRdQ9o-Ilb3LoZ43eRRR/view?usp=sharing

Description

ZOOM PASSWORD : ITP

Every 10 minutes the performance resets, using the audio and motion capture data of the renditions before, the live actor responds to the ghosts of eir past experience. Building on top of itself until becoming a cacophonic crowd. The actor cannot escape eir past as it continues to present itself, ey can only respond.. and respond to the response. If ey cannot change what has and is happening, can ey still find resolve? Does the moment of resolve then become another reflection? A study of presence.

ITPG-GT.2032.001
Performing Reality
VR\\\\AR,Performance
Posted on

Accessible maze game

The accessible maze game: test your hearing senses and increase your awareness of visual impairment in a playful format.

Kseniia Balaenkova

https://youtu.be/Nqdl1HFtyFw

Description

Me and another ITP student Wendy Wang created a maze that was made with visually impaired people in mind. The player can be guided through the maze only by sounds. For people, whose vision is not affected, the game offers an opportunity to understand how difficult it can be to rely just on hearing sense. At first, it is challenging and confusing to navigate through maze but once you get used to it, it becomes a fun and interesting challenge. The maze is generated randomly every time, and its complexity can be easily changed in the code. The player’s movement is controlled with the arrow keys on the keyboard. Sounds are played in a list format and the player can't move until the sounds are finished playing. All the sounds are easily distinguishable, and left and right sounds were made stereo so that they can be played in a left ear or right ear respectively. To understand the game easier, the greetings and instructions are played when the person first loads the game and can be listened again at any point by pressing Shift key.

ITPG-GT.2301.00004, ITPG-GT.2048.00004
Intro to Phys. Comp., ICM – Media
Play/Games,Accessible
Posted on

Blooming

Blooming is an interactive art installation of a serial about seeing and appraising all kinds of life styles. The whole process is accomplished through showing unique plant for each participant and bringing relaxing experience for the participant and viewers.

Jingyuan Li, Junzhu Zhang, Yilin Zou

https://youtu.be/SBKOA41n7aM

Description

What kind of lifestyles or habits are defined as “perfect”? Are we hiding our lifestyles out of the fear to be isolated by others?

In this project, we are recognizing and presenting the lifestyles of different individuals to reduce misunderstanding. To visualize lifestyles, we use flowers and plants which will change according to the movement and characteristics of different individuals, and map the pattern behind the furniture which represents one specific lifestyle.

ITPG-GT.2301.00004
Intro to Phys. Comp.
Performance,Art
Posted on

Digital Christmas

Merry Christmas!

Zhiyue Huang

https://youtu.be/aX0LaNqhTPM

Description

This is an interactive season's greeting card. Please enable your web camera, and move around your hands or your head to complete the card! The hints of the tasks are listed on the right. If you're still confused about how to interact, please check the video documentation =P And… Merry Christmas!!

ITPG-GT.2233.00001
ICM
Play/Games
Posted on

Smart Knitting Needles

When crafts meet technology

Liraz Primo

https://youtu.be/rqeLSeH5xfQ

Description

When the pandemic have started no one imagine that we will have to switch to an online studying system. The limitation of learning through a screen stand even more when you learning physical techniques. As a former student of Textile and an instructor of knitting it was clear to me that we need to think of a system that will integrate the craft with technology.

This project evolves with the connection between three dimensional fabric and the two dimensional form to read it. The needles can sense the fabric you create while you do it and see the technical drawing of it on the computer screen.

In these difficult times and as for the visual people we are, this could be an excellent way to develop our learning methods and for student and instructors to communicate in a better way.

ITPG-GT.2301.00002
Intro to Phys. Comp.
Education,Product Design
Posted on

Blur Clock

A clock which gets blurry when you are not looking at it representing the existence of time being due to humanity's blurred perspective of reality

Aidan Fowler, Youngmin Choi

https://vimeo.com/489005572

Description

This clock is inspired by The Order Of Time by Carlo Rovelli, who theorizes that time as we usually imagine it only exists because of a “blurred macroscopic perspective of the world that we encounter as human beings [and that] the distinction between past and future is tied to this blurring and would disappear if we were able to see the microscopic molecular activity of the world.” Along with the thought that humans create time itself, we are tying in quantum mechanics and the idea that nothing exists in a determinate state until an interaction occurs or a measurement is taken. In our clock, the time is indeterminate and blurred until we measure (by looking at the clock) which causes an exact time to be visible.

ITPG-GT.2040.001
Time
Art,Machine Learning
Posted on

I want to see the world

An interactive experience tells how we see the world via biological processes.

Tiange Hou

https://vimeo.com/488284023

Description

We have different sensory systems obtaining the perception. But do you know what happened inside our bodies, leading us to perceive the world? When the light goes into our eyes, how do we get the vision from it?

“I want to see the world” is an interactive experience during which users help the person(with eyes, hand, and brain) to see. This project is an overview of how we see the world via the biological processes. When light enters the eyes in the darkness, a critical cell signaling pathway, called phototransduction, starts in cells in our eyes. The sodium channel is closed so Na+ could not enter the cell. Then, everything else helps us to see could occur. Information is sent from the eyes to the brain via nerves and more visual information processing happens in the brain, indicated by LED lights and drawings. The computational drawings simulate a biological technique, fluorescence imaging.

Hands are responsible for all the interactions. Users do some hand gestures to the “hand,” implying that when we cannot see, other sensory systems, such as touch, help us. First, users wave to the “hand” to let this person know that users are around. Second, users move their hands up and down to the “hand” to let the person know that they wish to help. Third, users follow the instructions shining the light on the “eyes.” And last, users wave the hand again to let the eyes see the final image.

ITPG-GT.2233.00003, ITPG-GT.2301.00007
ICM, Intro to Phys. Comp.
Education,Art
Posted on

Lo-Fi Player

☕️ Lo-Fi Player is a virtual room in your browser that lets you play with the chilling VIBE!

Vibert Thio

https://www.youtube.com/watch?v=lyCfSQzWg-o

Description

“Lo-Fi Player” is a virtual room in your browser that lets you play with the BEAT! Try tinkering around with the objects in the room to change the music in real-time. For example, the view outside the window relates to the background sound in the track, and you can change both the visual and the music by clicking on the window.

Check out the blog: https://magenta.tensorflow.org/lofi-player

ITPG-GT.2068.001, IMNY-UT.228.002
Hand Held: Creative Tools for Phones, Front-End Web (Online)
Music