https://youtu.be/DWl0pBt_lhw

Description

The user wears a belt with a stretch sensor attached, measuring the user’s breath. As the stretch sensor moves with the expansion of the chest, its data is recorded and utilized to manipulate remote and physical objects. There are two variations on this output for our project:

REMOTE/SERVER COMMUNICATION: Different people can wear breath sensors in different locations. Together, their breathing patterns create an output on p5. In our p5 sketch, the breathing is signified by a feather animation moving up and down. Both users' breathing patterns create this change collaboratively.

PHYSICAL INSTALLATION: The stretch sensor allows breath to become a controller that manipulates physical phenomena. An installation of yarn pompoms is suspended from a frame and moves in reaction to the wearer’s inhalation and exhalation.

Zoom link:
https://nyu.zoom.us/j/99001077668

p5 link:
https://editor.p5js.org/mnk2970/sketches/ylgyvcaia

ITPG-GT.2301.00008

Intro to Phys. Comp.

Art,Wearables

https://youtu.be/B_wdEPwhsrQ

Description

In my project, I've decided to create a Mixed Reality (XR) experience for my audience by combining Augmented Reality (AR) and Virtual Reality (VR) together. As a traveler, I would like to experience different environments before I have physically been to a place. Thus, one of the intended goals of my project is to provide a convenient way for people to get a sense of different types of outdoor environments from the comfort of their own home. The outdoor environments featured in my project include both nature (such as the ocean) and urban (such as the park) sights. To achieve my intended goal, I've proposed an installation for a pair of smart-glasses that will hopefully exist one day in the future. The idea (or concept) behind my installation proposal is that people will be able to view everyday objects at home from a completely brand-new perspective by simply wearing the futuristic smart-glasses. The featured outdoor environments in this project are displayed in multiple virtual 3D spheres. These spheres are created by using 360° panoramas images taken at different places around the world. Each of them is attached to its related real-life object. When the audience walks into one of the virtual spheres, they will get a super immersive experience while being surrounded by the whole (360°) space. To put it in another perspective, they will be able to look around the space in all directions inside the virtual sphere. This immersive experience will not only come from the visual aspect but the audio aspect as well. In other words, people will also hear different types of sounds as they enter any of the spheres. For instance, when they walk into a sphere of Ocean, they will be hearing the sound of waves splashing in addition to being surrounded by virtual nature.

IMNY-UT.102.00003

Comm Lab: Hypercinema

VR\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\AR,Wearables

https://youtu.be/xytzRsYMmDE

Description

My project is iWind.

You can use the rotation of your head to drive the Arduino to control the character’s flying in a simulated real world, like wind passing over forests and lakes.And you can also try to swim in the universe.

Arduino is installed on an action camera accessories/helmet and connected to Unreal Engine.

(iWind is designed and made by Michelle Xu and Wei Wu)

ITPG-GT.2301.00007, ITPG-GT.2079.00001

Intro to Phys. Comp., Virtual Production (Online)

Play/Games,Wearables

https://vimeo.com/489637134

Description

In Sound and Color Bender, we explore the relationship between the movements of our bodies, color, form and sound. This project is the beginning of what we would like to be a tool for performers to use to create music and visual art simultaneously. What is the connection of the gestures of an arm moving, to the frequency of a melody, to a visual pattern on a screen? While we are based on opposite sides of the country, Natalie and I worked together to create a glove that responds to the movement of the user’s hand. We used the micro controller’s built in accelerometer and gyroscope to measure the tilt and acceleration of the hand, which sent those values to audio and visual software. The project’s current state provides a meditative space, with stimulating visuals and an airy, atmospheric audio experience.

ITPG-GT.2301.00002

Intro to Phys. Comp.

Performance,Wearables

https://vimeo.com/379383886/52f9b9d41f

Description

Handy is a wearable interface interpreting tangible interaction to intangible experiences, using EMG signal and machine learning. Unlike current popular hand-tracking interfaces, including those based on LiDAR and infrared camera, that we need to consciously pose our body for, on-body sensing based on EMG signals allows more intuitive and relaxed interactivity.

IMNY-UT.224.001

Introduction to Machine Learning for the Arts (Online) (UG)

Wearables

https://youtu.be/jFEUR7Vr76o

Description

I have always been interested in how the human body reacts to magnetic fields. I made an assumption about the biomagnetic field of the human body serval years ago. I thought that modern human's body (includes the brain) had the ability to sense the magnetic field from the earth as the other animal does. We had that ability when we were an infant. But nobody told us that there is a feeling of the magnetic field is the feeling of the magnetic field. As we grow, we lost the ability to recognize the ability, because without correct guidance.

This device is a wearable device. It detects the direction of the magnetic field through a magnetometer, and at the same time converts the direction of the magnetic field into vibration, which is transmitted to the user through the skin, allowing the user to distinguish the direction of the magnetic field through the vibration signal.

In terms of technology, I used Seeduino XIAO, a smaller Arduino board, and BNO-055 as my sensor. The current version uses an ordinary vibration motor. Before the start of the winter show, I might replace the motherboard on the back with a PCB board so that it will become smaller. Attach part uses flexible 3D printing materials.

ITPG-GT.2301.00008

Intro to Phys. Comp.

Wearables