ListenAR

Scott Reitherman

A mixed reality app that augments Vinyl LPs.

https://itp.nyu.edu/projects/addproject.php

Description

Continuing with Alex Fast on our mixed reality quest to augment LPs, we will pursue new features not yet explored in our midterm and refine things like API integration and video surfaces that are already key ingredients.

We have discussed putting this project into the ITP Winter Show, presented as a sort of AR record store pop-up shop, so we'll need to augment a handful of records. So we'll add to the list of albums and pursue refining the Radiohead and Bowie records that we began with.

Big New Things: integrated 3D objects to provide contextual information in more spatial ways, as well as implement some element of the Google Resonance spatial audio SDK.

Classes

Magic Windows and Mixed-Up Realities

augmented music

Amanda Lee

I love music, and people love music.

https://

Description

Instead of listening to their own music list, people can listen to the playlist which fits each area's mood. For this prototype, I will designate four music playlist into four different area. Music will be played in each zone automatically and randomly. Through this experience, people will share the same experience listening to the same music at the same time at the same place as a public music(radio) player.

Classes

Magic Windows and Mixed-Up Realities

Real Sound

Se Young Kim

Visualizing surrounding music/sound from real world and place it in the real world.

https://

Description

This is an augmented reality project using sound from the physical world as an input. The abstract sphere-shaped object will react to the volume, pitch, and the beat of the sound that surrounds the user. Some parts will change its color, some parts will move, rotate or bounce.
Whenever you go to a concert or show, you will find people taking pictures and videos with their smartphones. Real Sound could improve this experience even further. It will work like a VJ of your own. The sound visualization will start whenever and wherever you touch the screen of the smartphone. Real Sound is made to make people enjoy their music listening experience deeper and expand it to the visual experience.

Classes

Magic Windows and Mixed-Up Realities

Psychic Experience (HoloWAVE)

Sean Seunghwan Kim

Experience the world as a psychic through HoloWAVE!

https://www.meditasean.com

Description

Through HoloWAVE (HoloLens + Brainwaves-scanning helmet), you are put into the shoes of a psychic meeting with a client!

HoloWAVE's voice recognition capabilities enable the user to control the flow of time, which is used in conjunction with the user's level of concentration (Alpha wave: 7.5-14Hz) to determine how far into the past / future the user experiences.

For 2 minutes, you will become a psychic working with a client. You will experience the client’s past and future, and give advice.

www.meditasean.com

In collaboration with: Joe Moon (Stern)

Classes

Alt Docs: Inventing New Formats for Non-fiction Storytelling , Magic Windows and Mixed-Up Realities, Project Development Studio