https://www.youtube.com/watch?v=l8aZH3OoNCo

Description

Historia is an fully realized augmented reality walking tour that uses Apple's ARKit and its newly released ARGeoTracking API to create a world scale experience on the streets of Downtown Brooklyn. It has a 3D diegetic interface that integrates itself with the physical surroundings of the sidewalk to provide educational information about the neighborhood's rich history.

Across the neighborhood pops up stands that show photos, soundscapes, and videos sourced from historical archives at the New York City Historical Society, New York Public Library, New York City Transmit Museum, and Museum of the City of New York.

In addition to the information available by looking at and tapping on the 3D photo/audio/video markers (date, source, and 2-3 sentences of context), there's also in depth research presented on info boards next to the neighborhood's most notable landmarks like the demolished Albee Theater and the old City Fire Headquarters.

Through all this media and information, the walking tour attempts to shed light on the past of a neighborhood that has in recent years experienced rapid change and massive redevelopments.

IMNY-UT.220.001, IMNY-UT.220.001

Topics in Computation and Data: New Realities (UG), Topics in Computation and Data: New Realities (UG)

VR\\\\\\\\\\\\\\\\AR,Education

https://youtu.be/eyeD_nfBaWk

Description

A $750 vertical tax payment counter slowly fills up as Trump collects quarters. Pac-Man ghosts are now red viruses (you lose 1 of your 3 lives if hit). Viruses morph into tax cut bonuses for a few seconds before reshaping to viruses (if hit, your tax due goes down by 50%)

When you are about to hit the due tax amount, Joe Biden appears on scene waving and smiling. If you run into Biden, he is scooped into the wheelbarrow and the game is over.

“Thanks for helping President Trump pay his $750 federal income tax for years 2016 and 2017”

A final call to action redirects you to your state’s official election day polling location website.

Zoom link:

https://nyu.zoom.us/j/93089677561?pwd=WmRlUVhPNTNIeE9rZk5EcEkxbWgvZz09

ITPG-GT.2122.00001

Magic Windows and Mixed-Up Realities

VR\\\\\\\\AR,Play/Games

https://youtu.be/JhCvj9S5C5w

Description

Alone is an augmented reality exhibition inspired by Defsoul's Alone Exhibition in Seoul from October 6-12, 2020. Due to the pandemic and short exhibition time, many fans of Def were unable to visit his exhibition. This app gives users the opportunity to view Def's gallery anywhere around the world regardless of the circumstances. The AR experience first allows the users to create their own layout of the exhibit by sending virtual “media cubes” into their environment. Then, the users are encouraged to move around the space to explore the media cubes which contain Def's photos as well as other video and audio assets that relate to the original photo. 

The app has two different modes for enjoying the gallery. The first is “Def's Story” which allows the users to experience the gallery as the artist intended it with a specified photo order and arrangement. The other is “Your Story” which creates a unique photo order and arrangement through randomization. This personal mode encourages the users to create their own connections and associations with the photos. 

The project was coded in Xcode with Swift, the 3D assets were made in Blender, and the video textures were created in Premiere Pro. 

IMNY-UT.220.001, IMNY-UT.220.001

Topics in Computation and Data: New Realities (UG), Topics in Computation and Data: New Realities (UG)

VR\\\\AR

https://youtu.be/tiaEudZCxIs

Description

Liminal spaces are undefined, transitional spaces, often devoid of spatial cues and context. What has AI learned about our experiences in liminal spaces and how do AI-generated spaces reflect our conversations and images of liminality? Using media generated entirely by AI and machine learning programs, liminal mind is a Web VR experience comprised of three liminal spaces featuring soundscapes, a generated voiceover by a neural voice and equirectangular photos created from GAN images.

IMALR-GT.202

Critical Experiences

VR\\\\AR,Machine Learning

https://vimeo.com/488819756

Description

Check into the Hotel Chelsea for a social VR experience that expands the legacy of NYC's historic landmark into a virtual venue & maker-space, where users are invited to take up residence in its haunted rooms to explore its storied past and craft legends anew within its hallowed halls.

This project will animate the poetry, art, and music scarred into the Chelsea's walls and renew the bohemian dream of a space that cultivates and nurtures creativity, birthing a new virtual afterlife for the physical space that has been silenced by the city's merchant greed.

My approach will pick up the torch from the Chelsea Hotel community in Second Life's digital twin of the building, both architecturally and ideologically, where its authentic spirit still glows with occasional events and exhibitions. Upon that framework, the VR Chelsea will enable creative practices in visual and performing arts, and deepen dimensions of presence for remote users. This platform can also be used to explore solo standalone storytelling experiences that dive into the lives, times, and secrets with immersive embodied narratives that tap into spatial memory.

ITPG-GT.2461.001

Desert of the Real: Deep Dive into Social VR (Online)

VR\\\\AR,Culture

https://drive.google.com/file/d/1-vZOIY_taekskRdQ9o-Ilb3LoZ43eRRR/view?usp=sharing

Description

ZOOM PASSWORD : ITP

Every 10 minutes the performance resets, using the audio and motion capture data of the renditions before, the live actor responds to the ghosts of eir past experience. Building on top of itself until becoming a cacophonic crowd. The actor cannot escape eir past as it continues to present itself, ey can only respond.. and respond to the response. If ey cannot change what has and is happening, can ey still find resolve? Does the moment of resolve then become another reflection? A study of presence.

ITPG-GT.2032.001

Performing Reality

VR\\\\AR,Performance

https://drive.google.com/file/d/1xbVzU-tMDFAPYv1N4HsRvzv5_xHwmWyT/view?usp=sharing

Description

Our goals is to allow users to explore how their self-perception might change as they abandon the normal human form and start to interact with others. The experience leverages minimal interactions and allows players to explore the group dynamics through a series of actions. Along the journey, they are able to interact with other users through four forms of actions: connect, split, detach and duplicate.

ITPG-GT.2461.001

Desert of the Real: Deep Dive into Social VR (Online)

VR\\\\AR,Play/Games