Posted on

Looking Through Mirror of Ice

Miao Tian

It is a AR experience through Hololens, people will pass a line of objects and trigger virtual objects to appear.

http://www.miao-tian.net/2017/05/03/merror/

Description

Inspired by Alice Through the Looking Glass, this project provides an experience for viewer to be a walking mirror. There will be a couple of existing furnitures lined up to start with. Virtual objects will appear when user trigger the event along with sound effects.

The Video is a demo of a working case in Unity. I have yet to find the right equipment to properly record through Hololens.

Classes

Avant-Garde Procedural Art, Nature of Code (Animation and Physics)

Posted on

Somnolent Listener

Utsav Chadha

Making lectures interactive.

https://www.utsav-chadha.com/somnolent-listener

Description

Somnolent listener is a software that makes lectures interactive using speech recognition and synthesis.

The listener interprets speech, produces subtitles, captures keywords, records a transcript, creates visualizations and also makes music.

Classes

Interactive Music, Nature of Code (Animation and Physics)

Posted on

Multisensory Music

Michael Simpson

A tool for creating audio/visual experiences that provides the composer with realtime multi-sensory feedback (audio/visual/haptic) tied to their physical interaction.

http://mgs.nyc/syntk/

Description

This project offers the viewer a series of different musical interfaces (software) and allows them to interact with both the audio and the visual elements which are being projected onto a screen. The idea is to provide the audience with a multi-sensory AV experience by tightly weaving sound, graphics, and physical gestures (via mouse/wacom/drum pads/faders).

Classes

Data Art, Interactive Music, Nature of Code (Animation and Physics), Nature of Code (Intelligence and Learning), Shader Studio

Posted on

Mirages : Light Experiments

Hayeon / Hayley Hwang, Yeseul Song

Interactive light installation which creates illusions on the wall using multiple DMX lights

http://bit.ly/2pWU2Wi

Description

Mirages: Light Experiments is an interactive light installation which creates illusions on the wall using multiple DMX lights. The project invites audiences to a playful and imaginative world formed with lights where they can manipulate mirages by moving their body.

Classes

Light and Interactivity, Nature of Code (Animation and Physics)

Posted on

Kodi Learns To Cook

Steven Simon

Children's interactive storybook

http://stevensimon-portfolio.com/kodi.html

Description

After taking Nature of Code (Animation and Physics) this semester, I was able to enhance the games in a children's interactive storybook that I created for my ICM final last semester. I added physics to the games in the book, and libraries such as matter.js. This book is ready for multiple user-testing and more feedback. The ITP show is a perfect opportunity for this.

Classes

Nature of Code (Animation and Physics)

Posted on

Holokit

FY Zhu

Hololens is amazing and meanwhile expensive. Now we proposed the HoloKit, this is just 3 dollar cardboard components in open source, and can turn your mobile phone into a powerful Mixed Reality devices and actually performance better than Hololens.For more information, please visit my documentation page.

http://itpzhufy.com/2017/05/03/holokit/

Description

Holokit is an open source mixed reality toolkits which can turn your mobile phone into a hololens style MR glass devices. Generally speaking, it contains several components as below:

1. Cardboard Kit: This kit is the main structure parts, it will provide the user with the stereoscope vision which is totally like what hololens did. The arrangement of the Cardboard Kit can be seen in this video here:

https://drive.google.com/open?id=0B0EKS8hqR17hSmxTS0FSWXZHXzA

2. Inside out tracking and environment detection. This part is the core function which will make the Holokit not to be just something head-lock experience but can make it really walking around, and meanwhile recognize the space in the world

3. Multiplayer network support. Here we also provide a spectator for our guest. For what the spectator looks like, please see the video below:

https://drive.google.com/open?id=0B0EKS8hqR17hVmxZSkx1anJhbUk

PS: For my final demo, I hope to invite my friends outside the ITP to help me during the process. He has also helped something during the design process. If you have any concern, please contact me via email.

PS2: If you think that thing can't pass, I can also demo another project based on Tango, video linkage here: https://drive.google.com/a/nyu.edu/file/d/0B7B5PKi4GojvUzNiR2M2bEd2WGc/view?usp=sharing

Classes

Nature of Code (Intelligence and Learning), Thesis