It is a AR experience through Hololens, people will pass a line of objects and trigger virtual objects to appear.
http://www.miao-tian.net/2017/05/03/merror/
Description
Inspired by Alice Through the Looking Glass, this project provides an experience for viewer to be a walking mirror. There will be a couple of existing furnitures lined up to start with. Virtual objects will appear when user trigger the event along with sound effects.
The Video is a demo of a working case in Unity. I have yet to find the right equipment to properly record through Hololens.
Classes
Avant-Garde Procedural Art, Nature of Code (Animation and Physics)
]]>Making lectures interactive.
https://www.utsav-chadha.com/somnolent-listener
Description
Somnolent listener is a software that makes lectures interactive using speech recognition and synthesis.
The listener interprets speech, produces subtitles, captures keywords, records a transcript, creates visualizations and also makes music.
Classes
Interactive Music, Nature of Code (Animation and Physics)
]]>A tool for creating audio/visual experiences that provides the composer with realtime multi-sensory feedback (audio/visual/haptic) tied to their physical interaction.
Description
This project offers the viewer a series of different musical interfaces (software) and allows them to interact with both the audio and the visual elements which are being projected onto a screen. The idea is to provide the audience with a multi-sensory AV experience by tightly weaving sound, graphics, and physical gestures (via mouse/wacom/drum pads/faders).
Classes
Data Art, Interactive Music, Nature of Code (Animation and Physics), Nature of Code (Intelligence and Learning), Shader Studio
]]>Interactive light installation which creates illusions on the wall using multiple DMX lights
Description
Mirages: Light Experiments is an interactive light installation which creates illusions on the wall using multiple DMX lights. The project invites audiences to a playful and imaginative world formed with lights where they can manipulate mirages by moving their body.
Classes
Light and Interactivity, Nature of Code (Animation and Physics)
]]>Children's interactive storybook
http://stevensimon-portfolio.com/kodi.html
Description
After taking Nature of Code (Animation and Physics) this semester, I was able to enhance the games in a children's interactive storybook that I created for my ICM final last semester. I added physics to the games in the book, and libraries such as matter.js. This book is ready for multiple user-testing and more feedback. The ITP show is a perfect opportunity for this.
Classes
Nature of Code (Animation and Physics)
]]>Hololens is amazing and meanwhile expensive. Now we proposed the HoloKit, this is just 3 dollar cardboard components in open source, and can turn your mobile phone into a powerful Mixed Reality devices and actually performance better than Hololens.For more information, please visit my documentation page.
http://itpzhufy.com/2017/05/03/holokit/
Description
Holokit is an open source mixed reality toolkits which can turn your mobile phone into a hololens style MR glass devices. Generally speaking, it contains several components as below:
1. Cardboard Kit: This kit is the main structure parts, it will provide the user with the stereoscope vision which is totally like what hololens did. The arrangement of the Cardboard Kit can be seen in this video here:
https://drive.google.com/open?id=0B0EKS8hqR17hSmxTS0FSWXZHXzA
2. Inside out tracking and environment detection. This part is the core function which will make the Holokit not to be just something head-lock experience but can make it really walking around, and meanwhile recognize the space in the world
3. Multiplayer network support. Here we also provide a spectator for our guest. For what the spectator looks like, please see the video below:
https://drive.google.com/open?id=0B0EKS8hqR17hVmxZSkx1anJhbUk
PS: For my final demo, I hope to invite my friends outside the ITP to help me during the process. He has also helped something during the design process. If you have any concern, please contact me via email.
PS2: If you think that thing can't pass, I can also demo another project based on Tango, video linkage here: https://drive.google.com/a/nyu.edu/file/d/0B7B5PKi4GojvUzNiR2M2bEd2WGc/view?usp=sharing
Classes
Nature of Code (Intelligence and Learning), Thesis
]]>A digital companion for the antidance improviser, a stick figure that follows, remixes and counterpoints the movements of a person.
http://eccs.world/artificialantidancer
Description
Work in progress
Classes
Nature of Code (Intelligence and Learning)
]]>