Mengzhen Xiao – ITP / IMA Winter Show 2018 /shows/winter2018/ A Show for the Recently Possible. Sun, 16 Dec 2018 17:23:44 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 /shows/winter2018/wp-content/uploads/sites/45/2018/11/cropped-ITP_logo_2014-01.original-1-32x32.png Mengzhen Xiao – ITP / IMA Winter Show 2018 /shows/winter2018/ 32 32 Sketch To AR /shows/winter2018/sketch-to-ar/ /shows/winter2018/sketch-to-ar/#respond Fri, 14 Dec 2018 18:23:45 +0000 https://itp.nyu.edu/shows/winter2018/sketch-to-ar/ Continue reading "Sketch To AR"

]]> Lin Zhang, Mengzhen Xiao

Sketch To AR is a tool for turning a 2D drawing in the real world into a 3D virtual object in AR.

https://linzhangcs.github.io/blog/2018/10/31/sketchTo3D/

Main Project Image

Description

In most cases of building an AR project, making targets is necessary. Targets can be either images or 3D objects, which work as the trigger of showing the virtual objects. However, the virtual object that can be displayed corresponding to the target needs to be set in advance, which means that one target corresponds to one fixed virtual object. In our project, we want to explore a new way to step into AR. Instead of using a limited number of targets, users can draw whatever they want and see the augmented drawing in AR. Using image recognition, Poly API, and ARKit, this App is able to turn a 2D drawing into a 3D virtual object. The virtual object can also react with the real-world environment changes.

Classes

Magic Windows and Mixed-Up Realities

]]> /shows/winter2018/sketch-to-ar/feed/ 0