Topics in ITP: Sense-able Realities: Weaving data across the digital / physical divide

Isaac Cohen

AR is more than putting a virtual thing in a place. With the delightful smorgasbord of sensors available in modern phones, we can sense the world’s contours, the position of a user, the lighting of a scene and so much more. This 2 day workshop will explore how we can use this data to create experiences that entangle the digital and physical in responsive ways.

This class is platform agnostic: concepts will be applicable across all AR creation tools but demos will be done primarily using Unity and Lens studio. 

Things this class will cover: 

– World mesh transformation

– Feature points exploration

– Marker tracking

– Facial Mapping

– Lighting estimation

– Camera shaders

– Phone orientation

– AND MORE