Yu Hu

Glance is a non-linear narrative that tells the story of a musician with hearing loss through the use of eye tracking, hand drawn animation and interactive programming.


Glance is one day in the life of a musician who composes music through visuals. This is a story about overcoming self-limitation, by placing the viewer in the point of view of a deaf musician, I wish to draw attention to the beauty of everyday life. The user triggers scenes within the narrative by using their own eyes to glance at animated elements which in turn reveal a unique visual and audio story. A computer vision system created with an infrared camera in combination with unity, tracks the users pupil movement which generates a personalized story for each individual viewer. The images and illustrations were hand created using watercolor pencil and then sketched frame by frame digitally to create a unique rotoscoping style.