ITP Thesis Archive 2024

Abstract

Whispering Windows is an interactive storytelling experience that uses toylike miniatures with projection mapping and animations to create a surreal environment to bring digitally illustrated stories into the physical world.

Technical Details

Whispering Windows gives users limited scope to use a miniature toy-like controller to trigger different animations via either unity or js on a screen that's hidden behind a miniature building, while other sensors control the color and lighting of the projections mapped onto the building.

Research/Context

The project started by exploring color theory, how colors relate to our emotions, and how filmmakers and artists successfully use them to convey moods, atmospheres, and feelings without saying it explicitly. Halfway through the first semester, after talking to my advisor and other faculty, I decided to change to a project that still uses color theory as a storytelling tool instead of the experience being an information session on color. As a passionate 2D animator, I also wanted to use this medium to portray a story that acts as an example. Inspired by various movies (live-action and animated) and role-playing games set in surreal worlds, I created the story of 'Whispering Windows,' which is aesthetically beautiful yet haunting at the same time. It uses toy-like miniatures, surreal illustrated animations, colors, and music to bring to life a digitally animated story into the physical world. The project is a combination of my favorite projects that I've done as part of ITP, borrowing an element from each, namely 2D animation, non-linear storytelling, projecting mapping, automaton animations, digital fabrication, and making a playful interactive experience.