The Echoes Unheard
Lily Yu
Advisor: Theo Ellin Ballew
“The Echoes Unheard” immerses audiences in an interactive digital soundscape that captures the poetic essence of marginalized dialects and the deep personal connections they hold for the artist. It unveils the rich artistic and cultural narratives hidden within these languages.
Abstract
“The Echoes Unheard” is a web-based interactive storytelling experience. It invites the audience into a virtual landscape crafted by the artist, guiding them through the whispered melodies created in marginalized dialects. This journey intertwines the poetic beauty hidden in these languages with personal echoes from the artist that pulse with the music. Through engaging with this digital landscape, the audience gains a deeper appreciation for the nuanced cultural narratives and the profound personal stories that resonate within the overlooked poetic essence of these languages. The experience culminates in an invitation for the audience to share a song of personal significance, rewarding them with a customized digital vinyl image as a souvenir of their journey.
Technical Details
The frontend utilizes HTML, CSS, and Vanilla JavaScript for the 2D user interface and Three.js for the 3D environment. The database for user responses is based on Google Firebase.
Research/Context
"The Echoes Unheard" was inspired by the concept of "slow journalism," particularly Paul Salopek’s "Out of Eden Walk," which emphasizes storytelling through journaling about specific topics. This project sprouted from the desire to explore subjects deeply, leading to the discovery of music in unfamiliar languages and dialects. Such music, despite linguistic barriers, evoked profound emotions, sparking the idea to create a digital space that not only archives these musical pieces but also visualizes their invisible poetry and emotional connections with the artist.
This digital soundscape, built on Three.js, aims to offer an immersive experience that mirrors the slow journalism ethos, allowing the audience to engage with and reflect on the nuanced beauty of these songs. The built-in spatial audio feature in Three.js also enhances the immersion of the experience as the audience navigates in the space. The choice of technology was influenced by a review of similar projects, highlighting Three.js's ability to create engaging, interactive environments. "The Echoes Unheard" thus serves as a bridge between diverse musical expressions and the audience, inviting exploration of the rich cultural narratives and personal resonances embedded in the music.
Further Reading
- Out of Eden Walk: https://outofedenwalk.nationalgeographic.org/
- Penderecki’s Garden: https://pendereckisgarden.pl/en
- Annoying Museum: https://annoyingmuseum.zendesk.com/