The Ability Project is partnering with our friends at Vision into Art, National Sawdust, and ARUP to work on an interesting project. The brief is below:
Sensorium AI is an international research, arts and technology project, with the overall aim of democratizing the development of voice-recognition AI and expanding possibilities for creative expression of voice.
The project has a specific focus on strengthening the experience of voice for people with voice-related disabilities, speech impairments and atypical speech patterns – beginning with the Cerebral Palsy community and expanding outward from there. Sensorium AI will place an emphasis on both physical voice and expression, as well as voice in terms of social and democratic participation.
The Sensorium AI project will explore voice-AI as part of a broader project with an interwoven set of outcomes and impacts working at the intersections of voice, disability, identity and technology. The project will provide a key opportunity to engage the broader public in developing more nuanced understandings around voice and the meaning of voice. centered around a co-design process with the Cerebral Palsy community, with the research and development anchored by NYU, Arup and Enactlab. This collaborative process will generate new possibilities for developing creative and authentic expressions of voice, in all its forms – physical, social, cultural, and democratic.
The project will manifest through two core outputs:
INSTALLATION: An interactive art installation exploring the relationships between voice, expression and identity. The installation will utilize music, movement and other expressions developed through the co-design process – to allow participants to experiment with different expressions of their voice and their relation to other people’s voices. This installation is intended to be designed to tour and/or take place at multiple sites simultaneously and engage local communities in understanding and contribute to the overall project.
OPERA/SOPHIA: Sensorium Ex is an opera exploring themes of disability, voice, technology and family. The story culminates with a narration by Sophia, an AI robot who represents an amalgamation of the other characters in the story. The AI which animates Sophia will be created through the Sensorium AI research process – a technology built to expressively amalgamate the diverse voices of disability communities across the world, and create a ‘living’ chorus of diverse expressions.