Posted on

Touch Free Music

Brandon Kader

Touch Free Gesture using Computer Vision Presence Detection to play Music composed by myself.

http://https://www.brandonkader.com/interactive-music/

Description

The Max Patch opens the webcam feed and uses a low resolution. The jit.change object filters out repeating frames and the jit.rgb2luma converts ARGB color to Black and White. I used the jit.scissors object to divide the frame into six equal regions. The jit.3m object reports minimum, mean and maximum values from the webcam feed and the < 100 object compares the value. If the value is less than 100 it sends a bang to trigger a sound. I have mapped several sounds to some regions to give more intuitive control to the gesture in sculpting the music. To make the sounds visually expressive, I integrated a generative aspect that emits particles each time the region of the frame is triggered. I layered the particles with some visuals that further enhance the compelling interaction of the gesture with sound. The visuals are composed of FFTs and glowing violet hues. When you play the touch-less instrument, the visual feedback is effectively responding to the gesture in front of the webcam.

Classes

Interactive Music

Posted on

Trini Talk

Nikita Huggins

Trini Talk is an online platform designed to communicate and preserve the Trinidad English Creole Language. Using an interactive web platform, Trini Talk teaches the oral language of Trinidad through the island’s history, shows how the language is used and establishes a platform to preserve the language.

http://nikitahuggins.com/Thesis/TriniTalk/index.html

Description

Trini Talk, is a web platform designed to communicate the Trinidad English Creole Language. The platform uses an API of the dialect to teach this oral language through an interactive visualization. Video showcases real-life situations in the language usage. The language is evolving as new vocabulary is being spoken, so Trini Talk includes a platform to gather these new additions to the dialect from nationals. This is a preliminary effort to digitally preserve the evolving language.

Classes

Thesis

Posted on

Social Assemblages

Rebecca Ricks

Social Assemblages is a collection of distinct projects that speculates as to how Facebook data might be collected and analyzed by third parties in the future. "Eigenfaces" and "Logged in from" are the two projects on display.

http://rebecca-ricks.com/facebook

Description

It has been well documented that Facebook’s human facial recognition model can predict the identity of a face with over 99 percent accuracy. For my project “Eigenfaces”, I digitally printed a linen jacket with a pattern of images containing my eigenfaces threshold numbers alongside a 3D image of my face. By taking my private biometric data and literally wearing it on my sleeve, I wanted to encourage Facebook users to think about the degree to which their biometric data is already public. With my project “Logged in from”, I attempted to re-insert the digital world into the physical world by locating specific actions I took on Facebook within a physical geography. Using the location metadata associated with my Facebook activity, I reconstructed the real physical geography of each location in a three-dimensional environment, producing a series of strange, imaginary landscapes.

Classes

Thesis

Posted on

A Place to Remember

Anne Goodfriend

A Place to Remember is an Augmented Reality (AR) experience that takes place in Washington Square Park. AR Markers in the park invite passersby to use their phone’s camera-view to interact with hand-drawn maps, and recordings left behind by strangers. Users are then invited to contribute their own memories.

http://aplacetoremember.nyc

Description

A Place to Remember is an investigation of how Augmented Reality can be leveraged to layer communal narratives into and onto place. This project seeks to facilitate the creation of a collective narrative while augmenting a place such that users can explore memories of it while standing in the location that is their subject.
This project celebrates the role that public space plays in the creation of urban communities and in the formations of our personal memories and identities as urbanites. It aims to facilitate feelings of belonging, ownership and shared experience by inviting park visitors to engage with a place while listening to other people’s memories from there.
A Place to Remember focuses on Washington Square Park because this is a public space that is important to me and my understanding of myself as a New Yorker. When I first moved to New York, over 12 years ago, I lived in the Greenwich Village neighborhood. Because I lived in a tiny, shared room, home extended to wherever I could find some personal space and social interaction. More often than not, the place I went to was Washington Square Park. It was a place to nap, a place to eat, and a place to gather with friends.
It remains A Place to Remember.

Classes

Thesis

Posted on

Thesis

Paula Ceballos Delgado

[divine_pixels] is a collection of experiments which explore how ancient fortune-telling rituals can be updated using today’s digital technology.

Description

[divine_pixels] is a collection of experiments which explore how ancient fortune-telling rituals can be updated using today’s digital technology.

Classes

Thesis

Posted on

texere

Francesca Rodriguez Sawaya

In Texere, digitally generated designs make up the patterns for a hand woven textile that highlights the commonly hidden context around spoken words. Inspired by traditional Folk Art and the use of language in Oral Societies, it’s about crafting unwritten forms of language as a way of preserving the human side of collective memory.

https://itp.nyu.edu/thesis/journal2017/benedetta/author/frs256/

Description

Language shapes the way we see the world. Language is the way we learn how to communicate and relate with each other. Technology cannot capture the human side of language, and that is how things are said. And in the way we say things, is where human empathy is being shared. Digital devices transmit and store text, digits and characters, but disregard any type of context. And without it, language is being reduced to meaningless words.

This project preserves the essence of the meaning behind being human in a world that is foreseen to become more and more automated. Since technology lacks our unique capacity of transmitting empathy and we rely on computers to talk for us, this project analyzes oral histories told by people. However, preserving daily social memory must now include not only the spoken words, but the context around it, represented mainly by the patterns of intonation, pitch, volume and pauses. These are characteristics present in every language.

After performing audio analysis of oral histories collected, and gathering inspiration from traditional Folk Art and crafting techniques, a digital language pattern that translates the spoken words into weaving designs was generated. Finally, these designs became a physical weaving piece.

Classes

Thesis

Posted on

Cat In A Box

Mathura Govindarajan

educational experiences/storytelling devices that are based on traditional forms of Indian story telling

https://itp.nyu.edu/thesis2017/project/mmg542

Description

Kavad (literally translates to “doors”) is a rich form of storytelling that originates in Rajasthan, India. They are robust handmade boxes that open up in beautiful ways to convey a story.

My project draws heavy inspiration from this art form and tries to combine it with education via storytelling.

A user will unfold the box and a series of hidden compartments that contain different elements. The curiosity of the box goes hand in hand with the same curiosity you are seeking to unlock.

Classes

Thesis

Posted on

hysterical wearable

Renata Gaui

A wearable device that detects verbal microaggressions towards females during daily conversations and reacts to it.

http://www.gauirenata.com/category/spring-2017/thesis/

Description

On a daily basis, females are suppressed by negative vernacular habits:“you’re being emotional”, “are you on pms?”, “grow a pair”, “you’re so smart for a girl”, “don’t be a pussy” etc. that become part of our daily interaction with people (males & females). These are cultural vices that often goe by without being questioned. Is there a way that we can flip this pejorative speech and turn it into something that empower females? Can emerging technologies work as tools to create conversations about cultural mannerisms? My thesis project is a wearable device that protests against misogynist linguistics habits. A ruffled shirt neck has embedded in it hardware which is running a speech recognition software. The software is trained to detect verbal microaggressions towards females during her a conversation. Once it recognizes that a micro aggressive expression was used, it reacts to it by making a denture toy, hidden is placed behind the ruffles, start to bite – “mimicking” the aggressor and revealing itself by making the ruffles to fly through the denture movement.

Classes

Thesis