Posted on

Rhythmic skin

Nicolas Peña-Escarpentier

Wearable device for one-person procedural musical performances

http://itp.nicolaspe.com/2018/04/rhythmic-skin/

Description

Using a set of 6 vibration motors, Rhythmic Skin transmits haptic messages to the performer, in order to give essential information about the different layers of music. Using a Teensy micro-controller, it can connect as a MIDI instrument, making it possible to connect to many audio softwares.

Classes

Expressive Interfaces: Introduction to Fashion Technology

Posted on

Traveling in Style with Google Street View

Jim Schmitz

Neural Style Transfer algorithm applied to Google Street View data to make an animation that looks like you are flying through a painting.

http://ixora.io/categories/project-development-studio/

Description

Google collects panorama photos from all around the world and makes them available through the Google Street View service. Although they visit many interesting locations, often the photos look dull. My project involves obtaining these photos through their API and using a coherent style transfer algorithm to make the sequence look like a painted animation.

Classes

Project Development Studio

Posted on

VUJA DE

Yuqiao Qin

Vuja De is a virtual reality experience that explores the connection of virtual and physical space. It is a 3-minute-long interactive voyage through the cycle of life, which creates an embodied experience by creating an emotionally compelling world that respond to the user’s breathing.

https://yuqiaoqin.info/vujade

Description

When was the last time you paid attention to your breath, the magic gift we all receive when we first arrive in this world? Breathing is a deep connection between our interior bodies and the outside world and it records every step we live as human beings. We breathe differently when we are curious, when we feel fear, when we feel appreciation, when we are close to danger. Vuja De is an immersive virtual experience that welcomes users to a journey that responds to their breathing. By generating a unique experience in virtual space, it is meant to help users re-sensitize themselves as humans, and reaffirm physical and spiritual inter-connections. The experience is built around three moments that are central to any human life—the moment of birth, a moment of wandering, and the embrace of a dream. The user’s breath is captured by a microphone embedded in the headset, which sends output into the digital environment that the user inhabits.

Classes

Thesis

Posted on

The Soul Reader

Dan Oved

The soul reader uses the focus of a viewer's gaze to generate imagery that's a reflection of their subconscious.

http://www.danioved.com/blog/posts/electronic-rituals/the-soul-reader/

Description

This is a screen based experience which uses the focus of a viewer's gaze to continuously generate imagery. It shows the viewer different colors, text, shapes, and scenes, and uses recent advances in machine learning to determine which of these elements the viewer's gaze is focused on. It uses this information to continuously generating new patterns, colors, and shapes similar to what the viewer was fixated on, and renders them away from the center of the gaze. This way, the scene is constantly changing out of the field of view.

It’s like a choose your own adventure driven by your subconscious with no ending. It is both continuous and infinite. One person who continues where the another left off will start with the imagery generated by that other person, resulting in an experience shaped by all the people that used it before.

Classes

Electronic Rituals, Oracles and Fortune-Telling

Posted on

Talking Stone

Roland Arnoldt

A stone talks to humans when they are in tune with the language of the universe – true randomness.

http://ouiouioui.space/talking-stone

Description

Natural granite rock emits radioactive beta-particles at an amount that is considered non-harmful to humans. The moment of decay of each of these particles (mixed with gamma-particles from universal background radiation) can be detected by a geiger-counter and is true random according to quantum-mechanics. The geiger-counter is connected to an Arduino that compares the decay patterns of the rock with the knocking-patterns of the audience picked up with a piezo element mounted on the stone. When both align for a certain time, a solenoid hits the stone in the random pattern detected by the geiger-counter in real-time for 15 seconds. After the stone has knocked back, it is waiting again for humans to knock and possibly “unlock” it. As the chances are very low to get the pattern right from the beginning, the delayed gratification and moment of surprise has a higher impact on the audience. The core idea is to provide the audience with a playful and at the same time meditative experience. It helps them to establish an artistic dialogue with the universe that is based on the scientific principles of quantum mechanics and true randomness. True randomness can be regarded as a spiritual means as its mere existence as a principle questions our rules of logic and reason: We have no explanation for true randomness – but we know that it is a fundamental principle of the universe.

Classes

Energy, Project Development Studio

Posted on

Gold Hunter

Yuhan Zhang

How can I create an AR game that involves 2-3 people of any age, that is fun, beings them joy and surprises?

https://github.com/yzhzyh/ThesisArchiveLink

Description

This project is an AR game app that allows user to play with their friends together in real-time. During the game, targets will pop up randomly in the space, the user need to hold the phone to move around discovering the target, and tapping on the screen to shoot the bullet to destroy the target. The user need to compete with their friend to shoot the targets to win more scores.

I always believe connecting people is very important for every new technical tool. So for AR, I tried to build a sharable experience through a playful way, like a multi-user game, competing with your friend in real-time.

Classes

Thesis

Posted on

A Fresh View, a look into the Cyprus Problem

Ariana Vassilopoulou

A 360 Video installation that simulates the division of Cyprus, and shows the perspectives of the two communities – The Greek and Turkish Cypriots.

www.arianavassilopoulou.com

Description

A Fresh View is an installation that places two viewfinders facing each other, separated by a what is known as a Green Line. Each viewfinder represents the perspective of two communities in Cyprus; The Greek and Turkish Cypriots. Each viewfinder is created by putting the google cardboard into them, showing the Green Line from each side in 360 degrees. I conducted interviews and created the 360 videos in Cyprus, and learned how people on both sides feel about the separation of the country, and how the physicality of the Green Line affects their daily lives. This is what is shown inside of these viewfinders.

Classes

Thesis

Posted on

Timeline of the Far Future

Dongphil Yoo, Joohyun Park

What will happen?

https://www.timelineofthefarfuture.com/

Description

Timeline of the Far Future – an interactive web experience invites user to the macroscopic world that visualizes events spanning from the beginning of the 11th millennium to the furthest reaches of future time. All the data here is postulated by science and collected from Wikipedia API. This project aims to explore the fundamental question of “Where are we?” by asking “What will happen?”.

Classes

Mashups – Creating With Web APIs

Posted on

IMVII

Brandon Kader

I created a system to seamlessly integrate music, visuals, and depth sensory data to perform as a conductor. The performer moves in a space to conduct music samples and generative visuals.

https://www.brandonkader.com/thesis

Description

I made an immersive experience without a device or VR headset. I have tried a VR headset and felt disoriented and extremely uncomfortable. I most definitely do not want to work in that medium. It is important that the performer not touch things like a conductor does not play a specific instrument in an orchestra, rather directs the performance. My experience with piano performance is that it is not very physically moving, the piano is stationary and the performer is seated at the keyboard. There is little showmanship or stage presence. I have felt the need to perform my music in another way. I explored how to make an immersive experience – including music and visual effects – using a touch free interface for modern composers to perform room scale installations. I used a Kinect camera to gather depth sensory data with Processing to map music and generative visuals in a system I built with Max MSP Jitter, a visual programming language that patches and connects the data to music and visual elements. I used a Triplehead2go for 3 projector display to create a room-scale visual experience.

Classes

Algorithmic Composition, Choreographic Interventions, Thesis

Posted on

mltk: machine listening toolkit

Michael Simpson

Sound is a multiplicity of qualities and features. What if a tool allowed us to easily extract and use more of these data points in real-time?<br />
<br />
The <i>Machine Listening Toolkit</i> is a project aimed at easing the use of computational audition for creative purposes.

http://mltk.mgs.nyc/

Description

The Machine Listening Toolkit is a software toolkit for streamlining the use of machine listening algorithms. The toolkit was designed to be used in real-time applications and provides access to utilities and data structures that help alleviate the related burdens. MLTK currently includes an openFrameworks add-on, a collection of learning resources, and a standalone tool that can be used to visually explore representations of the data and data flows.

The dashboard allows users to select, configure, and explore a vast array of relevant algorithms and have their output rendered in real-time as a graphic visualization. The dashboard can display a matrix of real-time visualizations which the user can arrange freely. The simultaneous view allows differences between graphs to become apparent and observed. This is useful as a way of better understanding the algorithms and their relationships to each other but also provides a real-time indication of how the algorithms perform and seem most appropriate for a certain task given the sound. The graphs can individually be explored in 3D to help reveal historical trends in the data visually. Visualizations can be selected on-the-fly to make their data stream available to external applications using OSC. Data can also be exported into flat files in several common data file formats.

Classes

Thesis

Thesis Presentation Video

http://mltk.mgs.nyc/