Jinxed Blinks

Zoe Wells

A painting that tells a looping story by changing every time the viewer blinks.

https://itp.nyu.edu/classes/cc-f18-tth/final-project-progress-2/

Description

This project is telling the story of the girl Solveg from the Roald Dahl book “The Witches”. In the story, Solveg is cursed by a witch to be stuck inside a painting of a farmhouse that her family owns. No one ever sees the painting move, but whenever they look at it, she has changed position slightly, aging and eventually disappearing as the years go by. I was also inspired by “La Jetee”, a film taking the form of a slideshow of still images, and “In the Blink of an Eye”, a book by Walter Murch that compares cuts in editing to natural blinking patterns.

In my project, I am using a facial recognition library in python to watch for when the viewer’s eye aspect ratio (EAR) goes below a certain threshold for 2 frames. To improve on the blink detection accuracy, I added a feature that allows the user to calibrate the blink threshold to their own EAR by pressing the spacebar, which they would be prompted to do when they approach the project. Their blink will trigger a the image to change to the next still in the story. The story will have the girl aging and changing her position in the painting, with her environment aging with her. For the final version, I plan to have 15 images in an oil-painted style for the full loop of the girl growing old and disappearing, since the average person blinks around 15 times a minute.

My ideal setup for the project would be a monitor with a frame around it to complete the “painting” effect. My laptop, with the camera for facial recognition, would be placed below the monitor. I also plan to have a soundscape of nature noises coming from the painting, with a sound effect when a change happens.

Classes

Comm Lab: Hypercinema, Creative Computing

Meta-Time

Chengchao Zhu

Human daily struggle with time

https://chengchaozz.vom

Description

It is a live performance, convey how people fight with time. Time here as a machine, something meticulous, unmerciful, ruthless, vs human who are fighting with time all the time.

Classes

New Interfaces for Musical Expression

The Space Well

Haozhong Yao, Robert Ye

An experience of floating and diving into the deep space through a well.

https://wp.nyu.edu/hy1460/wp-admin/post.php?post=54&action=edit

Description

Concept:
– The universe is a mysterious well with unknown depth. Traveling in the space could feel like falling down to an abyss. We want to waive gravities from three different dimensions (one in the well, on from the ground the user stands, the one in outer space) into our project. Receiving the gravity from the earth while experiencing the gravity-less space environment, the user may find a spirit of exploration during the processing of falling into the well.

User Experience:
When you stand by the well and look into the water, the silhouette of you appear in the center of the well consist of stars.
If you put your arms up parallel to the ground, the projection of you will begin to fall into the deep space as the stars zoom in and scatter with acceleration, creating a sense of space traveling. And when you reach a certain falling speed, you will see the big bang.
If you swing your righthand very hard, your projection will spin and flash.
If you put your arms just a little away from the trunk – the projection is going to rotate a bit to create a sense of floating.

Setup:
The project is a 34-inches-wide round inflatable pool, covered by a military waterproof black canvas and filled with 5 gallons of water.
A Kinect camera from 8 ft away captures the data of the user’s body.
– A projector hanging on the ceiling projects the animation of the stars in outer space into the water from up above, and the animation of the user’s figure.

Classes

Comm Lab: Hypercinema, Comm Lab: Hypercinema, Creative Computing, Creative Computing

Taking Flight

Defne Onen

Get lost in the sculptural light and reflections of Taking Flight!

https://defneonenitp.tumblr.com/post/181063091151/taking-flight-description-taking-flight-is-a

Description

Taking Flight is a semi-immersive light art sculpture. The participant plays with the handles that control the light fixture attached; to create sculptural light reflections that mimic bird silhouettes. The process is guided by interactive ambient sound that turns on when a participant is present and off when not, making the experience a meditative one. Taking Flight will draw you in with it’s beauty, calm your nerves by letting you focus on a simple task and empty your mind completely by the end of it. You’ll never want to stop playing!

Classes

Introduction to Physical Computing

Sound.Space

Roxanne Kim

Sound AR Experience

https://roxannekimblog.wordpress.com/2018/12/05/sound-space/

Description

This is the AR sound experience. From my AR class – Magic Window Mixed-Up reality, we discussed mixed reality which is between reality and virtual reality. Throughout practicing different types of augmented reality, I have become interested in virtual sound. Sound exists in the real space but we cannot see. Supposing a room is full of sounds and only we can hear through this application, it will be awesome.

Classes

Magic Windows and Mixed-Up Realities

Growth

Bora Aydintug

Growth is an interactive drawing tool/simulator that lets the user create and influence their own abstract organic growth simulation.

https://github.com/aydintugbora/itp_icm_blog/wiki/Final-Project—Growth-Simulator

Description

Growth is an interactive sketch that attempts to aesthetically mimic organic growth. It's inspired by the relationship between mathematics and nature.

Natural patterns have always been of great interest to me. After watching a coding challenge video by Daniel Shiffman about phyllotaxis, I've spent some time experimenting with it. I originally wanted to do a interactive phyllotaxis project. While working on the branches to add to my phyllotaxis project, I became more interested in the possibilities of the branch growth aesthetic that I'd found. Although I added ways to manipulate it, the general aesthetic of the sketch remained more or less the same in the final version.

In its current state, the user interacts with the sketch through 19 html control elements such as sliders, checkboxes and buttons. These elements will be replaced by a physical controller, that incorporates a joystick, toggle switches, potentiometers and sliders.

The sketch is an array of ellipses that move together. At random points, individual ellipses stray from the collective path to go on to shrink. This resembles branching of plants. The ellipses also have a changing perlin noise value added to their x,y coordinates to make the patterns they draw look more natural. In this sense the sketch is semi autonomous, also there is a “auto color” option, which when selected adds to the green value of the ellipses' fill, as the y coordinate decreases.

This is a one person project. I'm building the controller for my Pcomp final, as the project is a combination of Icm and Pcomp finals. I'm currently working on a shoebox prototype, so that I can have it ready by tomorrow for user testing. I'm planning to move on to making the actual controller in the weekend.

Classes

Introduction to Computational Media, Introduction to Physical Computing

LED Custom Controller

Karina Hyland Hernandez

Control any addressable LED fixture with this simple, intuitive, computer-less interface.

http://karinahy.com/index.php/en/itp-blog/physcomp

Description

Addressable LED's have become a very popular technology to use in a variety of platforms. Specially in entertainment environments such as theatre, music and dance performances. But the market today offers two main ways of controlling them. You either get a non-reliable and limited remote control, or you need to be programming expert and a computer to actually get exactly what you want. The ‘LED Custom Controller’ is right in the middle of these extremes. With a small and rather cheap interface anybody can design and control LED for a live performance, spaces or instances. This controller is also a simple and reachable way to teach how this specific technology works and get started with intelligent light.

Classes

Introduction to Physical Computing

Accumulation Study

Hannah Tardie

Accumulation Study is a sculptural study in which a robotic arm gathers material towards itself. The piece was made to perform an automated mode of production, specifically the accumulation process involved in predictive machine learning models. The form was adapted from an open-source Mime Industries .svg file, and has been influenced by the work of Anicka Yi and Lee Bul.

http://www.hannahtardie.com/a-machine/

Description

This project concept came out of an interest in machine learning. I have found that while predictive machine learning models can be used to generate eerily accurate pattern predictions, they more interestingly obfuscate any semblance to the users from which the data was pulled, resulting in a hyper-specific set of characteristics about multiple people that will never be made visible, human, or intelligible to those receiving its predictions. This sculpture incorporates transparent, imperfectly shaped cubes. Each cube can be thought of as a complex set of data. The sculpture performs an abstraction process similar to that of machine learning, although it doesn’t generate any predictions and it doesn’t “learn.” Instead, it offers a collective, portrait of many different cubes– once visible and now only partially recognizable when in the greater structure–that resembles the abstraction process central to machine learning. The sculpture will demonstrate a “plurality” of portraits in a similar way that machine learning offers. I am inspired by the work of Anicka Yi and Brian House.

Classes

Introduction to Physical Computing

IT guy

Simon Jensen

Take over another persons computer during a video-conversation

https://

Description

Electron app that lets you talk in a video chat with whoever logs on. If the person you are calling flip their screen – the person talking to them can control their mouse from a remote location. The project is intended as a remote helping tool for people who need computer help or someone who wants to show something on another persons computer.

Classes

Live Web