Category Archives: Benedetta Piantella Simeonidis

Snoopi: the data sniffing dog

Jiashan Wu

Snoopi the dog sniffs out information and digital footprints from devices/people around him and visualizes them in real time. <br />

http://itp.fromjia.com/?p=342

Description

Culturally we are at a place where the ramifications of having data shouted out over wireless network has largely remained unseen. With Snoopi I want to start the conversation surrounding simple, benevolent acts and data collection and profiling. The question is: why does this matter? Should we care that we are leaking breadcrumbs of data from our intimate devices? Norms of our attitude towards data and data collection is still being formed. I hope to bring up questions and awareness about this topic to more people.

Dressed in a hoodie equipped with a Raspberry Pi running Surya's NSHeyy sniffer program, Snoopi the dog sniffs out information from surrounding devices. Information includes the origin of devices, their wifi router history (which allows tracking a user's location history), unique mac addresses, and their relative distance to Snoopi. When Snoopi's hoodie is on, an LCD screen lights up, displaying sniffed wifi history information.

On a computer nearby, sniffed data is visualized in real time. This visualization allows viewers to look at individual device information, see connections between devices (whether they have been connected to the same wifi network), and aggregate information about the devices/people in the area.

For the show, Snoopi can be substituted by a stuffed animal on a roomba or another autonomous vehicle. Depending on where Snoopi is, the visualization will update in real time to give viewers an idea of the type of people in the room as well as information about individuals in the room.

Classes

Introduction to Computational Media, Introduction to Physical Computing

Stitching Stories

Sisa B. Holguín, Sweta Mohapatra

STITCHING STORIES is an experimental, interactive video installation exploring the tale of two characters while giving users the power to make customized versions of a story.

https://github.com/teletechnophiliac/ITP/tree/master/PComp-Final/Final_Proc

Description

STITCHING STORIES is an experimental, interactive video installation exploring a moment in the lives of two characters while giving users the power to make customized versions of the story. Sisa B. Holguín has a strong interest in exploring innovations related to interactive videos and stories, and has collaborated with Sweta Mohapatra, who is interested storytelling via a physical controller. Using our custom controller, which is in essence a hacked “Bop It” toy, users will assemble a narrative by activating various parts of the controller in whatever order they would like to tell their own version of this story related to the garment industry. The result is an interesting experiment to see what users create with basic interactive storytelling elements. 

Sisa B. Holguín is a filmmaker who is intrigued by both the complex and stories that are untold. Sweta Mohapatra is a UX designer. Both are currently a Master's Candidates at the Interactive Telecommunications Program (ITP) at NYU.

Classes

Introduction to Physical Computing

Historical Contusion

Nicholas Hubbard

Historical Contusion asks the question: when we physicalize, make visible the impact of silence around difficult topics, are we willing to engage, and stay engaged?

http://www.ndhubbard.com/itp/historical-contusion/

Description

This project is an durational performance and installation in which users are invited to read a primary historical text that contains difficult/troubling content (a massacre that occurred in Northern California in 1860). The action of a motor will be driving an axe that will hit the performer with the blunt end, repeatedly, over the course of the event, unless a user intervenes. The user's voice, as long as they are reading, stops the motor. The aim of the project is to interrogate what it means to share history, and to connect that history to the body/emotion through the use of technology (is there such a thing as cyborg history?).

Classes

Introduction to Physical Computing

Felt Sound

Magdalena Kovarik, Songee Hahn

Build and feel the sounds while you play with colorful wooden blocks on an interactive mat!

http://www.sonihahn.com/pcomp/w8-9/

Description

There are a bunch of colorful wooden blocks on the top of a felt mat. While you place, stack, and knock down those blocks, you can make countless combinations of sounds in your own ways. Several sensors are embedded inside of the felt mat, and each sensor generates different types of sounds. As you place more blocks, more sound will be added in harmonious ways. The felt mat is specifically designed to turn an everyday object – the felt mat- into an unexpected sound playground for those who participate.

Classes

Introduction to Physical Computing

Tilt

Craig Pickard, Joseph Mango

Tilt is a tactile digital gaming and puzzle interface.

http://www.craigwentdigital.com/2014/11/physcomp-final-project-proposal/

Description

Tilt is a tangible user interface (TUI) that combines the benefits of a digital gaming platform with the tactile experience of manipulating a physical object. By choosing Unity3D as the development environment, we're able to utilise the powerful built-in physics engine to deliver realistic and engaging gameplay. Combining a physical interface with a digital application has allowed us to create an extensible multi-layered gaming experience that is, for the time being at least, only limited by our experience with the Unity3D development environment.

The digital application is rear-projected onto the display surface from below. This conceals the hardware and allows the user to engage with the content, instead of focusing on the technology. Tilt's dual-gimbal mechanism provides two-degrees of freedom, allowing the user to tilt the surface around two axes simultaneously. A triple-axis accelerometer determines the surface's orientation and translates that into input variables for the Unity3D environment.

The application that was developed for this prototype has requires the user to navigate a rolling ball through a three-dimensional maze-like environment by tilting the surface of the interface; causing the ball to roll in much the same way a real ball would roll along an inclined plane.

Although the prototype does not boast the feature, for future iterations we aim to incorporate pattern recognition software that will allow the user to place physical objects onto the projection surface, thereby augmenting the gaming experience and allowing the digital and real-world entities to interact with one another.

Haptic and auditory feedback further enhance the gaming experience, creating an engaging and sustained interaction for the user. The gaming experience is designed to be intuitive in its use, and users are encouraged to learn the nuances of manipulating the interface through tutorial-like levels.

Classes

Introduction to Physical Computing

Silophon

Dalit Shalom, Louis Minsky

Silophon is an assistive instrument/toy designed to create a positive experience of sound, specifically for children with autism. Silophon is designed to look like the classic xylophone, crafted with felt, allowing the user to play by hitting the keys with their hands or soft mallets, and also allowing the user to control the level of volume.

http://silophon.com

Description

It is well known that some people on the spectrum of Autism are hypersensitive to sound. The characteristic of wanting full control can be very frustrating when it comes to situations with sound where often there is usually no control. Traumatic experiences with sounds as a child could evidently lead to not wanting to engage with music and sound as an adult. We believe that by creating an instrument/toy that will allow the child to control sound, combined with an engaging level of user experience may help break the potential friction between hypersensitive children with Autism and sound.

During the building of our prototype we met with professionals in the field of Occupational Therapy who specialize in working with children who have Austism. One of the most important things we learned were the key elements to successful design for autism: predictability, control and choice

As for fabrication, we experimented with a bunch of materials. Felt seemed to be a good material to work with for two primary reasons:

1. Felt is a relatively soft material, hopefully encouraging children with autism to engage with it.

2. Felt has a sound-proofing attribute, since it absorbs sound.

The sound played on each key is a xylophone sound, only digital with the ability to control the volume.

The felt pieces are mounted on wooden notes/keys.

For further information, description and photos please see: http://www.onmydiskette.com/category/fall-2014/p-com/

Classes

Introduction to Physical Computing

Explorer

William Field, Minju Kim

Explorer is a space simulator. It is designed to be an educational tool which teaches about orbital mechanics.

http://www.willjfield.com/?page_id=348

Description

Explorer is a space simulator. It is designed to be an educational tool that teaches about space flight and orbital mechanics. The user of the simulator controls a space ship orbiting one of four planetary bodies in our Solar System – the Moon, Mercury, Earth and Neptune.

The simulator has two modes: free play and tutorial. Free play allows the user to direct the ship as desired and for any planet to be chosen at any time. Tutorial mode guides the user through several steps explaining how to get into orbit and how to change the shape of the orbit.

Along with the Processing sketch, Minju and I built a handheld controller to control the ship and camera. The project is designed as a prototype for a interactive museum didactic. It is targeted to ages 10+ but is enjoyable for all ages.

Classes

Introduction to Computational Media, Introduction to Physical Computing

Atmospheric Sound Lamp

Yining Shi, Gabriel Andrade

Atmospheric Sound Lamp has three paper mache lamps which will emit warm light and activate atmospheric sounds when they're touched by users.

http://www.yining1023.com/?p=392

Description

Atmospheric Sound Lamp is a physical instrument that combines two sensations – sound and light – to bring an atmospheric experience. It is made of three white paper mache lamps on a rack. When people touch a lamp, it will emit warm light and play cosmic sounds. More specifically, the light that comes out from the lamp case with many cuts creates many small shadows in the room. The volume is determined by the area of the touch, and tune depends on the length of the touch. In addition the paper mache provides a crafty texture that encourage touches from people. People could touch two or three lamps, or touch the lamps in different orders to play with the sound and also enjoy the warmth. For adults, these lamps will bring a peaceful meditative warm experience; for kids, they will increase their curiosity on light and sound.

Classes

Introduction to Physical Computing

Peeqo – The Productivity Bot

Abhishek Singh

Peeqo is your desktop robot buddy that helps you stay productive through the day

http://peeqo.com

Description

Peeqo is a tiny desktop robot that keeps you on track to get your tasks done and motivates you to stay productive through the day. All you need to do is plug him in and fill up your tasks for the day. Everytime you check a task off your list, peeqo rewards you with a high five and allows you to play with him. You can play with him by petting him, making him dance, sing or ask him yes and no questions(sort of like a magic 8 ball). He’s also insanely cute! Research has shown that a cute bot can get people to do things that they normally wouldn’t. When he thinks it’s time for you to go back to work, he’ll begin to get angry and become non responsive. I believe robots like Peeqo can change the way we interact with technology. Can we switch from a tool-based relationship to one of partnership.Can we go beyond drop downs and menus and design technology around emotion? Peeqo is an attempt at answering those questions and at making technology feel human.

Classes

Introduction to Physical Computing

Sky Forest

Tommy Payne, Eli Zhang, Maria Fang

Sky Forest is an interactive hanging light installation captivating people and fostering connections through touch and sound.

http://wp.nyu.edu/skyforest

Description

Sky Forest features a meticulous composition of capacitive materials which create a connection between a light source and the user. The piece features lengths of LED light strips and soft fabrics which foster the interaction of touch and play. Three artists working collaboratively conceived the hanging installation which people of any age and height can interact with. By interacting with capacitive sensors the user learns the behavior of the piece which bears some semblance to clouds in the natural world.

Classes

Introduction to Physical Computing