PComp Final PART 2 – Interior Weather

I spent the last two weeks (mostly working on my Applications presentation) thinking about what my ICM/PComp final should be. Since the beginning I knew I wanted to :

  • build an immersive installation that makes the user to feel something that is shared live on social networks;
  • use Twitter as a “switch” to activate a physical interface;
  • use non technological material to build the installation;
  • use those non technological material to build a “visualization” of data sent by Twitter.

My final will be called Interior Weather and is an interactive installation that transforms emotions shared live on Twitter into weather. The tweets containing:

  • “I feel alone” will put the light of (darkness);
  • “I feel sad” will activate water mist (rain);
  • “I feel angry” will activate a thunder sound;
  • “I feel happy” will turn the light on;

Connecting Processing to a Twitter stream
Today, I managed to connect Processing to a live stream using the Twitter API. It “println ” the tweets stream.

  1. You first need to activate your developer account on Twitter;
  2. Then you can connect to the API using this example.
Here is the code:

// This is where you enter your Oauth info
static String OAuthConsumerKey = “put your key here”;
static String OAuthConsumerSecret = “put your secret here”;
// This is where you enter your Access Token info
static String AccessToken = “put your access token here”;
static String AccessTokenSecret = “put you token secret here”;

// if you enter keywords here it will filter, otherwise it will sample
String keywords[] = {“any keywords you want”
};

TwitterStream twitter = new TwitterStreamFactory().getInstance();

void setup() {
size(800, 600);

connectTwitter();
twitter.addListener(listener);
if (keywords.length==0) twitter.sample();
else twitter.filter(new FilterQuery().track(keywords));
}

void draw() {
background(0);
}

// Initial connection
void connectTwitter() {
twitter.setOAuthConsumer(OAuthConsumerKey, OAuthConsumerSecret);
AccessToken accessToken = loadAccessToken();
twitter.setOAuthAccessToken(accessToken);
}

// Loading up the access token
private static AccessToken loadAccessToken() {
return new AccessToken(AccessToken, AccessTokenSecret);
}

// This listens for new tweet
StatusListener listener = new StatusListener() {
public void onStatus(Status status) {

println(“@” + status.getUser().getScreenName() + ” – ” + status.getText());
}
}

The next step is to parse the incoming tweets into strings and have them send various outputs to the Arduino.
Sending data from Processing to an Arduino
Today I did the Arduino example Physical Pixel to send data from Processing to an Arduino.

 

 

B – Transforming the space into a musical instrument

The Orproject

C – Using normal and existing daily gestures as instruments

21 balançoires

D – The interactivity is conscious or unconscious

Solarbeat

The Physical Equalizer

By Anne-Marie Lavigne and Sarah Rothberg
Sample track by Yotam Mann

The physical equalizer is a midi volume fader made from 6 fabric flex sensors and 20 wooden cubes. In this application, each sensor is linked to a track on Ableton Live through MAX/MSP. Placing a cube of wood on the base of the controller activates a corresponding track. The cubes are stackable, and the more cubes there are on a sensor, the louder the volume of that track. This device can be played as a music instrument, as a live performance tool, a mixing device for engineers. It can be experienced through speakers for a public performance or headphones for a individual experience.

Personal Statement
Interactivity is a mix of gestures and interfaces. We wanted to create a device that puts the emphasis on the gesture, not on the technology. How can we put the user into a special and unique creative mode? How can we build a tool that invites the user to be spontaneous and engaged? We aimed to create a simple, recognizable interface using materials that encourage child-like play.

Background

Our main research was on soft fabric sensors. We discovered and learned how to make them and which fabric is best for the device. We have built our own sensors and created a template that can be shared.

Audience

The target audience is diverse. Any adult or child can play or perform. Musicians can use it as a performance tool, as it acts as a visualization of what is happening on a computer. Sound engineers can use it as a mixing device.

User Scenario

The user is invited to play with wooden cubes to manipulate the volume of a track, or turn that track on and off, using it as a musical instrument. Using the cubes to increase or decrease the volume of a specific track allows the user to visualize the music. The cubes are made of wood and are reminiscent of toy construction blocks, encouraging users to build and play. to put the user into a playing mode. The wooden interface puts the emphasis on the gestures of the user, not on the technology.

Implementation

The physical equalizer is made of a rectangular platform with 6 soft fabric flex sensors and 20 wooden cubes. Each sensor is linked to a music track on Ableton Live. The user stacks the cubes on the sensors to activate the music tracks. The more cubes there are on a sensor, the louder the volume of the track.

Conclusion

We learned how to conceptualize and build a simple user interface that can have multiple uses and purposes. Making simple and clear interfaces is a complex task. We think we succeeded creating a full and entertaining interactive experience with the physical equalizer.

RE : Leave me alone, Self 1!

This is a response to this great post by my friend Christina for the Applications readings.

My first ITP weeks were challenging. Even though I have been working on projects created with cutting edge technology, I had never been the one developing the technology itself. My job was to feed technologists with content ideas and strategies: knowing and discovering technologies through the content filter.

From the first class of my first semester, I understood ITP were the place I had been searching for years. A place where you simultaneously create technology and content ideas. The approach we are taught here is that technology frames creative ideas and as much as ideas frame technology. The more you know how the technology works, the more creative ideas you have. The more you have creative ideas the more you discover technology.

As of the first day, I also understood the next two years are gonna be a challenge. To be creative, you must let yourself go and dive into that creative space that generates inspiration. The thing is that with technology, this is hard to achieve. There are so many codes, algorithmes, softwares to master before you can let yourself go, that I doubted for weeks I could succeed in being creative using those tools. It felt like my Self 1 was constantly thinking that I had to completely master every single technology before I could pretend creating with it.

Also, the tools we learn here are not simple tools. They are complex and elaborated computed languages that demands a lot of cerebral work to be performed. Unlike a pen on paper, or paint on a canvas, or dance, I first found it hard to let myself go and be creative. How far do you have to master a technology so it becomes an extension of your body and you hands? So it becomes part of your Self 2 impulsions? It sometimes feels like learning technology implements an intermediary in between my ideas and and my creativity. Can technological creation be spontaneous? Or is it always mediated by a third entity that you can never completely control and understand? Is technology a filter with which we comprehend society or is it simply a tool?

How can we let our Self 2 be spontaneous when our brain has to continuously process code and cerebral knowledge?

Also, how can we build interactive art and experiences that allows the public to expose their Selves 2? I have always wanted to create immersive art that generate a simple emotion and impulse inspiring the individuals’ Selves 2 to act. Not to think and judge themselves but impulsively move and react. Having people behaving spontaneously with their Self 2.

What is interesting and paradoxical is the fact that to create such simple and instinctive environments, I do have to master cerebral and logical knowledge using Self 1…