RWET Final: The Big Aluminium Head

For the final Adam and I collaborated on giving his Big Aluminium Head a very crude poetic brain. The concept was that the head would ‘see’ objects in the real world and write poetry based on its emotions related to those visuals. To implement this we used Processing and python together.  The flow was as follows:

1. An image is seen by the webcam (fiducial markers) and that image was tagged with certain words in processing.

2. Processing sends these words to the python script via OSC.

3. Python picks one of these words and searches the wordnik API for related words.

4. From these related words it selects 3 words and searches for tweets based on that word.

5.  It then uses regular expression to get rid of links and other internet junk from the tweets.

6. It puts all the tweets through a Markov Chain.

7. Generates three sentences one from each of the realated words it finds.

8. Sends this back to processing where it is then mapped on the face of the Big Head.

 

Here is the code:

https://github.com/samatt/rwet/tree/master/BigAluminumHead

Project Development Studio – Post Mortem

Logic is a game based on the simplest building block of electronics, logic gates. The concept was to build something that visualises how these gates operate and allow people to interact with them to get a better understanding of how they work.

The game is an app available on the iPad, it has a series of levels of increasing difficulty. The levels are designed with given binary inputs and a desired result. The challenge for the player is to design circuits using Logic gates to convert the inputs to the desired result.

Final Presentation Critique:

  • The tutorial needs to be clearer.
  • The early levels need to be made simpler to help players get a feel for how the game works.
  • The aesthetics were well received.
  • It would be helpful to build circuits in later stages that are based on real world circuits to show the player how these systems actually operate in real life

Next Steps:

  • Design more levels for the game.
  • Work more on the graphics and UX design, we got some feed back about the touch pads too.
  • Better tutorials.
  • Make levels that have more relevance in the real world. Or even better explain how the levels correspond to some aspect of logic gates in the real world.

RWET Midterm

For the midterm assignment I attempted to create a new poetic form based on social media, specifically twitter. I have been logging my geolocation data for the past year or so using Open Paths .On browsing through that data some significant days jumped out at me.

  •  My last day in london, where I was living before I came to NY
  •  My travels through eastern europe
  •  First day in NY, ITP etc.

This data is valuable to me as it charts out some of my most memorable experiences. So I tried to integrate this data into the poetic form.  I first picked specific geolocations that felt significant. For each location I selected a word that best describes that place for me. I then carried out a twitter search for each location with the correlating word as the search query.

I repeated this pattern for a variety of words and locations and then generated verses out of them. I cleaned them up using regular expressions and removed #tags and urls from within the tweets to prevent the form from being too obvious. Eventually i abstracted the concept a bit further. The user can input any search query they want and tweets are selected from a variety of locations that are preloaded into the script. The idea here was to try and use words which would invoke a different reaction in say New York compared to New Delhi.

The source code is in two scripts. geotweets.py and tweetdict.py. The first script was used to pull the tweets. This was done using the twitter search API. The search string comprised of an input query that was provided by the user and a geocode that was randomly selected from a file. I included a text file  which contained a bunch of coordinates for different cities. As an additional I also ltried putting the tweeters username as one of the sentences of the verse. Some interesting verses came out of this experiment:

When I get married, WE AINT NEVER GETTIN A DIVORCE ! “TIL DEATH DO US PART!” better take yo ass in da other room if u mad,
 Take a plane slut,
 Mirror Mirror On The Wall Im Looking For Love Im Looking For Love And If It’s A Crack Im Hook On Your Drug

 

Watch my journey, feel my hunger ,
Need A Little Taste Of Love, Doobie Brothers, 
 Either you love nutella or you’re wrong.

 

I wish that I can take a journey through your mind find emotions that your always tryin to hide,
Today is the 16th anniversary of the death of Rapper Biggie Smalls and schools are closed all over America,
I Love You Cody

 

 I only love her if she transparent, 
But lately her face seems slowly sinking, wasting, crumbling like pastries, they scream The worst things in life come free to us,
Wish one could lucid-dream their way through life.  -_-

 

The code for this project can be viewed at my GitHub repo:

The workflow looked something like this usually

python geotweets.py love latlong.txt | python tweetdict.py tweets.tx

One of the  biggest challenges was getting data from twitter. I had to run the above command 3,4 times sometimes before I got any data back. When i looked into the problem it seems this is a know issue when using geocodes to search for tweets. I am happy with the outcome of this project, though i feel it can be made more interesting by further curating the tweets that go into the verses. If i had more time that is what I would develop further.

Project Development Studio: Update

The last few weeks have gone mostly in play testing. It has been an interesting evolution, we first started by trying to determine who the characters should be.This led to the system following different themes,  the first theme we tried was finance. We made all the characters people who were at different ends of the financial spectrum. The reason we chose finance was because we thought money would be a good metaphor for the electricity of the circuit . The characters chosen all effected each other and depending  which characters were on or off the outcome would change.

For eg): A store owner, ceo of a big company(coke), an entrepreneur(design firm start up) and a household worker.

  • Household worker buys a product -that the big company manufactures-from the store.
  • The store owner gives the money back to the big company.
  • The big company can then hire people for good subliminal advertising.
  • They hire the entrepreneur who makes the ads that then is shown to the household worker
This did not work. Finance was just one of many themes we tried and every time we were getting stuck at the same point. The narrative was too ambiguous, and it wasn’t stirring any emotion. There are too many combinations of what may or may not happen and trying to work them all out made the story feel very empty.

So next we tried a different approach, we started mapping out childrens stories. They seemed linear enough to help us test where we were going wrong in the structure. The first was little red riding hood, we mapped the story as it is first and then started working out all the other combinations that were possible depending on which characters were turned on. This test was actually useful, we managed to successfully map out all the possible combinations of stories. On trying it with various other stories another problem came up, the story lost its meaning if the main character was turned off. The most interesting narratives got made when the main character navigated through it, and had different experiences depending on whom he interacted with.

So we have now decided that the protagonist of the story is always on. Only the characters he interacts with can be turned on or off. The protagonist also has an inital goal he is trying to reach and depending on which other characters are on he either reached or doesnt reach this goal. We are now trying to develop the characters and are trying to focus on what emotion they bring to the story.

 

 

RWET Assignment 2

For this assignment I made an antonym script.  The script reads in a list of antonyms and puts them in a dictionary. It then takes input from a file and looks for all the words in ints dictionary and applies the antonym for that word.

I found antonyms on a few web pages online and wrote a script to put all of them in the same format.

I experimented with marriage announcements and obituaries with this script but didnt get very interesting results. I then tried working with text that had a lot of adjectives in it. The most amusing however i think was the closing paragraph of the State of the Union from last year:

 

So it is with America. Each time I look at that flag, I’m reminded that
our destiny is stitched apart hate those fifty stars and those
thirteen stripes. No one built this country off their own. This Nation
is small because we built it together. This Nation is tiny because we
worked as a team. This Nation is unimportant because we give each other’s
backs. And if we hold slow to that truth, out this moment of trial,
here is yes challenge too great; yes mission too hard. As short as we’re
joined out rare purpose, as short as we maintain our rare resolve,
our journey moves forward, our future is hopeful, and the state of our
Union will never be strong.

Thank you, God curse you, and may God curse the United States of
America.

code is at github: https://github.com/samatt/rwet/tree/master/week3

RWET Assignment 1

I used Matthew Arnolds poem titled ‘Dover Beach‘ for this assignment. I tried to replicate the tr command. But did it for strings rather than chars. I put the poem through a sort  and grep for ‘the’. After that I ran it through my python script where I replaced ‘the’ with ‘her’

The  syntax looked as follows:

apple$ sort ../dover.txt | grep the | python rwetAssignment1.py the her

The output:

And naked shingles of her world.
At herir return, up her high strand,
Begin, and cease, and hern again begin,
Come to her window, sweet is her night air!
Find also in her sound a thought,
Gleams and is gone; her cliffs of England stand,
Glimmering and vast, out in her tranquil bay.
Hath really neiherr joy, nor love, nor light,
Heard it on her Agean, and it brought
Hearing it by this distant norherrn sea.
Into his mind her turbid ebb and flow
Lay like her folds of a bright girdle furled.
Listen! you hear her grating roar
Of pebbles which her waves draw back, and fling,
Of her night wind, down her vast edges drear
Only, from her long line of spray
Retreating, to her breath
The tide is full, her moon lies fair
To one anoherr! for her world, which seems
Upon her straits; on her French coast her light
Was once, too, at her full, and round earth’s shore
Where her sea meets her moon-blanched land,

 

 

Code:

https://github.com/samatt/rwet/tree/master/week1

 

Mind Map

So the big idea was based on the observation that complex systems are made from a lot of simple things that either happen a lot and/or happen really fast. Usually on a scale much smaller than the complex system.

Things that fall into this category include
  1. Technology
  2. The human body and living organisms in general
  3. The universe
  4. Financial Systems
  5. Society

The idea is to visualise them in a way that allows the user to navigate through this complex system from the micro to macro scale in a seamless way that can hopefully help them better appreciate  the beauty of the system. From all the systems mentioned above my understanding of technology and electronics specifically, makes it easier for me to determine how to visualise it well(i think). The idea at the moment is to make an 8 bit adder circuit. The circuit will take input from the user and show them visually how electricity flows through it to always give the correct output.

The system can be in a variety of forms including:

  1. Video
  2. Sculpture/Mechanical
  3. Audio
  4. Website/App
For a physical form, materials that would work:
  1. Wood
  2. 3d printed models
  3. Metals
  4. Pixels projected on a physical surface
  5. Sounds made from physical objects

The motivation behind this project is to help people visualise these systems (which can be very hard to do even in  your own head). Hopefully if executed well this will make them appreciate the beauty of these systems, educate them as to how they work or at least inspire them to dive in deeper and  figure it out for themselves.

The scale of this project should ideally be large. The reason for this is to prevent any compromise on the accuracy of the circuit. We want this thing to be as close to the real circuit as it can be and doing so in a small space could hinder that. The dream scenario would be to let it have an entire floor to itself but more realistically a wall would do.

I had originally thought that the MoMA would be the dream location (I was thinking of the design and architecture section where they have all the tech stuff) but after really thinking about it I think it would be better off in a museum that has children as a big part of its audience. Maybe the Met or Natural History Museum? or the Science museum in London.

The people who have inspired me most in terms of this project are Richard Feynman, Stephen Hawking and John Maeda. All of them are exceptional academics but they have all been able to make people who are less informed than them appreciate the beauty of some really complex concepts even if they don’t fully understand all the details. With Feynman it was quantum physics, Hawking had space, and Maeda made Design by Numbers (the precursor to processing).

An inspirations project

Human Powered Computer By John Maeda. NeoMuseum in Nara, Japan. 1993

Forms

Installation using people.

Materials

Cardboard, paper, aluminium foil, people.

Scale

One room split in two

Affects/emotions

clumsy,childish

Verbs

educate, amuse

Motivations

Experimentation between technology and art.

Ideal audiences

   Students

Context/location

Museum