« December 2007 | Main | February 2008 »

January 30, 2008

Pedal Prototyping

I built a rough foot pedal assembly for the rope & pulley system. I'm not quite sure what to make of it just yet, but it didn't feel right. Previously, pulling the rope towards my body would trigger a note on the synthesizer. As I pulled with increasing speed, the pulley system would increase the volume of the note along with a sound modulating parameter. As I pulled with decreasing speed, the system would decrease the volume and modulation parameter. Once the pulley stopped rotating, the system would turn off the note on the synthesizer. Today, I changed my code so that the rope only controls volume and modulation. I used the two foot switches I built to trigger two different notes on the synthesizer. It felt a bit more like playing a piano with my feet. I felt like I couldn't move as freely because my feet needed to be on the switches for the notes to stay on.

Foam Gasket Foam Gasket and Foil Contact Initial Foot Pedal Prototype

Ideas:
- Maybe there is an "initial state" of the instrument -- akin to an open string on a guitar or violin. (This can be tuned to the user's preference). This way, stepping off the footswitches still allows sound to occur when the rope is pulled.
- Does it make sense to allow more than one switch to be pressed at a time? I like the idea of being able to play intervals or simple chords with the system, but it doesn't make sense with the string metaphor.
- This is the synthesizer setup -- what about the sample playback setup? What experiments can I do there to push forward a bit?
- How do I capture a "gesture" with the rope like a rapid direction change?

Thesis Project: Rope and Pulley

During the course of this thesis project, I will develop a new electronic musical instrument that combines the expressive possibilities of large-scale human body motions with the sonic flexibility of computer-based synthesis into an intuitive live performance tool. Through frequent user-testing, a review of research in the field of New Instruments for Musical Expression, and specific attention to a disciplined creative process, this thesis will also investigate and comment on the relationships between tools and the work they are used to produce as well as the process a toolmaker goes through to develop an instrument.

I started working on this project as a sketch for Performing Technology last semester. It turned into my final project. You can look at the background information here.

Assignment #1 - Lines and Contour

Drawing #1
Line Drawing 1 033
Straight-up blind contour drawing of a plant in my apartment. I tried to imagine moving my finger along the edge of physical model.

Line Drawing 1 035

Drawing #2
Line Drawing 2 003
Tracings... I started off trying to trace the lines on the surface of a jigsaw puzzle -- what I was after was the physical experience of touching the object while drawing it. I found that tracing was the most gratifying way I could find to put my finger on the object I was drawing.

Drawing #3
Line Drawing 3
A line-drawing which also explores contour. This drawing is composed of only three lines and plays with the idea that things have to be drawn first in order to be made. This drawing/object was drawn and made simultaneously.

Line Drawing 3 - model

Non-Drawing #1
Financial District
There are a bunch of lines in this photograph. Many of them are implied as edges of objects -- the contours these objects present. There is a flow of action in this photograph that proceeds from the upper left to the bottom middle. This is the most literal line here, but at the same time, each vehicle, while following the road is also following its own trajectory -- an invisible line that is not shown here.

Notice how perspective affects the lines on the buildings. Because of the thirteenth floor vantage point from which I took this photo, the vertical lines on the building seem to be on a collision course somewhere below the street. You can even see that they start out thicker at the top of the building and grow thinner as they go down. It's very interesting what our eyes (and camera lenses) do to lines that are in fact parallel (by measurement).

January 18, 2008

User Testing

Yesterday, several people looked at my rope and pulley instrument / interface. Generally speaking, they all liked what they saw and found the interface to be intuitive. I didn't have to really explain what to do with it -- they "got it" almost immediately.

The Test Setup
IMG_9098
- rope & pulley system connected via Arduino to computer running Max patch
- computer connected via MIDI interface to Roland M-DC-1 dance module

When my right side faces the computer, pulling the rope towards my body triggers a note on the MIDI synthesizer. Pulling the rope with increasing speed increases the volume of the note as well as a sound modulating parameter. Decreasing the pulley's speed decreases the volume and modulation parameter. When the pulley stops rotating, the system turns off the note on the synthesizer.

I also demonstrated the original performance patch which plays Jimi Hendrix's "Red House" when the rope is pulled.

Observations
- It was difficult for me to come up with questions on the spot to ask other than, "how did it feel?", "was it intuitive?", etc.

- I was hoping to observe something that would bring me an idea for the next direction, but I'm not sure if I saw something.

- I found myself explaining and demonstrating the system to generate interest in the idea even though the system was only playing a single note.
- The system needs a bit more refinement in order to demonstrate it quickly. I sometimes get flustered when I switch between modes because it doesn't work immediately. I either need to write down the steps for setting it up or fix the Max patch so it does a few more of the setup functions automatically.

- When Amit was teaching us about user testing last year, he focused on picking a particular task. What was the task I wanted tested? It was hard to get specific answers because I wasn't asking specific questions.

- The responsiveness of the system is an important feature. Right now it feels good.

- All testers found that synthesizer version of the system really needed something to happen when the string was pulled back in the direction of the sensing wheel. It wasn't clear what that something should be, though. Shinyoung suggested some sort of record scratching sound. Rui understood the technical problem I was having with mapping volume / modulation with a positive and negative motion source. But he agreed that it felt strange that nothing happened in the "negative" direction. For this reason, he found that he liked the interaction with the computer-based sample playback ("Red House") better. The sample playback corresponded directly to the motion he was making with the rope. As he pulled the rope towards his body, the sample played "forward", slowing down and speeding up as he pulled with varying speeds. When he pulled the rope in the opposite direction, the sample responded in kind.

- One of the testers was very much interested in the body motion available as a result of this system. Being a "non-musical person", she was interested in how someone moves when playing the instrument. She wanted to see the installation of this instrument afford a nice set of gestures / body movements for the user. To observe this sort of behavior, I think I may need to build another unit that can easily be mounted horizontally, vertically (or on any angle, for that matter).

- Another tester enjoyed the materials the system was made out of. He felt like he could be rough and expressive with it because it was made out of discarded materials. Because the interface was not "precious," he felt that he could play hard. He mentioned that he wouldn't feel bad breaking the string or some other part of the mechanism because he had the sense that things would be easy to fix. If I can get the knot right, this would probably be the case. The only things I really worry about in the system as it is (made out of cardboard), is a kid trying to hang off of the rope. What I've observed several times is that people playing with an interface for the first time want to play ROUGH as the developer looks on in horror.

- I want the ability to change pitches on the instrument -- but not with the pulley. I want some sort of system on the floor that allows discrete pitch selection. One of the testers agreed with this.

- There may be something important about the fact that you can hide behind this instrument (like a guitar, piano, or even a laptop)

- I am hesitant to provide speed control over the sample playback unless it has some very natural smoothing that doesn't allow it to get too much out of control. These could be done as a series of short user feedback experiments. The other trick in allowing speed control is that stopping the rope must instantly stop the sound. This is one of the affordances of the current system. This could change if I add more mass to the pulley, however. A metal pulley will definitely want to keep spinning unless the rope is heavy enough (and has enough friction) to stop it.

- It was suggested that I ask other people (non sound people) should try it out and see if they get the mapping

- Jamie suggested trying a collaboration with motion theater people (like Judson Church) to establish a type of choreography.

January 07, 2008

Tiny Surveillance Camera Housing

Wendy is worried about the tiny surveillance cameras. She wants some way to position them safely. After brainstorming, we realize that a tripod might be the quickest way to get up and running -- the lowest barrier to getting to the next step. I will mount the cameras in small protective enclosures.

IMG_9040

1/4"-20 turns out to be a very important specification for photography. This is the dimension of the bolt found on camera tripods.

IMG_9041 IMG_9042 IMG_9043 IMG_9044 IMG_9045 IMG_9046 IMG_9047 IMG_9048 IMG_9049 IMG_9051 IMG_9052 IMG_9053 IMG_9054 IMG_9055 IMG_9056 IMG_9058 IMG_9059 IMG_9060 IMG_9061 IMG_9066 IMG_9068