Tag Archives: Jeremiah

ASL Learning Game (attempt)

So I decided to build upon my ASL project that I did earlier this semester. Originally I was going to do a search engine using the ASL alphabet. But during the user testing session Anna had an idea to make it into an ASL learning game. What would happen is at the top of the screen images of the handshapes of letters would appear. The object is that you would copy the handshapes which would input a query (which you wouldn’t see) and then it would pull up the first google image of what you signed. Then you would type into an answer box what you think the word you signed meant. If you got it correct you’d move onto the next level, if not you’d have to guess again. When I started putting all of these ideas together I ran into many road blocks though. When I first started I was trying to use a LeapMotion but it wasn’t working with Processing at all. Then when I started with the flex sensors I couldn’t get the Arduino to work (turns out I had the wrong numbers put into the program, but whatever). Then I got the Arduino to work but I had to find all the various numbers for the letters again, and it wasn’t working as nicely as the last time I ran the ASL program. Next I just tried to get Processing to print the letter on the screen, but I couldn’t figure out how to get readings from the Arduino to be slower and I couldn’t figure out how to make the letters into one string. Because I couldn’t figure out this I wasn’t able to think of a way to get the letters into a query. So I don’t have the entire project all together… But I do have all the pieces of the code (except for the ASL Handshape pictures).

Here is the Processing code for getting the letters to show up on the screen.

And here is the query code:

 

Art Accessability and Computational Media

When we started this class we were discussing what computational media is. At that point if had I been asked to define it I wouldn’t be able to and I probably would have babbled something out about computers and art and “stuff”. Even now I don’t think I can articulate it very well and I would say that it’s not entirely a short coming on my part, but that it’s also hard to define succinctly. So to quote the late Justice Stewart, “I know it when I see it.” Beyond that I know that computational media and physical computing are revolutionizing art everyday and that blows my mind and has shaped my concentration at the same time.

Computational media has allowed for a whole new level of interaction in performance/installation art that wasn’t there before. It allows for a higher level of multi-media interaction between performer and audience or the audience performer and art. It also helps make it more accessible to audiences in ways that may not have been often thought about before. For example, using physical computing components like the gloves developed by Imogene Heap, a project that is only in the idea stages in my head would allow Deaf individuals interact with music in a way that would bring enjoy meant to hearing and non-hearing people. This project would allow individuals to paint on a projection (using LED tracking), and would allow them to change color and line quality through manipulation of the gloves. This aspect is the visual and tactilely appealing part for those involved (but especially Deaf individuals). A program similar to this one: http://games.fugly.com/Game/repeating-sound-grid.swf would then take the color and location of the drawing and create a looping sound that would always sound good together (go ahead try the program, it is tuned so that any combination of notes sounds good together unless you just click too many than it just get’s jumbled but whatever) which would be the appealing part for hearing individuals. In other words this allows Deaf people and hearing people to interact in a way previously barred to them, it would create a bridge between the two in art. Without computational media I personally don’t see a way that this project could come into being.

This is just one of the ways that I feel computational media has had a positive impact on the world and why I feel like it should be pursued. It allows for further accessibility for those with different abilities, sometimes in ways which one wouldn’t expect. So though some may fear what the future holds in this field, I for one am looking forward to the future.

It’s Raining, It’s Pouring (Brain Tracking)

So I was busy and just kept my program simple. I just took the color tracking program, made the ellipse into a bucket, and added falling raindrops. If you catch 20 raindrops “Winner!” shows up on the screen. I tried to add sound but I kept getting a NullPointerException so I just am using external sound. I also tried to have an image appear that said “Winner!” instead of just text but it gave the same error. As for the brain, well I just had it laying around and needed something colorful.

Here is the program in action.
Here is the program in action.

And here’s the code, I didn’t clean it up because I was busy, but it works!

 

 

Piggy Bubbles (Popped by hand, wow, so cool, I’m amazing!)

So I had a busy week so I just tried to incorporate telecommunications into last weeks project. So I just used a pressure sensor and when you press the sensor it’s supposed to pop one bubble. However, I cannot get it to pop only one bubble and I keep trying to fix it but it doesn’t end up working. So in reality it’s supposed to only pop one bubble and only play that bubbles sound. I also feel that my code could be made simpler and had I had the time I’m sure I would have figured it out but like I said I was busy but whatever.

Here's a screen cap of the program running.
Here’s a screen cap of the program running.

 

Piggy Bubbles

So I wanted to make something with bubbles just to figure out object oriented programming. But I wanted to take it a step further by adding something with popping. Then I thought… WAIT…. I NEED SOUND! So I decided to add a wide variety of sounds with each bubble corresponding to a different sound.

Here's a screen cap of the program running.
Here’s a screen cap of the program running.

And here is my code, the sound files were taken from freesound.org and I’ll put them on my flashdrive so we can hear them.

 

and here is the bubble class with the functions:

 

Interactive Screen Saver: NOW WITH 20% MORE INTERACTIVITY

So I just continued to work on my bouncing ball screen saver thingy but I tried to add a new feature. A “stop sign” where if the mouse is in the stop sign the ball would stop bouncing until you move the mouse off of the sign. I got this to work… kinda… but there is one problem. If the ball is moving in a negative direction when it is stopped, then when it begins moving again it moves in the positive direction. I know why this is; however, I have not been able to figure out how to fix it.

Here is the code:

The problem is that to stop the ball xSpeed and ySpeed go to zero. I tried to work around that with the x and y Velocity variables but that didn’t work because they both are positive… So currently I’m lost. Also I think there may be more instances where I could have used functions but I wasn’t sure how to go about that.

Interactive Screen Saver… what?

So I wanted to make something that would allow the bouncing ball to vary speed, direction, and size. However, once I started I tried messing with speed when I would click, but I could not get the effect I wanted and though I knew why I didn’t know how to fix it. But I was able to change direction and location of the ball. So I made a screensaver that is the stereo typical bouncing ball, but if you were to click on the screen the ball would move to where you clicked and would move in the opposite direction of that which it was bouncing in before. I also wanted it to erase after a while after you let it sit for a while or if you click so that it doesn’t get too crazy.

Here is the code:

And I made it color-changing too!

 

I Can Draw Flowers (And Other Daily News) (AKA Flower Power)

I decided just to get used to drawing with the simplest idea I could think of. A flower on some grass with some clouds. And that is what I did. As you can see in the picture:

This is a flower.
This is a flower.

I wanted to try working with arcs and that’s what I did. I was going to add more but then I decided why mess with a perfectly beautiful drawing. As far as the other daily news, well I lied about that, you can always ask me about that later if you so choose.

Now for the fun part! Here’s my code:

 

And there you have it folks!

ASL to LED (AKA American Sign LED-uage)

For my project I wanted to combine American Sign Language and what we’ve been working on in class. So I decided to translate the sign language alphabet into Morse code (done through flashes on an LED). I used two flex sensors, one on my thumb and one on my forefinger to do so. For this project I only did the letters A through H because to go past that I would need another flex sensor as well as an accelerometer to accurately transmit the letters. However, for A through H only the thumb sensor would technically be needed, but for accuracy (and I bought the thing so I figured why not) I used the one on the forefinger as well. It took me a while to figure out exactly how to code it and I feel like there would be a way to shorten down the code, but I did not know how at this point. But the biggest time consumer was figuring out the sensor ranges needed to code. And here is the video explaining some of this and a demonstration.

 

Don’t Forget Your Keys (Part 2)

The switch is activated.
The switch is activated.

So to be 100% honest I forgot to take a picture of my circuit before I disassembled it and I just didn’t feel making it again just to take a picture. However, because my project this week tied in to last weeks switch I just reused that picture. So I’ll just describe everything and I swear it works. The idea was that if the keys were on the hook and the door was closed one LED would flash on and off. If the key was on the hook but the door was opened the LED would stay on constantly and a buzzer would go off. If the key wasn’t on the hook though nothing would happen. To keep things simple though I just used two panic button switches instead of using the key and door switches. Below is the code for this. Also I couldn’t get the buzzer to work so I just used two LED lights instead.

void setup(){
pinMode(8,INPUT);
pinMode(7,OUTPUT);
pinMode(13,INPUT);
pinMode(12,OUTPUT);
}
void loop(){
if (digitalRead(8) == HIGH){
if (digitalRead(13)==HIGH){
digitalWrite(7,HIGH);
digitalWrite(12,LOW);
delay(1000);
digitalWrite(7,LOW);
digitalWrite(12,LOW);
delay(1000);
}
else {digitalWrite(7,HIGH);
digitalWrite(12,HIGH);}
}
else {digitalWrite(7,LOW);
digitalWrite(12,LOW);
}
}

Water Weight (or Don’t Forget Your Keys!)

This is a close up of the set up.
This is a close up of the set up.

Full setup with the switch
Full setup with the switch
The switch is activated.
The switch is activated.

From the beginning I wanted to do something with water for my switch. However, I wasn’t sure how to make it a true switch at first. While chatting with friends about this project one of them gave me the idea to displace the water somehow. This idea led me to this setup. The circuit itself has two wires going into a cup of salt water. One under the water level and another just above. The switch is a lever (in this case a hanger) with equal weights placed on either side. When weight, such  as keys, are added to the side above the water, the weight dips into the water, raising the water level enough to complete the circuit. By giving a visual signal you’re more likely to remember to put your keys on the hook and take them with you making it less likely that you’ll lose your keys.