eyes by eyes
Keunyoung Oh
nonverbal conversation through visual information.

http://itp.nyu.edu/~ko373/thesis06/eyesbyeyes
Classes
Final Project Seminar
Keywords
color tracking, non-verbal communication, chatbot, pattern reading, messanger, Flash, Java
Description
‘eyes by eyes’ is a project communication of two computers through visual information. Without any direct connection, Two computers communicate through visual by using cameras which pointing to each others screen.
Each screen displays images divided by some rows, which represent the number of bits in an ASCII code, and by some columns, which represent the number of letters typed from the keyboard, will be filled with a picture of eye. Thus, the number of eyes will be the total number that resulted from multiplying the bits in a ASCII code by the number of letters typed in. So, the interesting part of this display is that the actual resolution, each pixel represented as the eye (or an icon), will be the actual eyes used in this particular communication. Let’s say the resolution represent the conversation, and each pixel for the words in that conversation. Then, the actual conversation will be displayed through the keyboard input. These keyboard inputs will be directly translated into ASCII code upon its key press, and this code will be directly converted into binary formats, all 0’s and 1’s.
Each letter represented in binary codes will be showed in each row of the display by the usage of the eye form, as explained previously. An shut eye will represent 0 while an open eye will represent the 1. Finally, cameras capture the screen and analyze the ASCII information and computers turn it into characters and print out as a actual alphabet form through LCD display to help users understanding.
Each screen displays images divided by some rows, which represent the number of bits in an ASCII code, and by some columns, which represent the number of letters typed from the keyboard, will be filled with a picture of eye. Thus, the number of eyes will be the total number that resulted from multiplying the bits in a ASCII code by the number of letters typed in. So, the interesting part of this display is that the actual resolution, each pixel represented as the eye (or an icon), will be the actual eyes used in this particular communication. Let’s say the resolution represent the conversation, and each pixel for the words in that conversation. Then, the actual conversation will be displayed through the keyboard input. These keyboard inputs will be directly translated into ASCII code upon its key press, and this code will be directly converted into binary formats, all 0’s and 1’s.
Each letter represented in binary codes will be showed in each row of the display by the usage of the eye form, as explained previously. An shut eye will represent 0 while an open eye will represent the 1. Finally, cameras capture the screen and analyze the ASCII information and computers turn it into characters and print out as a actual alphabet form through LCD display to help users understanding.
Personal Statement
Since I came to the State and started to use other than my mother tongue, I learned...
* power and the big chance of miscommunication of the non-verbal communication.
* unconscious actions that can make context unintentionally
* how different languages being used for a same purpose.
* power and the big chance of miscommunication of the non-verbal communication.
* unconscious actions that can make context unintentionally
* how different languages being used for a same purpose.
Background
Nowadays, having a simple conversation requires either a verbal or a gesture means. Indeed, the theme of communication has always been based on the idea of hearing and speaking voices or using hand gestures. However, the main criterion in a simple communication between two persons is that they must face each other in order to set some kinds of receiver between these two mediums. It is from this idea how my idea got developed. How about if any people can communicate with the most basic element of conversation: Eye Contact. People must watch in order to start a conversation, except the one happening during phone conversation. Therefore, my piece will reflect this theme of establishing a new mean of communication: Eye Talker.
Audience
anybody who want to make conversation through computer's vision massenger.
User Scenario
1. on the table, two monitors facing each other and cameras attached top of the each monitors targeting each other's screen.
2. when user push the ‘interruption button’, then monitor will be turn around to user to show the introduction Flash movie let the user choose,
* conversation set(computer to computer, computer to user, user to user)
* language(Flash, Java, C, Director, MAX/MSP)
* icon(eyes, or other than icon)
* topic(case of 'computer to computer set': weather, news, or MSN chat log)
3. when the choices done, the monitor will be turn around to face other monitor, and
the screen shows eyes(icons) blinking image, and the other side camera capture the screen.
4. LCD screen on the table will print out the translated characters human readable alphabet characters simultaneously.
5. upon to the chatting set, user may can use keyboard to join the conversation.
2. when user push the ‘interruption button’, then monitor will be turn around to user to show the introduction Flash movie let the user choose,
* conversation set(computer to computer, computer to user, user to user)
* language(Flash, Java, C, Director, MAX/MSP)
* icon(eyes, or other than icon)
* topic(case of 'computer to computer set': weather, news, or MSN chat log)
3. when the choices done, the monitor will be turn around to face other monitor, and
the screen shows eyes(icons) blinking image, and the other side camera capture the screen.
4. LCD screen on the table will print out the translated characters human readable alphabet characters simultaneously.
5. upon to the chatting set, user may can use keyboard to join the conversation.
Implementation
When the user finish to choose the conversation setting from the kiosk movie which made with Flash, the information will generate XML file. At same time, Java launches to send commands through serial to rotate turntable under the monitor, and the camera starts to detect the location of the other monitor. When two monitors facing each other and the calibration finished, the java program setup icon upon the XML file the Flash generated makes patterns. Each camera starts to color tracking(mostly blue) to read the pattern and translates back to the alphabet characters every time the other side user typing.This text user typed will be sent to chatting robot (Pandorabot) as a XMl form and the answer will displayed as generating patterns with the eyes icons.
These conversations are displayed on small LCD panels to help user to understand the behind the visual conversation.
These conversations are displayed on small LCD panels to help user to understand the behind the visual conversation.
Conclusion
Through the means of visual representation, any alphabetical letters will be represented by the use of different eye blinking. This eye blinking will indeed mean each letter of a specific word people will try to express. Like chatting over an internet, people do “conversate” by means of typing on a simple keyboard.
This idea will be further developed as a physical forms, such as doll eyes’ blinking using motors or actual lights of buildings.
This idea will be further developed as a physical forms, such as doll eyes’ blinking using motors or actual lights of buildings.
Additional Documents
- Untitled - Main Image