Paul May
Photo Plus
Photo Plus allows users to record the story of a printed photo, save that story somewhere safe, then retrieve or add to it later.
http://paulmay.org/itp/extending-physical-photos
Classes
Introduction to Physical Computing
Introduction to Physical Computing
I have designed a system that lets a user take a physical photograph, identify it to a computer, add then digital information that refers to that photo (digital audio). Later they can use the PhotoPlus system or a web service to retrieve audio/information related to photo.
* The photograph - a unique key - a tangible way to start the recording process, or the retrieval process.
* A way to recognise the photo - A QRcode printed to an adhesive label, attached to the rear of the photo, being recognised by a webcam.
* Input - A system to record digital information about the photograph. A microphone built into the PhotoPlus system recording mono audio as WAV which is converted to MP3.
* Storage - a place to put the information. Local storage for fast retrieval and a web-service where the user can access audio later.
**Current Status** Video prototype of key interactions completed, 3D model of system complete, system software 75% complete, physical components (barring an illuminated button) in my posession, physical build in progress.
Background
My project deals with these two concepts - the rich experience of printed photos, and the data-storage aspect of physical photos. I want to build a system that extends physical photos - allowing users to add audio stories associated with them, notes and memories; while retaining the printed photo as the key to access this information.
Audience
I see this as a storytelling tool that spans a period of time - or generations. Users are those people with collections of photos they'd like to augment with more information, or people who want to recall that information. They could be same people, or different people at different times.
User Scenario
* Tagging a photo for the first time, recording a story about the photo *
1. Use approaches the PhotoPlus system
2. They push a button to start the system - they are prompted (audio) to place a photo on the mount if they would like to retrieve information about an old photo, or push the button if they'd like to tag a new photo.
3. The user pushes a button indicating that they'd like to tag a new photo
4. An adhesive label is printed with a unique QRcode, and offered to the user by the system.
6. The user is given audio instructions - place the label on the back of the photo, in the centre, with the arrow pointing up, then place it in the mount.
5. The user attaches the label to the back of the photo.
6. The user places the labeled/tagged photo on the mount
7. Once the photo is in the mount the user pushes a button to start an audio recording.
8. The user speaks about the photograph, and when they have finished, they push the button again.
9. The system thanks them (audio) and asks them to remove the photo.
* Retrieving Information About a Photo *
- In this case the user is retrieving information about a photo that has already been tagged with a QRcode and had an audio recording made by the user -
1. Use approaches the PhotoPlus system
2. They push a button to start the system - they are prompted (audio) to place a photo on the mount if they would like to retrieve information about an old photo, or push the button if they'd like to tag a new photo.
3. They place the photo on the rest/mount - they want to retrieve information
4. PhotoPlus retrieves the audio related to the photo
5. The audio is played
6. Once the audio is played the user can remove the photo - ending the scenario - or push a button to record more audio.
Implementation
Internal items - label printer, speaker, microphone, arduino, cabling. Housing is made of pine board.
Conclusion
My main goals are to execute the concept - to see how a printed photo can be extended to add digital information. I am interested in creating a system that uses a physical item as its key interface metaphor. I hope to discover some of the complexity involved in asking users to carry out actions without being prompted by a screen.
* The photograph - a unique key - a tangible way to start the recording process, or the retrieval process.
* A way to recognise the photo - A QRcode printed to an adhesive label, attached to the rear of the photo, being recognised by a webcam.
* Input - A system to record digital information about the photograph. A microphone built into the PhotoPlus system recording mono audio as WAV which is converted to MP3.
* Storage - a place to put the information. Local storage for fast retrieval and a web-service where the user can access audio later.
**Current Status** Video prototype of key interactions completed, 3D model of system complete, system software 75% complete, physical components (barring an illuminated button) in my posession, physical build in progress.
Background
My project deals with these two concepts - the rich experience of printed photos, and the data-storage aspect of physical photos. I want to build a system that extends physical photos - allowing users to add audio stories associated with them, notes and memories; while retaining the printed photo as the key to access this information.
Audience
I see this as a storytelling tool that spans a period of time - or generations. Users are those people with collections of photos they'd like to augment with more information, or people who want to recall that information. They could be same people, or different people at different times.
User Scenario
* Tagging a photo for the first time, recording a story about the photo *
1. Use approaches the PhotoPlus system
2. They push a button to start the system - they are prompted (audio) to place a photo on the mount if they would like to retrieve information about an old photo, or push the button if they'd like to tag a new photo.
3. The user pushes a button indicating that they'd like to tag a new photo
4. An adhesive label is printed with a unique QRcode, and offered to the user by the system.
6. The user is given audio instructions - place the label on the back of the photo, in the centre, with the arrow pointing up, then place it in the mount.
5. The user attaches the label to the back of the photo.
6. The user places the labeled/tagged photo on the mount
7. Once the photo is in the mount the user pushes a button to start an audio recording.
8. The user speaks about the photograph, and when they have finished, they push the button again.
9. The system thanks them (audio) and asks them to remove the photo.
* Retrieving Information About a Photo *
- In this case the user is retrieving information about a photo that has already been tagged with a QRcode and had an audio recording made by the user -
1. Use approaches the PhotoPlus system
2. They push a button to start the system - they are prompted (audio) to place a photo on the mount if they would like to retrieve information about an old photo, or push the button if they'd like to tag a new photo.
3. They place the photo on the rest/mount - they want to retrieve information
4. PhotoPlus retrieves the audio related to the photo
5. The audio is played
6. Once the audio is played the user can remove the photo - ending the scenario - or push a button to record more audio.
Implementation
Internal items - label printer, speaker, microphone, arduino, cabling. Housing is made of pine board.
Conclusion
My main goals are to execute the concept - to see how a printed photo can be extended to add digital information. I am interested in creating a system that uses a physical item as its key interface metaphor. I hope to discover some of the complexity involved in asking users to carry out actions without being prompted by a screen.