Video Sensing
Objectives:
- Investigate the Possibilities of a Cameras connected to Computers
- Learn Simple Techniques of Computer Vision
- Learn Java Programming using the Eclipse Programming Environment
1: Hello Class
- Possibilities:
- Approaches to Computer Vision:
- Class Structure
- Programming
- Reading Golan, Head First Java p 1-150
- Assignment:
- Hello Java: main
- Hello Eclipse: new project, new class, run
- Hello CVS : share> new repository, update committ
- Extra Credit HelloProcessing, HelloWindow
- Find Example Marie Sester, Zack Booth Simpson Scott Snibbe, Danny Rozin, Golan, Camille Utterback,Shiffman, Dano
- Atlas Gloves, Found Connections, GumSpots, Looking Glass, Now and Then,
Silhouettes, Summary Pixels, TimeScaned, Oriental Scene, Digi Contorni, The Mark,
2:
Architectural
- Assignment: Extend WebCam class. Make a Camera for taking still photos of a space. What spaces are interesting to capture buildings doorways, skies, rooms, highways, power pants, your neighbors apartments, moutains of afganistan, every possible perspective in the world. How is it triggered, timelapse, sound, movement, physcomp rig, or mouse clicks of unemployed peopler. How are they displayed, a sequence, a blending, acollage of sub images and master images, a panorama, or a cubist assembly of many people's perspectives of the same thing. Where are they published, back in the space, on the web, on a phone or on the wall.
- Inheritance you already have been extending PApplet
- Java Graphics, JFrame, Paint Method, BufferedImage
- Asynchronous Callbacks, Implementing Listener methods eg WindowClosing, NewFrame
- Video PipeLine Hardware to Drivers to Quicktime to Java to VXP
- Relationship betwen objects 1) contains "has a" eg PixelSource 3) extends "is a" eg JFrame, WebCam
- Reading: Head First Java p 161- 192, Observing Surveillance, HomeLand Security
- Tech Assigment: Extend WebCam or WebCamDisplay class. Get Video Showing using PixelSource , Try to get some novel trigger or display.
- Examples: files or use the VideoSense_Examples_CVS , the default upload spot
3: Body
- Getting to the pixels.
- Buffers, Graphics, Rasters
- Checking the color of a pixel, thresholds, color space
- Frame differencing, background removal, detect change
- Neighborhood operations, edge dection, blur.
- Reading: Mirror Neurons
- Assignment: Make a electronic glass. files or use the "Mirror" module in VideoSense_Examples_CVS
4: Hands
- Lighting, Manual Cameras, IR, Polarization, Retroreflective ir flood lights
- Grouping Pixels Points, Rectangles
- Reading: Visual Intelligence, Mind Hack
- Assignment: Make a controller. files (Avoid the "Growth" files for this week) or use the "Tracking" module in VideoSense_Examples_CVS
5: Feb 16 Tracking Blobs
- Workshop Midterm
- Noise
- Blobs
- Assignment: Make a controller. files (Avoid the "Growth" files for this week) or use the "Tracking" module in VideoSense_Examples_CV
6: Feb 23 Midterm Workshop
- Work on Projects
- Assignment: Make a midterm
7: March 2 Midterm
8: March 9 Other Hardware Platforms
9: March 23 Other Software Platforms
- Jitter Visit from Luke/Danny
- Student Tech Demos
10: March 30 Other Budgets
- Visit Chris Breugler
- Student Tech Demos
11: April 6 Final Ideas
12: April 13 Final Workshop
13: April 20 Final Workshop
14: April 27 Final Presentation
- On-Time Attendance/Participation 20%
- Intro Projects 15%
- Midterm 20%
- Research 15%
- Final Project 30%
Related Readings: