Physical Computing +

David Rios | Syllabus | IMNY-UT.245 |
Last updated: November 15, 2024

This course expands the students’ palette for physical interaction design with computational media. We look away from the limitations of the mouse, keyboard and monitor interface of today’s computers, and start instead with the expressive capabilities of the human body. We consider uses of the computer for more than just information retrieval and processing, and at locations other than the home or the office. The platform for the class is a microcontroller, a single-chip computer that can fit in your hand. The core technical concepts include digital, analog and serial input and output. Core interaction design concepts include user observation, affordances, and converting physical action into digital information. Students have weekly lab exercises to build skills with the microcontroller and related tools, and longer assignments in which they apply the principles from weekly labs in creative applications. Both individual work and group work is required.

Prerequisites: Creative Computing, or equivalent knowledge/experience

Topics in Physical Computing and Experimental Interfaces: Interaction as Art Medium +

While traditional forms of art such as painting and sculpture only expect intellectual communication with the spectator, interactive arts consider the audience as active participants and directly involve their physical bodies and actions. Interactive art invites its audience to have a conversation with the artwork or even be part of it. Well designed interactions add new meanings to the artwork and enhance effective and memorable communication with the viewer through their magical quality.

Artists have achieved interactivity in their art through different strategies based on various technologies. For example, some projects have physical interfaces such as buttons and knobs, some projects react to the audience’s presence or specific body movements, and yet others require collaborations between the audience as part of the interaction process. Some artwork involves interactions that require a long period of time for the engagement. In many of these interactive art projects, interaction methods are deeply embedded into the soul and voice of the work itself.

In this class, we will explore interaction as an artistic medium. We will be looking at interactive media art history through the lens of interaction and technology to explore their potential as art making tools. Every other week, you will be introduced to a new interaction strategy along with a group of artists and projects through lectures, discussions, and a field trip. During in-class labs and a mini hackathon, you will learn about relevant technologies and skills for the interaction strategies and build your own project to be in conversation with the artists and projects. You will also explore and discuss the future of interactions and how interactive art can contribute to innovations in interactions, and vice versa. You will also learn about how to contextualize, articulate, and communicate your project in an artistic way.

Technical topics covered in class include but are not limited to: physical computing, sensor research, sensor programming, interaction design, and body tracking using cameras (on p5.js), using depth cameras.

Learning Objectives
Critically approach and examine different interaction strategies in interactive artwork
Obtain sensibilities and techniques to translate abstract idea into interactive form (installations, objects, or systems) that is engaging to the audience
Experiment with innovative forms and artistic possibilities of interaction
Effectively utilizes computer programming, electronic circuit design, and sensors to complete an interactive project
Practice contextualizing and articulating artistic creations
Prerequisite

Creative Computing (IMA) or equivalent knowledge.

Course Requirements

This class meets once a week for 3 hours for 14 weeks. Class meetings consist of lectures, demos, in-class labs, reading discussions, feedback sessions for assignments, and group activities. There will be a mini hackathon and a field trip. Students are expected to actively participate in class, participate in discussions, prepare lab materials such as physical computing components, create their own projects, and turn in weekly assignments. Students are encouraged to book office hours with the instructor, GA, or ITP residents to ask questions, connect better with the class, and/or seek support.