The course focus is on the design and creation of digital musical instruments. Music in performance is the primary subject of this class. We approach questions such as “What is performance?” “What makes a musical interface intuitive and emotionally immediate?” and “How do we create meaningful correlations between performance gestures and their musical consequences?” Over the semester, we look at many examples of current work by creators of musical interfaces, and discuss a wide range of issues facing technology-enabled performance – such as novice versus virtuoso performers, discrete versus continuous data control, the importance of haptic responsiveness as well as the relationship between musical performance and visual display. Extensive readings and case studies provide background for class discussions on the theory and practice of designing gestural controllers for musical performance. Students design and prototype a musical instrument – a complete system encompassing musical controller, algorithm for mapping input to sound, and the sound output itself. A technical framework for prototyping performance controllers is made available. Students focus on musical composition and improvisation techniques as they prepare their prototypes for live performance. The class culminates in a musical performance where students (or invited musicians) will demonstrate their instruments. Prerequisites: H79.2233 (Introduction to Computational Media) and H79.2301 (Physical Computing). Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048) & Intro to Phys. Comp. (ITPG-GT 2301)
This course expands the students’ palette for physical interaction design with computational media. We look away from the limitations of the mouse, keyboard and monitor interface of today’s computers, and start instead with the expressive capabilities of the human body. We consider uses of the computer for more than just information retrieval and processing, and at locations other than the home or the office. The platform for the class is a microcontroller, a single-chip computer that can fit in your hand. The core technical concepts include digital, analog and serial input and output. Core interaction design concepts include user observation, affordances, and converting physical action into digital information. Students have weekly lab exercises to build skills with the microcontroller and related tools, and longer assignments in which they apply the principles from weekly labs in creative applications. Both individual work and group work is required.
A site for IMA NY Students to find equivalent courses outside of IMA NY
For most students joining IMA in Fall 2022 and beyond, there is a new program structure that affects the categorization of courses on this site:
Any class in any IMA major elective category (ie "Art & Design") refers to the IMA program structure previous to those entering in Fall 2022. If you are in the class of 2026 (most entering Fall 2022 or later), any course in an IMA elective category are generic IMA electives in the new structure.