4 Point

This is an environment for students to work on their existing project ideas that may fall outside the topic areas of existing classes. It is basically like an independent study with more structure and the opportunity for peer learning. This particular studio is appropriate for projects in the area of interactive art, programing, physical computing and digital fabrication. There are required weekly meetings to share project development and exchange critique. Students must devise and then complete their own weekly assignments updating the class wiki regularly. They also must present to the class every few weeks. When topics of general interest emerge, a member of the class or the instructor takes class time to cover them in depth. The rest of the meeting time is spent in breakout sessions with students working individually or in groups of students working on related projects.

Interactive technologies seldom stand alone. They exist in networks, and they facilitate networked connections between people. Designing technologies for communications requires an understanding of networks. This course is a foundation in how networks work. Through weekly readings and class discussions and a series of short hands-on projects, students gain an understanding of network topologies, how the elements of a network are connected and addressed, what protocols hold them together, and what dynamics arise in networked environments. This class is intended to supplement the many network-centric classes at ITP. It is broad survey, both of contemporary thinking about networks, and of current technologies and methods used in creating them.

Prerequisites: Students should have an understanding of basic programming. This class can be taken at the same time as, or after, Intro to Computational Media or an equivalent intro to programming. Some, though not all, production work in the class requires basic programming. There is a significant reading component to this class as well.

Learning Objectives

In this class, you will learn about how communications networks are structured, and you will learn how to examine those structures using software tools. By the end of this class, you should have a working knowledge of the following concepts:

* The basics of network theory, some history of the internet and the organizations and stakeholders involved in its creation and maintenance
* The Open Systems Interconnect (OSI) model and standard internet protocols such as Internet Protocol (IP), Transmission Control Protocol (TCP) , Universal Datagram Protocol (UDP), and Hypertext Transport Protocol (HTTP). 
* Network addressing, private and public IP addresses
* What hosts, servers, and clients are and a few ways in which they communicate
* What a command line interface  (CLI) is and how to use the tools available in one
* The basics of internet security
* How telecommunications networks are similar to other infrastructural networks, like power and transportation, and how they are different.

Recent years have seen unprecedented advancements in text-to-image / text-to-video AI models, sparking widespread attention, discussion, and mainstream adoption of these innovative co-creative tools. This has led to a mix of reactions, ranging from excitement and curiosity to concern, anger, and even offense. Alongside this, the growth of open-source models is democratizing access to these AI tools, extending their use beyond experts, tech giants, and professional technologists.

In this 14-week course, we will go over the landscape of text-to-image / text-to-video AIs and dive deep into some of the most well known ones (such as Stable Diffusion, Flux, CogVideoX, Hunyuan, etc.), to see what potential they have in terms of exploring new modes of content creation and helping us re-examine our language pattern. This will be a practice + technique course comprised of three modules: Text-to-Image AIs and Tools, Model Customization, and Text-to-Video AIs. In each module, there will be a hybrid of practice + technique sessions that focus on different topics such as building good prompting practices, image synthesizing, using Python to train models for customized visuals, building workflows with ComfyUI, and creating animations from text. We’ll also discuss how such tools could intervene in the workflows of artists and technologists, what they can provide for researchers, and what are the caveats and things we should look out for when we’re creating with these AIs.

Pre-requisites: Introduction to Computational Media (ICM) or the equivalent.

“A computer is a clock with benefits” writes Paul Ford in Bloomberg’s issue dedicated to code. Time, at once fundamental and mysterious, is of course a basic part of any time-based media, but uniquely more so for programmed media that can evolve as it runs. In this course, we’ll reflect on the deep mysteries of time while also building hands-on skills that will improve our command of temporal media and technologies.

Specific topics will range from the marvelous engineering of historical clocks and orreries through modern computer architecture. We’ll draw inspiration from a technological tradition stretching back at least 2000 years to the Antikythera Mechanism that includes humanity’s earliest efforts to understand temporal patterns in nature. Practically, we’ll build mechanical and software clocks; experiment with time-series data and time protocols; and survey techniques for digital signal processing and software state transitions.

Students will improve their skills in:

– Extracting meaning from data in time-series sets, like sequential sensor readings in a physical computing project or a public API;
– Creating experiences with a beginning, middle and end; a narrative arc;
– Getting to the “metal” in microcontrollers and CPUs;
– Integrating real-time clock modules and network time protocols with projects;
– Using programmatic timelines and variable ‘tweening’ to add grace and sophistication to our creations

Students will execute production assignments throughout the semester. Students should have taken or be taking physical computing, a programming course, or have equivalent experience.

Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048) & Intro to Phys. Comp. (ITPG-GT 2301)

This class asks students to think about thinking. Based on first person introspection, meditation and readings in psychology, students will examine the experience of their minds. Then we look at how computation, in particular recent developments in AI, can better work as a medium to capture and share that experience. Class time is evenly divided between conceptual discussions around the psychology of media, looking at student work, and then learning coding skills for the following week. The early course materials direct students towards developing and implementing multi-user web apps to improve our society’s social media ecosystem but final projects often take different directions. 

On the technical side, the class gently picks up from any introductory javascript coding class.  Compared to Creative Computing it moves away from the p5.js in favor of vanilla javascript in an environment like Visual Studio Code assisted by AI.  The class encourages students to find a healthy balance of using “vibe coding” while maintaining the ability to specify overall architecture and debug individual lines of code. In particular the technologies covered are Replicate.com’s API’s for Machine Learning Models for generation and relation of text and images, Firebase tools for server based databases, realtime sharing, storage and authentication. Libraries like UMAP for dimension reductions, Three.js for realtime rendering, P5LiveMedia for Audio and Video sharing, and Colab for running python notebooks.

Each week students will post a quick sketch experimenting with the technology as well a short written response to a prompt based on a short reading or video.

The most difficult part of prototyping is not the building process, but the process of deciding how to build. If we choose proper technology for prototypes, we can improve their robustness and simplicity.

This course will cover available and affordable technologies for ITP students to build prototypes. The course will start with soldering, wiring and LED basics. Then students will design an Arduino compatible board in Eagle, get it fabricated, assembled. And then using the debugger to dig deeper to understand how a microcontroller works.

The class will also cover multitasking, signal processing, communication, document writing and advanced skills beyond the Intro to Physical Computing class.

Each session will have lectures followed by in-class practices with guidance. The 14-week long assignment is called Do It Once – Do It Again. Bringing an idea or ongoing projects is highly encouraged.

This course requires Physical Computing or equivalent experience.

Prerequisite: Intro to Phys. Comp. (ITPG-GT 2301)

In this course students create digital musical instruments and do a live performance using them. Over the semester, we look at examples of current work by creators of musical interfaces, and discuss a wide range of issues facing technology-enabled performance – such as novice versus virtuoso performers, discrete versus continuous data control, and the relationship between musical performance and visual display. Readings and case studies provide background for class discussions on the theory and practice of designing controllers for musical performance. Students design and prototype a musical instrument – a complete system encompassing musical controller, algorithm for mapping input to sound, and the sound output itself. A technical framework for prototyping performance controllers is made available. Students focus on musical composition and improvisation techniques as they prepare their prototypes for live performance. The class culminates in a musical performance where students (or invited musicians) will demonstrate their instruments. Prerequisites: ITPG-GT.2233 (Introduction to Computational Media) and ITPG-GT.2301 (Physical Computing)

Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048) & Intro to Phys. Comp. (ITPG-GT 2301)

Just a friendly heads up for this class: Unreal Engine experience is necessary because it is our primary tool for both creating and experiencing projects during the semester. If you don’t have a solid understanding by September 2026 you will likely fall behind and it won’t be as fun 🙂

In this course, we will explore how to create immersive narratives that leverage our full suite of senses like touch, taste and smell as well as lesser-known ones like space, time, balance and scale. We will dig into the history of experiential storytelling, starting from immersive theater and Smell-O-vision to cutting-edge haptics and mind-bending illusions of proprioception. To help center this back in practical applications, we will also explore how this evolving art is commonly used in exhibition design, experiential marketing and brick and mortar retail. The class will be a healthy mixture of game theory and experience-based learning (meaning there will be field trips and many multisensory VR projects to explore).
Some AI tools will commonly be taught and implemented. I strongly encourage their use on the production side, not the creative side. 

We will dig into the process of making the immersive experiences Forager (SXSW, NAB, SIGGRAPH) and Tree VR ( Sundance, Tribeca, TED), looking at both the project files and all the work that went into ideation and pre-production. 
All of this will culminate in a show exhibiting all your final projects in the Media Commons ballroom.

As game and interaction designers we create systems and choices that can either prey upon our psychological foibles or help us avoid decision pitfalls. It is our responsibility to understand how we decide, to consider the ethics of the systems we create and to practice designing systems in a purposeful manner.

Game Design & The Psychology of Choice will provide interaction and game designers with an understanding of the factors that influence behavior and decision-making by looking at the intertwining of cognitive psychology and economics through the development of behavioral economics. These disciplines study behavior on the individual and group level, often revealing some of the why behind the rules of thumb and folk wisdom that game designers come to intuitively. But understanding the why—why we fall into decision traps; why certain tradeoffs tax our brain more than others; why we are overconfident about our abilities; why certain decisions make us uncomfortable—allows us to more purposefully apply our design craft, both in and out of games. Finally, as a class, we will take what we learn about how we think and create series of game experiences based around key cognitive science concepts.

Assignments may include:
•Mod a cognitive science experiment into a game or experience
•Analyze and present a game through the lens of cognitive science and behavioral economics
•Create game or experience based around a particular insight from cognitive science or behavioral economics

Throughout history, musicians have channeled their creativity into outrageous fashion statements and invented personas: think MF DOOM, Sun Ra, Ghostface Killah, Daft Punk, Leikeli47 and Rammellzee. By embracing their alter egos in extreme and outlandish ways, artists have found their authentic creative voices. This course will introduce participants to the art of masquerade using their resourcefulness to create costumes from found materials, and performance as an exploration in creative expression using new media and technology. Students will be introduced to ideas surrounding abstract storytelling, experimental audio + video production, and A/V performance using a combination of technical and hands-on approaches.

This course requires CL: Hypercinema or equivalent experience.

Prerequisite: CL: Hypercinema (ITPG-GT 2004)