Light and Interactivity (ITPG-GT 2133)

Credits: 4
Duration: 15 Weeks
Dates: Tue

We use light in all aspects of our lives, yet we seldom notice it. Most of the time, that’s no accident. Lighting in everyday life, well-designed, doesn’t call attention to itself. Instead it draws focus to the subjects and activities which it supports. In this class, you’ll learn how lighting is used for utilitarian, expressive, and informational purposes. We’ll consider the intersection of lighting design and interaction design, paying attention to how people interact with light. We’ll practice both analyzing lighting and describing its effects, in order to use it more effectively. On the technical side, you’ll learn the basics of the physics of light, its transmission and perception. We’ll talk about sources of light, both current and historical. We’ll work with computerized control systems for lighting and modern light sources, and we’ll create a number of lighting designs for different purposes. You’ll get practice building AC and DC electronic circuits, programming microcontrollers for physical interaction, and learning digital communications protocols such as DMX512 and HTTP and REST. Projects in this class will range from indicator lighting on devices to task and wayfinding lighting in everyday environments to stage and environmental lighting. We won’t spend time on projection or light used for purely expressive purposes, but will look at how to put light to work instead. We’ll focus our attention on lighting the subject at hand, whether that subject is a person, a living environment, or a workspace. This class will be production-intensive throughout the course of the spring semester. Second-year students will not be able to combine the assignments in this class with their thesis projects, though some of the skills may be complementary.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Exploring Concepts From Soft Robotics (ITPG-GT 2125)

Credits: 4
Duration: 14 Weeks
Dates: Fri

Because the full potential of the emerging field of soft systems is unrealized, there are countless opportunities for curious innovators to discover or develop novel soft systems. Soft robotic skills and techniques also open up a world of possibilities for large scale or surprising artwork. This course teaches hands-on fabrication techniques for constructing simple pneumatic actuators from cast silicone and heat-sealed mylar, and challenges participants to design and build their own. Lectures and discussion center on concepts from soft innovation history, the current state-of-the-art, and sister disciplines of bio-inspired and hybrid (soft/hard) robotics. Consideration of both brand new soft materials, from a class visit to Material ConneXion library, and everyday overlooked soft mechanisms, found in average retail stores, will require participants to look at softness through a new lens. Final projects will be the development of an original soft/flexible/hybrid research or artistic concept presented with context, material swatches with justifications for choices, and physical or modeled proof-of-concept. About Kari Love: http://www.karimakes.com

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

BioDesigning the Future of Food (ITPG-GT 2131)

We’ve been tinkering with the living systems that generate our foodstuffs for millennia. But climate change is radically and rapidly shifting these food landscapes, and the impacts include the extinction of many of the foods we love: chocolate, wine, beer, coffee and more importantly starvation for those in the world who are already food insecure. In this class, we’ll explore biotechnologies and bioengineering along with microbes and mushrooms to design and create pathways for the restoration of some of the damage we’ve wrought on our food system. We’ll also use art and design and systems thinking to build speculative and actionable projects that will focus not just on the future of food but the future of our planet and all of its inhabitants. This class is part of the Biodesign Challenge.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Summer 2021)


ITPG-GT 2131-000 (6365)05/24/2021 – 07/05/2021 Tue6:00 PM – 9:00 PM (Evening)at OnlineInstructed by Bardin, Stefani R

Electronic Rituals, Oracles and Fortune-Telling (ITPG-GT 2120)

According to anthropologists Filip de Boeck and René Devisch, divination “constitutes a space in which cognitive structures are transformed and new relations are generated in and between the human body, the social body and the cosmos.” In this class, students will learn the history of divination, engage in the practice of divination, and speculate on what forms divination might take in a world where the human body, the social body, and even the cosmos(!) are digitally mediated. Starting with an understanding of ritual and folk culture, we will track the history of fortune-telling from the casting of lots to computer-generated randomness to the contemporary revival of Tarot; from reading entrails to astrology to data science; from glossolalia to surrealist writing practices to the “ghost in the machine” of artificial intelligence. Weekly readings and assignments culminate in a final project.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2120-000 (22892)01/27/2020 – 05/11/2020 Tue12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Parrish, Allison

Hacking the Browser (ITPG-GT 2811)

Web browsers were originally used only for displaying simple HTML pages, but over the years they have become supercharged all-powerful web execution machines. In this class we’ll explore experimental new features and HTML5 APIs that allow browsers to communicate with the OS and their environment. APIs that will be covered may include: Battery Status, Geolocation, notifications, accelerometer usage, video access, speech recognition, and text-to-speech. We’ll cover the mechanics of bookmarklets and Chrome extensions, with a sustained multi-week focus on building extensions and exploring Chrome’s extensions APIs. Class workshops will include projects such as building an ad blocker, programmatically replacing text and images on a website, and making sites that respond to external events. Students will give weekly in-class presentations on web capabilities, complete small weekly assignments, and present a final project. This class leans heavily on web technologies, and experience with HTML, CSS and modern JavaScript (ICM with p5.js or Commlab Web/Networked Media) is required.

Interactive Telecommunications (Graduate)
2 credits – 5 Weeks

Sections (Spring 2020)


ITPG-GT 2811-000 (22881)01/28/2020 – 03/03/2020 Tue6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Forsyth, Cory

Open Source Cinema (ITPG-GT 2865)

The medium of motion pictures will be will be transformed by virtual reality technologies. But the emerging hybrid form will likely have less to do with the iconic VR headset and immersion, than in the newly possible flow of expression in the other direction, out of the participant. This class looks at the true potential of virtual reality as its mutability, to put ordinary users in the role of director of visual media as they already are in their dreams and fantasies. Democratizing media by breaking it down into discrete more easily remixable parts has historically, from DNA to alphabets to movable type led to an explosion of expression and knowledge creation. Motion pictures, perhaps our most convincing medium, is now undergoing such a transformation thanks to virtual reality technologies. Specifically, we will look at how tools like depth cameras, motion capture, and machine learning can treat a scene as a collection of elements instead of a collection of pixels. We will work with the real-time 3D rendering capabilities available, even in your phone, for the instant contrivance of visual reality using compositing, the transformation of images and models as well as virtual camera moves. The class will also consider how the more conceptual dissection of film by cinema scholars and psychologist into things like plots and character types might be templated into reusable formulas for non-experts to create an emotionally satisfying dramatic arcs.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2865-000 (22861)03/25/2020 – 05/06/2020 Wed3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by O’Sullivan, Daniel

100 Days of Making (ITPG-GT 2793)

Credits: 2
Duration: 6 Weeks
Dates: Tue

Iteration and its impact on your creative process is the theme of this class. The format of the course turns its head on the traditional class structure and instead of focusing on syllabus that builds to a final project, the course is focused on a daily, iterative practice. Students will identify a theme, idea or topic they would like to explore over the course of 100 days and must commit to making or producing a variation on that idea and posting social evidence of their work every day for 100 days. Projects can focus on building, writing, drawing, programming, photographing, designing, composing or any creative expression. In parallel to the making, in-class lectures will examine the work of artists whose work has been defined by iteration and discuss the role of discipline and routine in the creative process.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Subtraction (ITPG-GT 2719)

Subtractive fabrication is a common manufacturing process that produces durable and functional objects. This class will cover multiple techniques on machining and milling raw material into custom parts. We will focus on both traditional and digital fabrication tools: lathe, CNC router, 4 axis mill, etc. We will cover CAD, CAM, and machine setups as well as research affordable desktop milling solutions for personal shops. The class will be hands on and fabrication heavy, paying close attention to precision, accuracy, and craftsmanship. There will be weekly fabrication exercises, a midterm, and a final project. It’s mill-er time.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2719-000 (22906)01/30/2020 – 05/07/2020 Thu9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Light, Benjamin

Homemade Hardware (ITPG-GT 2767)

Hardware is not hard, and rapidly prototyping circuit boards is easier than ever with new tools available at ITP. Students will learn how to grow from a breadboard to a custom surface mount board, all without leaving the floor. This class is about artists and designers taking control of their hardware, and exploring the potential of embedding their projects into the world around them. Students will learn the multitude of tools and processes required to make a DIY circuit board. These include Eagle CAD, micro-milling machines, drawing schematics, ordering parts, surface-mount components, acid etching, solder paste and stenciling, reflow, pick-and-place, and others. In-class demonstrations will be done for each of the above, and students will complete assignments using online reference notes and videos. Two smaller projects and one final project will be assigned (3 total), each a circuit of the student’s’ choosing. These three assignments will be designed to work off the most recently taught subjects, and to get the students to fail early. It’s a lot of new material to be learning across multiple domains, so the students will need the entire semester to iterate.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2024)


ITPG-GT 2767-000 (14754)01/26/2024 – 05/03/2024 Fri9:00 AM – 12:00 AM (Morning)at Brooklyn CampusInstructed by Sigler, Andrew

Dynamic Web Development (ITPG-GT 2577)

Credits: 2
Duration: 6 Weeks
Dates: Fri

This 7-week, 2-point course will provide a framework for learning how to develop and program web applications. It will focus on server side development using JavaScript, Node.js with the Express framework, and persistent databases on cloud based infrastructure. Additional topics will include login and session management, web services and APIs, and will lightly touch on front-end web development. The course will be a mixture of lecture and in-class collaborative coding, with weekly programming and reading homework.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Rest of You (ITPG-GT 2975)

You live with illusions. The nature of these illusions has long been described in mystical practices but is now increasing corroborated by modern research such as neuroscience, behavioral economics, social psychology, embodied cognition, and evolutionary psychology. What does this have to do with computational media? With technology, we have the ability to revisit some of these vestigial illusions that made sense in ancient environments but that might limit our personal happiness or the overall functioning of modern society. Will the computer’s ability to run more objective statistical analysis on data gathered tirelessly over time, across individuals and locations allow us to more accurately see ourselves and the world as it is. Can we build computer interfaces that give a fuller expression of our experience when we are not limited by an illusory view of ourselves? The insights into how into how to reach people more fully comes with a responsibility to then ask what should say to them. As the computers are able to understand us better than we understand ourselves will we relinquish control to them? At a practical level, the class looks at interfaces for digitizing signals from the less consciously controlled parts of your body using things like biosensors and cameras. It then moves on to opportunities for finding insights in from patterns in the mounds of already digitized expression you have produced every day for years, for instance in your email. Then we look at the possibility of bypassing consciousness with techniques like subliminal priming to affect behavior. Finally, we will look at how we can use things like browser extensions to manipulate shared media in an attempt to counter some filter bubble effects that emerge at a group level based on the illusions discussed in this class. This class will use skills from Physical Computing and ICM.

Interactive Telecommunications (Graduate)
2 credits – 8 Weeks

Sections (Spring 2020)


ITPG-GT 2975-000 (22862)01/27/2020 – 03/23/2020 Mon3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by O’Sullivan, Daniel

Connected Devices and Networked Interaction (ITPG-GT 2565)

Credits: 4
Duration: 15 Weeks
Dates: Tue

The World Wide Web no longer stops at the edge of your screen. When it comes to products, if it powers up, it talks to another device. This class provides an overview of methods for connecting the physical world to web-based applications. We’ll consider what the emerging interaction patterns are, if any, and we’ll develop some of our own as needed. This class can be seen as a narrower and more interaction design-based complement to Understanding Networks. The latter class provides a broader overview of the dynamics of communications networks, while this class focuses specifically on the challenges of connecting embedded devices to web-based services. Neither class is a prerequisite for the other, however. This class will introduce network connection techniques for devices using microcontrollers like the Nano 33 IoT and MKR series or ESP8266 and processors running an embedded operating system like the Raspberry Pi. Prerequisites: Intro to Physical Computing and Intro to Computational Media, or equivalent experience with the topics covered in those classes. Learning Objectives: Students will gain an understanding of the basics of network programming for devices with limited computing power. They will learn about current protocols for communication between devices and networked servers, and about the rudiments of security for that communication. Reading: There will be an article or two to read each week, to foster discussion about the design of connected things. Assignments: There will be several one-week software and hardware assignments to get familiar with different technologies and communications protocols, and one hardware and software final application project.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Playful Communication of Serious Research (ITPG-GT 2974)

Credits: 4
Duration: 14 Weeks
Dates: Mon

Exhibition design is the art of marrying experience and information. The best do so seamlessly; the very best surprise and delight you along the way. In this class you will explore the craft of interactive exhibition design through practice. Working in small groups, you will select an NYU researcher whose work is of interest to you and create an interactive experience that presents this research to a broader, public audience. In the process, you will learn to interrogate content and form, audience and environment, medium and message to create a meaningful and playful exhibit experience.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Comics (ITPG-GT 2925)

Code without content gets boring fast. This seven week course will show you how to create stories around which you can weave the technology learned in other classes. When content comes first, interesting problems arise to solve. Participants will get solid grounding in how to tell a visual story using words and images in a traditional format, so then they can take that format and reimagine it in entirely new and unique ways. The first few classes are devoted to getting basic comic skills. The remaining classes will hone and expand these abilities while posing the question: what can be done differently, and how can technology add to what we have created? At the end of the semester you will have a something that sets you apart; – original content AND technological know how. Students will combine words and images, look at each other’s work, look at examples of published works. Reimagine how these stories can be told in new and unique ways. This a demanding course. There is a lot of work involved, they will end up with a lot of original content. During the first half we look at and make traditional comics. Second half we experiment with comic format WHILE honing storytelling skills. Relevant speakers will come in to discuss what they do and how they work etc.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2925-000 (22870)01/28/2020 – 03/10/2020 Tue9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by White, Tracy

Recurring Concepts in Art (ITPG-GT 2586)

As a response to developing technologies, artists working in areas of new/digital media are continually inventing new concepts for self-expression – interactivity, the passage of time and resolution, just to name a few. Yet these concepts are new only in the sense that they are being adapted to new media. For example, the notion of interactivity, frequently observed as original and specific to the user-interaction component of computer-mediated works, was equally, if differently, specific to Gianlorenzo Bernini’s 17th-century Baroque sculpture and architecture. Indeed the very concept of new media, and the concomitant implication of critically significant artistic development, applies throughout history. Oil revolutionized painting in the Renaissance, as did house-paint (on canvas) in the 1950s; in the 1910s, the found object indelibly altered definitions of art, the importance of the object being subsumed by that of the concept in the 1960s. This course examines how artists working before the boom of digital technology utilized other media, techniques and approaches to effect formal, conceptual and experiential dynamics comparable to those being investigated by new media artists today. The objective of the course is to provide students with not only knowledge of the immensely rich history of artistic creativity, but also a platform through which that knowledge might be utilized to reconsider new media strategies of artistic expression. It is the goal that through observation, discussion, reading and projects (both written and hands-on), students acquire mental tools to approach their own work with an expanded understanding of artistic possibility. Organized thematically, each class focuses on a different concept derived from the field of new media production and examined with regard to artistic precedents. The course focus primarily, though not exclusively, is on 20th/21st-century art. It is conducted as a combination lecture/discussion class. Critical theory is incorporated into the readings and discussions, but this is not strictly a theory course. The course has been conceptualized and designed to enhance understanding through a variety of means, from basic observation, to exploratory conversations, to more rigorous thinking informed by lectures, readings and focused discussions.

Interactive Telecommunications (Graduate)
2 credits – 5 Weeks

Sections (Spring 2020)


ITPG-GT 2586-000 (23425)01/31/2020 – 03/06/2020 Fri9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Krantz, Georgia

The Nature of Code (ITPG-GT 2480)

Credits: 4
Duration: 14 Weeks
Dates: Wed

Can we capture the unpredictable evolutionary and emergent properties of nature in software? Can understanding the mathematical principles behind our physical world world help us to create digital worlds? This class focuses on the programming strategies and techniques behind computer simulations of natural systems. We explore topics ranging from basic mathematics and physics concepts to more advanced simulations of complex systems. Subjects covered include physics simulation, trigonometry, self-organization, genetic algorithms, and neural networks. Examples are demonstrated in JavaScript using p5.js (https://p5js.org). Much of the class time will be dedicated to in-class exercises and self-study as the course is available online through a video series (https://www.youtube.com/user/shiffman/playlists) and textbook (http://natureofcode.com/book).

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Cabinets of Wonder (ITPG-GT 2470)

Credits: 4
Duration: 14 Weeks
Dates: Wed

If you were inventing a museum today, what would it look like? Who would be there? What would its main purpose be? What would the audience experience? The first museums were called Cabinets of Wonder. Usually, a viewer with a guide, often the collector, would open doors and drawers to see what was inside–amazing things from different parts of the world, different times. They were windows on the world to places the visitors would probably never be able to go; to see things they would never otherwise be able to see. And now there’s television, movies, the internet, and travel. Why do people go to museums now? Will they in the future? Today, most museums seek to educate and to include more and more diverse visitors than they used to. How do people learn in public spaces? How do we know that they do? How can they make use of the new interactive technologies to support the experience and not lose what’s special about them? The class is an exploration, observation, theory, and design class for you to imagine the future of museums and exhibits. Museum and exhibit visits are your primary assignments for the first half of the course—usually accompanied by a reading. You will also make some record of your visit (including a sketchbook, a diorama, reviews). There will be guest speakers from Museums and exhibit design firms, and several field trips. In the second half of the course, you begin to imagine how you might reinvent a museum and develop a full-scale presentation of your own Cabinet of Wonder. About Emily Conrad: https://www.linkedin.com/in/emily/

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Energy (ITPG-GT 2466)

Credits: 4
Duration: 14 Weeks
Dates: Mon

From the most ephemeral thought to the rise and fall of civilizations, every aspect of your life, and indeed the universe, involves energy. Energy has been called the “universal currency”by prolific science author Vaclav Smil, but also “a very subtle concept… very, very difficult to get right” by Noble physicist Richard Feynman. It is precisely this combination of importance and subtlety that motivates the Energy class at ITP. Maybe you fear the existential threat of anthropogenic climate change, or maybe you just want your pcomp projects to work better. Either way, the class will help you understand energy quantitatively and intuitively, and incorporate that knowledge in your projects (and perhaps your life). How? Building on skills introduced in Physical Computing, we will generate and measure electricity in order to see and feel energy in its various forms. We will turn kinetic and solar energy into electrical energy, store that in batteries and capacitors, and use it to power projects. We will develop knowledge useful in a variety of areas, from citizen-science to art installations, and address topics such as climate change and infrastructure access through the lens of energy. Students will build a final project using skills learned in the class. To accommodate pandemic restrictions, students will have the option to do more or less hands-on work or research as their situation allows, and support material such as an annotated supply list will help students tailor material expenses to their interests. Prior Physical Computing or equivalent experience required.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Live Image Processing & Performance (ITPG-GT 2422)

This course teaches the ins and outs of using image processing software with an aim towards some type of real-time use (e.g. a performance or installation). The class looks at ways to manipulate different visual media (time-based, still, vector, and rendered) in real-time to allow students to develop interesting real-time performance systems. While the focus of this class is on using Max for visual work (through a software package called Jitter), it also looks at how to integrate interactive elements (sound, physical interfaces, etc.) into the work. Class time is spent on interface design and software development issues as well. The class explores some interesting capabilities of the software in terms of real-time camera input and tracking, generative graphics systems, and media transcoding. Throughout the class students develop and share ideas on live performance as a medium for visual expression, and learn the software tools necessary to put these ideas into practice in the form of idiosyncratic performance systems. A final presentation in the form of a group performance will be arranged. Students should have some working knowledge of Max/MSP before taking this class.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2422-000 (22920)01/29/2020 – 05/06/2020 Wed12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Romein, Matt