Bioprinting & Biofabrication for Artists & Designers (Topics in ITP) +

Matt Griffin | Syllabus | ITPG-GT.2379 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: March 21, 2025

Biofabrication has existed as a concept for a very long time to refer to technologies for fabricating living tissue constructs, with the aim of creating entire solid organs. But only within the past fifteen years have scientists and engineers created machine platforms suited to repeatable results that bring them closer to their goals, bringing into existence 3D bioprinters with a wide array of strategies and materials. Some of this development was made possible by scientists modifying, manipulating, or reverse engineering open-source 3D printers and RepRaps to create the equipment they needed. (Technology that many at ITP may already have familiarity with.) The initial machine-assisted fabrication stage is often only the starting point for much longer research studies in tissue engineering and regenerative medicine, involving the translations of form, chemistry, cell-types, and biomaterials and other interventions that make it possible for scientists to collaborate with cells and living systems to produce living matter. Sometimes (often!) the fabricated structures contain no cells themselves: they are a biomaterial scaffold, or similar forms that are more about making the conditions right for the next stage of the experiment. 

And this leads to a compelling opportunity for artists and designers. The creative problem solving that scientists, engineers, clinicians, and biomaterials experts go through to find their route to living cells and tissues parallels how artists, designers, engineers, and architects produce their work. While not every student at ITP intends to become a bioengineer, many are interested in biological systems, biomaterials and bioplastics, mycelium forming, and bio-inspired design. This course draws on a selection of open-source bioprinting & biofabrication processes (that are closely tied with 3D printing technology) to introduce students to this pioneering technology with attention to how artists and designers might also repurpose these approaches for working with their own target materials and objectives, intervening with these technologies.

Web Art as Site +

Theo Ellin Ballew | Syllabus | ITPG-GT.2094 | Fri 12:10pm to 2:40pm in 370 Jay St, Room 407 Meetings:14
Last updated: November 11, 2024

WEB ART AS SITE addresses the history and practice of art made for and inseparable from the web, while teaching basic coding for the web. We explore key examples of web art from the early days of the internet through today, asking questions about this idiosyncratic artistic medium like: How do different forms of interaction characterize the viewer and/or the artist? What happens to our reading practice when text is animated or animates? How is an internet-native work encountered, and how does the path we take to reach it affect our reading? Who is able to see a work of web art, and what does access/privilege look like in this landscape? How are differently-abled people considered in a web artwork? What feels difficult or aggressive in web art, and when is that useful? How do artists obscure or reveal the duration of a work, and how does that affect our reading? What are the many different forms of instruction or guidance online? As we ask these questions, we exploit the internet pedagogically, collaborating online, playing with anonymity, and breaking the internet spaces we know.

Students learn web coding through specialized online tutorials; most of class time is reserved for discussion (of web art and supplementary readings) and critique. Throughout the semester, students will produce two major works of web art. Students need only a standard laptop, and will not be expected to purchase any software or text (cost of materials: $0).

Machine Learning for Creative Coders (Topics in ITP) +

Daniel Shiffman | Syllabus | ITPG-GT.2378 | Fri 12:10pm to 2:40pm in Meetings:14
Last updated: November 11, 2024

This introductory course provides students with practical experience in developing creative coding projects using machine learning. The class begins with a focus on p5.js and ml5.js, then progresses to other open-source frameworks like TensorFlow.js and Transformers.js. Students will learn how to work with pre-trained models, apply transfer learning and fine-tuning to those models, as well as train their own models from the ground up. The course also covers writing server-side applications with node.js to connect to cloud-based APIs, often necessary for working with cloud-hosted models for generative text and images. Alongside technical demonstrations and weekly practical exercises, the course includes readings and discussions on ethics, bias in machine learning, data collection best practices, and responsible model training. Students will build a final project incorporating machine learning over four weeks.

Kinetic Sculpture Workshop (Topics in ITP) +

Daniel Rozin | Syllabus | ITPG-GT.2378 | Wed 12:10pm to 2:40pm in 370 Jay St, Room 410 Meetings:14
Last updated: November 11, 2024

This class is a workshop, this means students will be working on a single project throughout the semester. The goal of the workshop is to develop skills and implement them in the creation of a kinetic sculpture. Topics that will be explored are – computer vision and sensing, on screen simulation, CAD, mechanics and fabrication. Topics will be explored individually, in groups and with demos by the instructor. 

• Develop on-screen interactive experience using computer vision and sensors.

• Imagine the on-screen interactive experience as a physical object and simulate it.

• Develop the mechanics necessary for the sculpture.

• Design the kinetic sculpture.

• Fabricate the kinetic sculpture.

Intro to Programming in Unity (Topics in ITP) +

Matt Parker | Syllabus | ITPG-GT.2378 | Mon 12:10pm to 2:40pm in Meetings:14
Last updated: November 11, 2024

Unity is one of the premiere Game Engines, used not just for developing games, but also interactives and installations. It boasts a powerful GUI (Graphical User Interface) that allows for easy configuration and setup of projects and an asset store that provides thousands of resources for creative development. However, the heart of Unity is programming custom behaviors in the entity component model, which centers around adding gameObjects with components scripts to scene graphs. Using the C# programming language, we will explore how to use code to create original and diverse projects. There will be an emphasis on programming fundamentals; they will be motivated through the lens of design. We will discuss how platforms, libraries, frameworks, and engines impact design, in both empowering and limiting ways. This class will have weekly homework assignments, in class work, as well as midterm and final projects. ICM or equivalent programming knowledge is a prerequisite.

The New Arcade +

Mark Kleback | Syllabus | ITPG-GT.2063 | Thur 6:00pm to 8:30pm in 370 Jay St, Room 408 Meetings:14
Last updated: November 11, 2024

With platforms like Steam and Itch.io making independent games more accessible to the public, we’re starting to see a movement toward physical installations of indie games as well. The New Arcade pays tribute to arcade cabinet designs of the 80’s and 90’s, but infuses them with new interfaces and digitally fabricated components.

In this class, students will learn how to use the Unity game engine to design a simple arcade game. They’ll learn about aspects that separate an arcade game from other types of games, and interface their game with different kinds of hardware using microcontrollers.

In the second half of the class, students will use Fusion360 to construct a new arcade experience using digital fabrication tools like laser cutters, and CNC machines. The class will culminate in a physical installation that showcases their game in a public gallery.

Prerequisites: Physical Computing

About Mark Kleback: https://wonderville.nyc

The Nature of Code +

Can we capture the unpredictable evolutionary and emergent properties of nature in software? Can understanding the mathematical principles behind our physical world help us to create digital worlds? This class focuses on the programming strategies and techniques behind computer simulations of natural systems. We explore topics ranging from basic mathematics and physics concepts to more advanced simulations of complex systems. Subjects covered include physics simulation, trigonometry, self-organization, genetic algorithms, and neural networks. Examples are demonstrated in JavaScript using p5.js.

https://natureofcode.com/

Synthetic Architectures +

For better or worse humanity is heading down the virtual rabbit hole. We’re trading an increasingly hostile natural environment for a socially networked and commercially driven artificial one. Whether it’s the bedrooms of YouTube streaming stars, the augmented Pokestops of Pokemon Go, the breakout rooms of a Zoom meeting, or even the “airspace” of Airbnb; we are witnessing a dramatic transformation of what occupying space means. The socially distanced measures as a result of the COVID-19 pandemic have only accelerated this societal embrace of the virtual.

So where are these dramatic spatial paradigm shifts occurring? Who owns and occupies these spaces? Who are the architects and what historical and ethical foundations are they working from? What world do they want to build for humanity and where does the creative individual fit into it? Will it be a walled garden, a role-playing adventure or a tool for creating more worlds?

The course will ask students to embrace the role of virtual architect, not in the traditional brick-and-mortar sense of constructing shelter, but in terms of the engagement with the raw concept of space. However this virtual space must be considered and evaluated as a “site,” that is activated and occupied by real people and all the limitations of physical space that they bring with them from the real world. This is the foundation of synthetic architecture; simulated space met with biological perception.

This conceptual architecture is free from the confines of physics but host to a whole new set of questions: How do we embrace the human factors of a dimensionless environment? How do we make or encourage meaningful interactions within the limits of current technology? New models of interaction must inform and shape the architecture of virtual space – what does that look like? How can architecture and aesthetics inform the creation of virtual environments and immersive narratives? How do we acutely consider the psychological and social impacts of the worlds we design and what is the metaphorical ground plane to make sense of this virtual world, unbound by physics?

About Jonathan Turner: http://www.jonathanwilliamturner.com/about/

Seeing Machines +

Elie Zananiri | Syllabus | ITPG-GT.3031 | Mon 6:00pm to 8:30pm in 370 Jay St, Room 409 Meetings:14
Last updated: November 11, 2024

A programming course where we’ll explore various techniques and solutions for tracking and sensing people or objects in space. Students will get familiar with the terminology and algorithms behind many sensing topics such as computer vision, depth cameras, positional tracking, and coordinate mapping. As these subjects are explored, we will also dig into communication, and how this information can be transmitted from one tool to another, for example using OSC, Spout/Syphon, MIDI, DMX/ArtNet. The goal being to use the right tool for the job and not limit ourselves to a particular piece of software.

Real Time Social Spaces: Building Video and Audio Interactions for the Web +

Aidan Nelson | Syllabus | ITPG-GT.2327 | Mon 6:00pm to 8:30pm in 370 Jay St, Room 410 Meetings:14
Last updated: November 11, 2024

Over the past 3 years, we have seen many aspects of our lives thrust online. Increasingly, we are working, learning, socializing with family and friends, attending live performances and more through 2D grids of video feeds on platforms such as Zoom and Google Meet. These communication tools have become essential for remote communities to connect, yet fail to replicate many of the most engaging, messy and human aspects of our in-person experience. What happens when we break out of this grid and explore new forms of real-time social interactions online using webcam video and audio?

Recent explorations in this realm have shown the promise of spatial metaphors in creating engaging real-time social interactions online. In this course, students will create their own series of experimental social spaces that explore these questions: how does the shape and nature of our environment affect the way we communicate? What unique forms of real-time expression and sharing might be possible online (and only online)? How might we design experiences for the unique social dynamics we want to support?

Students will be exposed to principles of spatial design as well as a series of open source Javascript tools for arranging live webcam video and audio in 2D and 3D space in the browser. They will use WebGL (through the three.js library) to build 2D and 3D environments, and will be exposed to WebRTC (Web Real-Time Communications) and Node.js to add interactivity to those environments.

Playful Experiences +

Gregory Trefry | Syllabus | ITPG-GT.2467 | Thur 09:30am to 12:00pm in 370 Jay St, Room 409 Meetings:14
Last updated: November 11, 2024

Forget the screen. People want to be part of the action. They don’t want to watch detectives and control superhero avatars. They want to solve the mystery and be the hero. They want to experience it. We see this craving for playful experience in everything from immersive theater to escape rooms to the Tough Mudder to gamified vacation packages. Designing live experiences for large audiences that demand agency offers a distinct set of challenges, from how much choice you give each participant to how many people you can through the experience. We’ll look at examples from pervasive games to amusement parks to immersive theater, examining both the design choices and technology that make the experiences possible. Along the way we’ll create large, playful experiences that put the participant at the center of the action.

About Greg Trefry: https://www.giganticmechanic.com/our-team/#trefry

Playful Communication of Serious Research +

Exhibition design is the art of marrying experience and information. The best does so seamlessly; the very best surprise and delight you along the way. In this class, you will explore the craft of interactive exhibition design through practice. Working in small groups, you will select an NYU researcher whose work is of interest to you and create an interactive experience that presents this research to a broader, public audience. In the process, you will learn to interrogate content and form, audience and environment, medium and message to create a meaningful and playful exhibit experience.

Modern Artifacts: Interactive Public Art for the People +

Ali Santana | ITPG-GT.3005 | Wed 09:30am to 12:00pm in 370 Jay St, Room 411 Meetings:14
Last updated: November 11, 2024

In an era of remote everything, how can we create artwork that brings us back together IRL? This course explores our connection to physical objects within the context of community. How can sculpture, installation, immersive, and public art nurture our neighborhoods via collaboration, play, ritual, self-expression, and awe?

Students will work collaboratively to radically imagine bold, sculptural, immersive works using innovative and lo-fi techniques integrated with technology. Hands-on workshops include experiments creating found sculptures, AR prototypes, projection mapping, real-time interactive multimedia content, and more. We’ll reference ancient monuments, sacred objects, NYC relics, street art and contemporary works to envision new artifacts that create awareness by reflecting the needs of our communities.

Prerequisite: Comm Lab: Hypercinema
About Ali Santana: http://www.alisantana.com/bio

Mobile App Development Lab +

John Henry Thompson | Syllabus | ITPG-GT.2372 | Tues 09:30am to 12:00pm in 370 Jay St, Room 409 Meetings:14
Last updated: November 11, 2024

One of the most transformative consumer products in history, the iPhone remains the standard bearer for great design and user experience. With the latest versions of iOS and iPhone, Apple puts depth sensing and augmented reality in our pockets. How do we take advantage of this incredible platform to produce our own compelling experiences?

This course will be a hands-on workshop where we explore the world beyond generic apps and push the boundaries of what’s possible on iOS hardware. Each week, you’ll be asked to complete a programming exercise meant to foster your understanding of iOS application development. We’ll leverage existing open source libraries to quickly build out your app with features such as real time communication and cloud storage.

We aim to create distributed instruments for computed expression.

Full-time access to an iOS device and a Mac laptop computer running the latest operating system and development tools are required.

Prereq: Some programming experience (such as ICM) and willingness to learn Apple’s Swift programming language.

About John Henry Thompson: http://johnhenrythompson.com/

Live Web +

The web has become an amazing platform for live communication.  Streaming media, audio and video conferencing, text chat and other real-time data transmission give us the ability to create a wide array of platforms that enable live cooperative and collaborative performance, real-time games, and novel real-time communications experiences.  

In this course, we focus on the types of content and interaction that can be supported through these technologies as well as explore new concepts around live participation.  We utilize browser based technologies such as WebSockets and WebRTC in combination with JavaScript and Node to build client/server based applications.  Experience with HTML and JavaScript are helpful but not required.

Light and Interactivity +

Tom Igoe | Syllabus | ITPG-GT.2133 | Tues 3:20pm to 5:50pm in 370 Jay Street Room 450 Meetings:14
Last updated: November 11, 2024

We use light in all aspects of our lives, yet we seldom notice it. That is by design: lighting in everyday life, well-designed, doesn’t call attention to itself. Instead it places focus on the subjects and activities which it supports.

Solid state lighting technologies and digital control technologies have made major changes in the lighting industry. They support a wide range of color rendering and control than earlier lighting technologies, an ability to change light over a wider range of time, and they can communicate with all kinds of digital systems and devices.

On the design side, this class takes a “post-pixelist” approach: rather than making images with light, we’ll use it to illuminate people and the spaces and activities in which they engage. We won’t focus on pixels or projections, but rather on casting light on the subject at hand. We’ll consider the intersection of lighting design and interaction design. We’ll analyze lighting and describe its effects, in order to design and use it more effectively.

On the technical side, you’ll learn the basics of the physics of light, its transmission and perception. We’ll talk about how the materials which we cast light on or through affect how we perceive it. We’ll talk about sources of light, both current and historical. We’ll work with computerized control systems for lighting, and we’ll design a few lighting fixtures for different purposes. You’ll get practice planning and building electronic and microcontroller-driven circuits for lighting, and you’ll learn digital communications protocols used in the lighting industry.

Assignments will cover lighting observation and description; sensing and measurement of light; design of new lighting fixtures; and control of existing fixtures and lighting systems.

This class will be production-intensive throughout the course of the spring semester. Second-year students should consider that the assignments in this class must be done in addition to their thesis work, regardless of the topic of their thesis.

Intangible Interaction +

This course will focus on researching, designing, and defining Intangible Interactions together, and unveiling artistic potential in it. Intangible interactions are those that we engage in without involving direct physical contact. Some examples would be automatic toilets, shopping carts that stop rolling outside the shop, contactless thermometers, gesture-based interactions, theremin, artwork activated by your presence, and mid-air haptic experiences. Intangible interfaces don’t have a tangible form that explicitly instructs us how to interact with them, and these interactions utilize other forms of feedback than those we feel through touch. Hence, Intangible Interactions tend to be more nuanced rather than direct, and the system is intricately designed to read your intentions using sensors. While technologies used for intangible interaction–such as computer vision and sensors are now more available and accessible, knowledge around the design and implementation of effective intangible interactions is a much less explored subject.

We will explore practical, artistic, and whimsical applications of intangible interaction and look at the ways it can enhance human-computer interactions in our everyday lives. For example, it can allow new ways to interact with educational exhibits, artifacts, and artworks. We will explore intangibility as a poetic medium that can open up possibilities for creating work that challenges human senses and perception. We will discuss what are cultural and social implications that we need to consider in designing intangible interactions—what does it mean for an interaction to be “intuitive” and what are some of the assumptions that are embedded into designs that we need to challenge? You will also be introduced to working with sound frequencies that are outside the hearable spectrum to create mid-air haptic feedback.

Technical topics that will be discussed in the class include: non touch-based sensors including optical sensors; proximity sensing; presence detection; optimizing sensor readings on Arduino; extending capability of sensors with light pipes and lenses; body tracking with cameras; signals outside visible spectrums; environmental sensing; mid-air haptic.

Assignments will include relatively small-scale production assignments, labs, thinking, ideating, and reading. For the final project, you will be prompted to conceptualize a project that is larger than a classroom scope. You will respond to a call-for-projects with a proposal along with a solid prototype for the project so you have fully fleshed materials to apply to resources such as grants and other opportunities in the near future. I want you to think big and equip yourself with practical and essential skills to build a sustainable art or design practice! A proposal writing workshop and structured peer reviews will be provided to support this process.

Tags: intangible, interaction, artistic, poetic, physical, sensors, physicalcomputing, haptic, hci, research, art, design, environment, playful, fun, proposalwriting

Future Mapper +

CHIKA | ITPG-GT.2362 | Wed 09:30am to 12:00pm in 370 Jay St, Room 407 Meetings:14
Last updated: November 11, 2024

As you know, projection mapping and Light Art are becoming popular again because of large-scale pop-up installations worldwide: ARTECHOUSE, SuperReal, Meow Wolf, and TeamLab.
Technology has advanced over the years, but how people enjoy light art have not changed so much.

How do your ideas and artwork fit into these site-specific installations? This class is for anyone interested in creating a site-specific installation using mapping technologies to create new experiences for the public audience.

This class guides students through conceptual and technical processes of project and artist development. It consists of three parts: Project & Artist Development, Projection Mapping, and LED Mapping.

We will research and discuss the history of visual artwork, public engagement, and technical exercises using real international contests and festival sites. The student will learn the latest Projection and LED Mapping techniques using Madmapper.

And we will also focus on advanced techniques like multi-projector projection, projector calculation, Interactive Mapping, and software & hardware to culminate in a final project.

The class will also invite guest speakers to discuss the nuts and bolts of their art and business.

About Chika Iijima: www.mappathon.com, www.imagima.com

Exploring Concepts From Soft Robotics +

Kari Love | Syllabus | ITPG-GT.2125 | Fri 12:10pm to 2:40pm in 370 Jay Street Room 450 Meetings:14
Last updated: November 11, 2024

Because the full potential of the emerging field of soft systems is unrealized, there are countless opportunities for curious innovators to discover or develop novel soft systems. Soft robotic skills and techniques also open up a world of possibilities for large scale or surprising artwork. This course teaches hands-on fabrication techniques for constructing simple pneumatic actuators from cast silicone and heat-sealed mylar, and challenges participants to design and build their own. Lectures and discussion center on concepts from soft innovation history, the current state-of-the-art, and sister disciplines of bio-inspired and hybrid (soft/hard) robotics. Consideration of both brand new soft materials, from a class visit to Material ConneXion library, and everyday overlooked soft mechanisms, found in average retail stores, will require participants to look at softness through a new lens. Final projects will be the development of an original soft/flexible/hybrid research or artistic concept presented with context, material swatches with justifications for choices, and physical or modeled proof-of-concept.

About Kari Love: http://www.karimakes.com

Energy +

Jeffrey Feddersen | Syllabus | ITPG-GT.2466 | Thur 3:20pm to 5:50pm in 370 Jay St, Room 410 Meetings:14
Last updated: November 11, 2024

From the most ephemeral thought to the rise and fall of civilizations, every aspect of your life, and indeed the universe, involves energy. Energy has been called the “universal currency” by prolific science author Vaclav Smil, but also “a very subtle concept… very, very difficult to get right” by Noble physicist Richard Feynman. It is precisely this combination of importance and subtlety that motivates the Energy class. Maybe you fear the existential threat of anthropogenic climate change, or maybe you just want your physical computing projects to work better. Either way, the class will help you understand energy quantitatively and intuitively, and incorporate that knowledge in your projects (and perhaps your life).

How? Building on skills introduced in Creative Computing, we will generate and measure electricity in order to see and feel energy in its various forms. We will turn kinetic and solar energy into electrical energy, store that in batteries and capacitors, and use it to power projects. We will develop knowledge useful in a variety of areas, from citizen-science to art installations, and address topics such as climate change and infrastructure access through the lens of energy. Students will build a final project using skills learned in the class.

Prerequisites: Creative Computing

Instructor Jeffrey Feddersen Website: https://www.fddrsn.net/

Electronics for Inventors +

Pedro Galvao Cesar de Oliveira | ITPG-GT.2036 | Thur 2:50pm to 5:50pm in 370 Jay Street Room 450 Meetings:12
Last updated: November 11, 2024

Today we are no longer solely connected to the digital world through computers. The result of this push to connect the digital and the analog world is the increasing necessity for low cost, low power, and self-contained electronics.

This course is an applications-driven intro to electronics for inventors. Through a hands-on approach, students will learn basic concepts about analog circuits, Boolean logic, digital devices interfaces, and low-cost code-free electronics.

Topics will include basic principles of electricity, as well as an understanding of electronics components such as resistors, capacitors, diodes, transistors, audio amplifiers, and timers. Students will also learn what it takes to build an arduino-like microcontroller.

This class will use as a backbone the book “Practical Electronics for Inventors – 4th Edition” by Paul Scherz and Simon Monk.

Format: Lectures + In-class LABs + Readings

Designing for Messy Humans +

Aleks Krotoski | Syllabus | ITPG-GT.3047 | Tues 3:20pm to 5:50pm in 370 Jay St, Room 408 Meetings:14
Last updated: November 11, 2024

“How can we create services – digital or otherwise – that scratch psychological itches in ways that take into consideration the uncontrollable nature of users? In this course, we marry the art of design with the science of psychology. The offspring of this match is complicated, unexpected and never predictable – but indelibly informed by both its binary and analogue parentage.

Leaning on a variety of international case studies that tickle our human passion for enquiry, for storytelling, for sensation, and for sense-making, plus short philosophical readings about the nature of the indefinable, each class will dissect what we know about something inherently human (from beauty to joy to elegance), and how technologists and machine-makers have tried to predict it. We will spend time in this course reverse engineering black boxes and imagining how they could have been designed otherwise. The final project will be an “”engine”” or machine – mock-up, paper design or working prototype – that proposes to produce the solution to a messy human question every single time.

The course will be divided into three thematic sections of three classes each: a theory week, an analysis week, and a prototyping week. Each thematic section will examine single-topic human “needs” frequently designed for in apps and tech. Students will be expected to take part in group discussions, and brainstorming sessions that will imagine systems that could achieve that topic. Latterly, the last session will be workshops, in which students will work together or alone on their own projects based on one topic of their choice.”

Connected Devices and Networked Interaction +

Tom Igoe | Syllabus | ITPG-GT.2565 | Tues 09:30am to 12:00pm in 370 Jay Street Room 450 Meetings:14
Last updated: November 11, 2024

The World Wide Web no longer stops at the edge of your screen. When it comes to products, if it powers up, it talks to another device. This class provides an overview of methods for connecting the physical world to web-based applications. We’ll consider what the emerging interaction patterns are, if any, and we’ll develop some of our own as needed. This class can be seen as a narrower and more interaction design-based complement to Understanding Networks. The latter class provides a broader overview of the dynamics of communications networks, while this class focuses specifically on the challenges of connecting embedded devices to web-based services. Neither class is a prerequisite for the other, however. This class will introduce network connection techniques for devices using networked microcontrollers and processors running an embedded operating system.

Prerequisites: Intro to Physical Computing and Intro to Computational Media, or equivalent experience with the topics covered in those classes.

Learning Objectives: Students will gain an understanding of the basics of network programming for devices with limited computing power. They will learn about current protocols for communication between devices and networked servers, and about the rudiments of security for that communication.

Reading: There will be an article or two to read each week, to foster discussion about the design of connected things.

Assignments: There will be several one-week software and hardware assignments to get familiar with different technologies and communications protocols, and one hardware and software final application project.

Computational Letterforms and Layout +

Allison Parrish | Syllabus | ITPG-GT.2051 | Thur 6:00pm to 8:30pm in 370 Jay St, Room 409 Meetings:14
Last updated: November 11, 2024

Language is more than just words and meanings. Language is material: it’s paper and ink, pixels and screens, fingertips on keyboards. In this course, students will gain an understanding of how language’s material manifestations are represented digitally, and learn computational techniques in order to create new work and new systems that challenge conventions in type design and page layout. Topics include asemic writing, concrete poetry, markup languages, character encodings, generative typography, and printing technologies (including pen plotters). Readings and lectures in the class draw from the fields of computation, critical theory, literary studies, art history, mathematics and graphic design. A series of production-oriented assignments lead up to a final project. In addition to critique, sessions will feature class discussions and technical tutorials. 

Prerequisites: Introduction to Computational Media or equivalent programming experience.

Computational Approaches to Narrative +

Allison Parrish | Syllabus | ITPG-GT.2198 | Tues 6:00pm to 8:30pm in 370 Jay St, Room 408 Meetings:14
Last updated: November 11, 2024

Beginning with the release of Crowther and Woods’ “Colossal Cave Adventure” in 1977, the potential and unique affordances of computation as a means of storytelling have become more and more apparent. Combining approaches from literary theory, anthropology, computational creativity and game design, this class considers how narrative structure can be represented as data and enacted through computation, and invites students to implement practical prototypes of their own interactive and procedurally-generated narratives using a variety of technologies.

Topics include (but are not limited to) hypertext fiction, “choose your own adventure”-style branching narratives, text adventures, visual novels, story generation from grammars and agent-based simulations. Students will complete a series of bite-size weekly assignments to present for in-class critique. Each session will also feature lectures, class discussion, and technical tutorials.

Prerequisites: Introduction to Computational Media or equivalent programming experience.

Collective Play +

Rules of play shape competitive games from checkers to football. But how do rules of interaction, both stated and unstated, shape everyday life? What happens when there are no established conventions and the rules are being made up as we go along? And last but not least, can we invent and facilitate new social norms through unconventional uses of technology?

In this course, we will design, code and test strategies for playful, serious, and bizarre group interactions drawing inspiration from daily life. We will interrogate both what it means to play and how individual identities and group behaviors emerge. What motivates participation? What hinders it? When does participation become oppressive? What’s the difference between self-consciousness and self-awareness? Who has power? Who doesn’t? Are leaders necessary? What’s the difference between taking turns and engaging in conversation? What happens when the slowest person sets the pace? What happens when there are no explicit rules? And how do we set the stage for breaking social conventions?

Class time will be a mix of technical material, play-testing, improvisation and movement work adapted from acting and dance training. All projects will be done in groups of 2-4.

We will work with both mobile sensors and traditional keyboard/mouse interaction with p5.js, socket.io and node.js to enable real-time interaction. Our challenge is to design technology-enabled interactions that encourage participants to be even more present in the physical world with each other.

Code Your Way +

Ellen Nickles | ITPG-GT.3007 | Mon 09:30am to 12:00pm in 370 Jay St, Room 407 Meetings:14
Last updated: November 11, 2024

This course provides students an opportunity to sharpen their coding skills in several ways: by reviewing fundamental programming concepts, acquiring techniques to systematically develop code-driven projects, and then implementing those to develop an independent project with the structure and support of a classroom learning community.

The first part of the semester consists of weekly exercises to practice strategies for learning new algorithms, writing pseudocode, pair programming, debugging, refactoring, version control, and more. Screen-based code examples for the activities and assignments draw inspiration from the history of creative coding. The second part of the semester shifts to a project development studio format for students to apply these strategies to a self-directed project. This could be an existing idea or one devised during the course.

Ultimately this course aims to empower students to reflect on their process and teach themselves how to program with greater efficiency and independence. It is a direct follow-up to Introduction to Computational Media (ICM) or for anyone interested in advancing their coding practice.

Examples and exercises will be provided in JavaScript using the p5.js library. However, students are welcome to consult the instructor about working with another programming library, framework, or language with which they have interest or prior experience.

Prerequisite: ICM or equivalent experience

Cabinets of Wonder +

Emily Conrad | Syllabus | ITPG-GT.2470 | Wed 6:00pm to 8:30pm in 370 Jay St, Room 408 Meetings:14
Last updated: November 11, 2024

If you were inventing a museum today, what would it look like? Who would be there? What would its main purpose be? What would the audience experience? The first museums were called Cabinets of Wonder. Usually, a viewer with a guide, often the collector, would open doors and drawers to see what was inside–amazing things from different parts of the world, different times. They were windows on the world to places the visitors would probably never be able to go; to see things they would never otherwise be able to see. And now there’s television, movies, the internet, and travel. Why do people go to museums now? Will they in the future? Today, most museums seek to educate and to include more and more diverse visitors than they used to. How do people learn in public spaces? How do we know that they do? How can they make use of the new interactive technologies to support the experience and not lose what’s special about them? The class is an exploration, observation, theory, and design class for you to imagine the future of museums and exhibits. Museum and exhibit visits are your primary assignments for the first half of the course—usually accompanied by a reading. You will also make some record of your visit (including a sketchbook, a diorama, reviews). There will be guest speakers from Museums and exhibit design firms, and several field trips. In the second half of the course, you begin to imagine how you might reinvent a museum and develop a full-scale presentation of your own Cabinet of Wonder.

About Emily Conrad: https://www.linkedin.com/in/emily/

Bioart as Biopolitics–Genomics and Identity +

Heather Dewey-Hagborg | Syllabus | ITPG-GT.3048 | Fri 12:10pm to 5:10pm in 370 Jay Street, Room 426 Meetings:7-First Half
Last updated: November 11, 2024

What does biology have to do with art? Bioart is a discipline in which artists use life itself as a medium for creative experimentation and reflection on the social implications of cutting edge biological science. Biopolitics describes the ways in which DNA and other forms of biological knowledge combine with the accumulation of data to segment, categorize, and predict our behavior. In this course we will take a tour of the materials and techniques utilized by artists in the emerging field of biological art, with a focus on genomics and its political and social implications. This hybrid art and science class will introduce concepts in personal genomics, genetic engineering, speculative design, bioart, biopolitics, critical engineering, and bioethics as sites for activism and artistic exploration. Students will extract and analyze their own DNA while discussing human evolution and the social construction of identity. They will learn how DNA extraction and sequencing works, how to analyze real genomic data, and will incorporate this in creative and critical projects. Regular readings and in-class discussions will supplement artistic projects.

Technology, Media and Democracy: Addressing Challenges to an Informed Electorate +

Justin Hendrix | Syllabus | ITPG-GT.2184 | Mon 7:00pm to 8:30pm in > Thur 6:30pm to 7:50pm in Meetings:14
Last updated: November 11, 2024

Across New York City’s universities, the Technology, Media and Democracy program will bring together journalism, design, and technical disciplines to understand the various threats to democracy, and attempt to address these challenges using technical and computational methods and techniques. Students have the opportunity to work with peers in other programs in journalism, engineering, media studies, design & technology at Columbia, Cornell Tech, CUNY and The New School to build ideas that advance an information ecosystem that nurtures democratic societies. The free press, journalism and the media are some of the most critical elements of our democracy, but have been increasingly under attack by political and market forces, and a social media landscape that has altered the way people interact and share information. These challenges include: dwindling resources and support for deep investigative journalism; legal, technical and even physical assaults of media organizations and journalists; challenges to credibility and reliability of information; and shifting business models and economics that threaten both local and national news organizations and coverage. This course will include various elements that will help frame the problem and build/prototype solutions that address a variety of issues.

https://techpolicy.press

Reading List: https://docs.google.com/document/d/1xoq92YRHNIVJV-74gwilZKVy-6yDTgAkfBDAll-oDO8/edit

Restorative Spaces (Topics in ITP) +

John Henry Thompson | Najma Dawood | Syllabus | ITPG-GT.2379 | Wed 09:30am to 12:00pm in 370 Jay Street Room 450 Meetings:7-First Half
Last updated: November 11, 2024

Taking time to unwind is restorative and essential given the nature of our lives and the media rich environments inhabit. This couldn’t be any more true than it is for those attending interactive and digital media programs in NYC.

There are many ways individuals and groups engage in this from taking walks in parks to meditation or yoga. Recently, more immersive environments have begun to pop up that leverage sound and projection.  In this class, students will explore these new opportunities for developing restorative spaces, augmented with immersive technology, and more.

Whatever Generative AI is Doing Now (Topics in ITP) +

Derrick Schultz | Syllabus | ITPG-GT.2379 | Fri 3:20pm to 5:50pm in Meetings:7-Second Half
Last updated: November 11, 2024

This course will be a survey of current generative AI tools, with an emphasis on open source tools that any artist can build into their practice. Topics will include LLMs, and image and video generation. We will cover practical applications as well as the theory behind these set of technologies and how that theory influences their outputs. We’ll explore everything using Google Colab and ComfyUI, as well as other APIs and services that can be integrated into creative coding frameworks and media production environments. No prior coding experience beyond Introduction to Computational Media is needed for this course.

Storytelling for Project Development (Topics in ITP) +

Sharon De La Cruz | Syllabus | ITPG-GT.2379 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 11, 2024

This course challenges how you use technology to tell a story. We will start with storytelling linear basics and progress towards non-linear storytelling and new media arts considerations. This course is helpful for participants who want more grounding in storytelling, want to strengthen their voice, and are interested in building worlds beyond the one we currently experience. This course considers a range of mediums but does not expect you to be an expert in any; it allows you to experiment and explore different mediums throughout the semester.  

We will spend the beginning of the semester researching and engaging in small assignments based on storytelling basics, primarily focused on writing and prepping storyboards and scripts, basics of visual design, and interaction design. Our midterm will ask the class to retell the same story by translating a prose text into the medium of your choice. The last section of the course will focus on a survey of new media storytelling. Students will concentrate on a final project which asks them to present a story (original or adopted) via the medium of their choice. Final projects are critiqued based on storytelling techniques discussed in class, clarity of story, and presentation. You do not have to come in with a project in mind; however, if you do, there will be plenty of space in your final assignment to explore it, considering the techniques practiced in class.

Through the Lens: Modalities of AR +

Maya Pruitt | Syllabus | ITPG-GT.2368 | Mon 6:00pm to 8:30pm in Meetings:7-First Half
Last updated: November 11, 2024

In this course, students will explore the fundamentals of augmented reality by dissecting the interaction between camera, computer, and user. Each week we will focus on a different AR modality: image, face, body, environment, and object, and consider their real-world applications. Through weekly explorations, we will examine the existing affordances of AR as well as their impact. This course will culminate in a final project, and our tool of choice will be Lens Studio. Course syllabus: https://docs.google.com/document/d/1wMWVnDdzgz2bbsCNp7jRAiCe1job4glq61o67sWAP00/edit?usp=sharing

Surveillance in the Simulation +

Theodora Rivendale | Syllabus | ITPG-GT.3037 | Wed 6:00pm to 8:30pm in Meetings:7-Second Half
Last updated: November 11, 2024

Surveillance is the most successful business model in cyberspace, maybe the most successful business model anywhere in history. But the internet is changing. New regulations, new technologies, new consumer preferences, new ways of making money, a new generation of technologists promising change. Will surveillance capitalism continue to be the dominant modality in the online world of the future? And if not, what would replace it?

In this class we’ll examine the contemporary state of the surveillance industry and the technical infrastructures that underpin it, such as cookies, requests, and browser fingerprinting. And then look to the promised technologies of the future, from the cryptographic web3.0 to the metaverse to our own hypothesized models for the future of digital existence.

On Permanence: The Lifecycle of Art in Digital Works +

Tarikh Korula | Erin Sparling | Syllabus | ITPG-GT.3045 | Fri 09:30am to 12:00pm in Meetings:7-First Half
Last updated: November 11, 2024

What does it mean to make something that lasts? In this 7-week studio, we will attempt to understand the collective hallucination that is the Internet, while rationalizing the intersection of permanence, mutation, utility and ownership in creative digital work. To support this investigation, we will:

– Use hands-on workshops to understand and build various forms of generating digital art
– Consider the implications of storage and longevity
– Have a working knowledge of marketplace capabilities, and their influence on the art that they contain
– Expand on our understanding of verifiable ownership, blockchain and otherwise, and how it can have impact beyond the digital landscape

Through this class, you will develop work that considers time as a critical axis, be it the longevity of the outcome, or the impermanence of the idea. Work may live on the blockchain, utilize generative ai frameworks, or manifest as a performance in a snowstorm.

New Portraits +

Alan Winslow | Syllabus | ITPG-GT.3042 | Wed 6:00pm to 8:30pm in 370 Jay St, Room 410 Meetings:7-First Half
Last updated: November 11, 2024

“””Portraiture stands apart from other genres of art as it marks the intersection between portrait, biography, and history. They are more than artworks; when people look at portraits, they think they are encountering that person,”” says Alison Smith, chief curator at the National Portrait Gallery in London.

For thousands of years, artists have used cutting-edge tools and resources to create portraiture, giving viewers a glimpse into the subject’s life. A successful portrait embraces technology to bring the viewer closer to the subject but is not overshadowed by it.

In this course, we will delve into portraiture through the lens of volumetric capture using the Depth Kit system. Through hands-on assignments, students will learn the entire pipeline of volumetric capture, from configuring the system to capturing our subjects and final output. Simultaneously, we will focus on fundamental aspects of portraiture, such as lighting, storytelling, production techniques, and historical foundations.

The course will explain the techniques and considerations involved in creating volumetric portraits. We will explore various approaches to capturing subjects, employing advanced technologies to record their presence in 3D. Students will gain proficiency in the Depth Kit system to produce high-quality volumetric portraits that can be integrated into different mediums, including game engines, augmented reality (AR), or traditional 2D outputs.”

Motion Capture and Live Performance +

Matt Romein | ITPG-GT.2999 | Mon 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 11, 2024

Motion Capture and Live Performance is a studio class in which students will learn how to use the OptiTrack Motion Capture System and Unreal Engine to create live performance with digital assets, environments, and characters. Students will work on group projects, culminating in a final performance presented to the class and guests. We will learn about performance tools, staging conventions, design considerations, and more in service of exploring what makes a digital performance compelling to a live audience. This will be supplemented with readings and viewings that serve as the basis for discussions that critically explore how avatars and capture tools are being used in art, entertainment, and social spaces.

Live! +

Carrie Sijia Wang | ITPG-GT.3004 | Wed 6:00pm to 8:30pm in Meetings:7-First Half
Last updated: November 11, 2024

This course engages students in a dynamic series of workshop-style experiments, looking into different possibilities of live-streamed performance. Through an exploration of language, media, time, space, body, and object, students are encouraged to develop their unique artistic voices while utilizing the class as a platform for performative inquiry into subjects of individual interest.

Throughout the course, we will examine a wide range of examples, spanning from durational performances by artists such as Tehching Hsieh and Marina Abramović, to online interactive performances that invite audience participation. We will explore how we can apply emerging technologies to design live-streamed projects that tell stories, convey ideas, and express feelings.

A few weeks into the course, students will propose final project ideas and develop the performances in subsequent weeks with support from the instructor. The class will culminate in a virtual event featuring live-streamed projects by the students.

Introduction to Quantum Technologies +

Greg Shakar | ITPG-GT.3003 | Mon 6:00pm to 8:30pm in Meetings:7-Second Half
Last updated: November 11, 2024

Being in two places at once. A particle that’s also a wave that’s also a particle. Having a value of both zero and one at the same time. These are some of the phenomena encountered in Quantum Physics, where nature at its smallest scales manifests. Where fundamental components of matter like electrons and protons interact with “quanta” of energy like photons of light.

Computers that leverage the surprising rules of the quantum world are on the verge of a revolution. These Quantum Computers will solve problems in minutes that would take today’s supercomputers billions of years to compute.

In this course, we learn about Quantum Computing while exploring the underlying quantum physics that makes them so powerful. We’ll also look at other quantum technologies like Quantum Dots, Quantum Sensors, MRI, and 2D Materials.

Coursework will include programming algorithms on a simulator, and running programs on actual Quantum Computers in the cloud. In class we’ll do Quantum Physics experiments using lasers, mirrors, and a microwave oven among other tools.

Interactive Multi-Screen Experiences +

John Henry Thompson | ITPG-GT.3002 | Fri 09:30am to 12:00pm in Meetings:7-Second Half
Last updated: November 11, 2024

We experience screens daily in many forms: in our hands, on our desktops, on walls and public installations as we travel. This course will explore the creative possibilities of real-time interactive and reactive art on screens in various forms. Using the recently developed p5VideoKit we will create standalone installations. p5VideoKit is a new library of live video effects – building on p5js – presented as a dashboard for mixing video in the browser. This library allows the user to apply visual effects to live video from connected cameras and sensors or streaming from devices on the internet. p5VideoKit is open source and can be extended with the user’s p5js code for a plethora of visual effects and interactivity. One possible application of p5Videokit would be a public facing installation allowing anonymous people on the street to use their hand held devices to interact with large street facing screens, thereby collaborating on real time creation of “digital graffiti”.

Building on ICM, students will learn how to adapt simple sketches into components of p5VideoKit so that algorithms can be quickly composited and orchestrated into more complex works. Students will also learn how to edit and share code beyond the p5js editor, use nodejs/javascript to automate deployment of installations, and remotely configure dedicated computers with long running installations. Several dedicated computers and screens will be available to preview installations on the floor and street facing areas of the 370 Jay Street campus.

Prerequisites: ICM or equivalent coding experience.

About John Henry Thompson: http://johnhenrythompson.com

Big LEDs +

Aaron Parsekian | ITPG-GT.2481 | Wed 6:00pm to 8:30pm in Meetings:7-Second Half
Last updated: November 11, 2024

Light Emitting Diodes or LEDs are used creatively all around us. They have the ability to emit light at different colors and intensities instantly and from very tiny points. How can we make creative visual works out of these amazing devices? What construction methods can we use to make those works reliable?

Big LEDs will cover the process of designing large LED systems. We will cover LED array hardware and how to map pixels from computer generated media onto them. We will go through every major part of the hardware – different styles of LED arrays, drivers and gateways, cables, data protocols, and how to safely power all of them. We will learn to use the pixel mapping softwares Enttec ELM and Madmapper. We will also cover the paperwork needed to furnish a professional LED installation, including drafting riser diagrams, plan, section, and elevation views, creating a bill of materials, and writing instructions for users and installers.

This year’s final project will be a site-specific LED sculpture installed in a public space at 375 Jay St. The installations will be able to display student chosen media that can be viewed for one minute. Students will work either in groups or alone and can choose from one of four installation options to present on:

– A prepared square section of 2.0mm pitch LED video tiles (approx 256px x 256px, 2’-6” x 2’-6”)
– A prepared low-resolution sculpture with diffused linear elements (approx 500px, 2’-6” x 5’-0” overall)
– A student conceptualized LED video tile project
– A student conceptualized low-resolution project

Because of this year’s pandemic, unprecedented changes have come to the professional world of LED installations. As a result, we will be using remote tools such as networked-based cameras, remote desktop applications, and virtual private network connections to watch and operate the final projects. We will spend class time setting these tools up together. The two prepared options for the final project will be installed and maintained by the instructor.

100 Days of Making +

Karalyn C Lathrop | Syllabus | ITPG-GT.2793 | Tues 09:30am to 12:00pm in Meetings:7-All Semester
Last updated: November 11, 2024

100 Days of Making is a 2pt course that offers students the opportunity to pursue a creative passion or interest and develop or refine a skill over a 100-day period. Students choose a topic of interest and produce an expression of that topic every day for 100 days. For examples of past projects see here: https://itp.nyu.edu/classes/100days/. The course meets every other week over the course of the 14-week semester. Class time is spent discussing student progress and reflecting on students’ creative journey.

Students are encouraged but not required to start their project on or near January 1. There will be a meeting for enrolled students to discuss project ideas prior to the winter break.

About Christina Dacanay: www.cdacanay.com
About JJ Esquizo: http://www.juanjose.xyz/ &  Instagram: @juanjose_xyz

Writing Good Code +

Daniel Tsadok | Syllabus | ITPG-GT.3014 | Sun 12:10pm to 6:25pm in > Sun 12:10pm to 6:25pm in Meetings:S-Special
Last updated: November 11, 2024

As software projects become more complex, it becomes increasingly important to keep the code organized and manageable; otherwise, it becomes extremely difficult to implement new ideas, and the project is much more likely to be prone to mysterious and frustrating bugs. This course will demonstrate several approaches to organizing code for larger-scale projects, including how to write and name functions and classes, DRY (Don’t Repeat Yourself), pure functions, unit testing and Test-Driven Development (TDD), and why to avoid “magic numbers” and global variables. The focus of the course will be on JavaScript, using P5.js, but the principles will apply to most languages. We will be doing an ongoing, step-by-step, in-class refactor* of a complex sketch. We will also be using version control to track our changes every class. Students will be expected to complete weekly readings and assignments, and to refactor one of their previous projects, using the principles learned in this course.

* Refactoring means rewriting the code, without any changes to how the program behaves. Students should have some programming experience prior to taking this course, and would ideally have an existing software project they would like to develop.

Next-Gen Design: Crafting AI-Driven Products +

Helene Alonso | Syllabus | ITPG-GT.2380 | Sat 09:30am to 3:45pm in > Sun 09:30am to 3:45pm in Meetings:S-Special
Last updated: November 11, 2024

Designing AI products is not the same as traditional UX design + AI, you need to have a completely different approach where the capacities of the technology and the modalities of interaction are embedded in the design process from the start. By the end of this hands on class, you’ll be empowered to create innovative, intelligent products that resonate with and delight users.

Motion Design for User Feedback +

Alon Chitayat | Syllabus | ITPG-GT.2059 | Sat 12:10pm to 6:25pm in > Sun 12:10pm to 6:25pm in Meetings:S-Special
Last updated: November 11, 2024

Microinteractions are everywhere, you interact with them on a regular basis.
We communicate emotions through animated emojis, we burst heart buttons with love
whenever we like a post or password fields that shake when you type in the wrong password

These small but significant animations offer users delightful moments and valuable feedback. They serve to intuitively guide your users without the need for explicit instructions, and lend your interface a distinct personality and essence. As designers, you have the power to infuse soul and character into every interaction with the secret power of motion, creating memorable experiences that resonate with your audience.

What is a Lottie animation?
Lottie is a JSON-based animation format that has garnered significant attention from designers and developers alike, due to its lightweight and cross-platform capabilities. With Lottie, animations can be seamlessly integrated into websites and apps, and play effortlessly on any device or browser.

What will we learn?
Using LottieLab, a free online Lottie animation editor, we’ll learn how to design, animate and
export playful Lottie animations as interactive UI components (such as loaders, animated
buttons or icons)as whimsical moments of user delight.
We’ll learn how to integrate & trigger them in prototypes and web interfaces.
We’ll examine the basic principles of designing motion for user experience, we’ll learn how to translate human body language into micro animations.

We’ll cover how to create interactive animated states with fluid transitions between them.

Intro to Curating New Media Art +

Julia Kaganskiy | Syllabus | ITPG-GT.3036 | Sat 12:10pm to 6:25pm in > Sun 3:20pm to 9:35pm in Meetings:S-Special
Last updated: November 11, 2024

In this course students will be introduced to the role of the curator with a very brief history of curation, followed by a focus on the particular challenges and approaches to curating new media art. The class will give an overview of practical approaches to exhibition-making both online and offline, looking at artist-led approaches to curation in particular. The class will include a hands-on practicum in which students will work towards creating a mock exhibition plan.

Haptics +

Kate Hartman | ITPG-GT.2457 | Sat 10:30am to 5:00pm in > Sun 10:30am to 4:30pm in Meetings:S-Special
Last updated: November 11, 2024

From the crass rattle of early pager motors to the sophisticated clicks and purrs of the iPhone Taptic engine, the ability to buzz has increasingly worked its way into our devices. This course focuses on physical prototyping and interaction design for non-visual feedback. Specifically, it will explore how haptic feedback can be utilized and integrated into handhelds, wearables, objects, and environments – anything that we touch or that touches us. Traditional tools such as eccentric rotating mass (ERM) motors, linear resonance actuators (LRAs), and haptic motor drivers will be introduced as well as less conventional methods such as gentle poking, prodding, warming, cooling, squeezing, and tickling. Through hands-on experimentation and a review of research to date, students will emerge from this course well-positioned to incorporate haptic feedback into their future projects. Note: This course is designed for students who have previous experience with physical computing and Arduino.

Telling Stories with Real-Time Engines (Topics in ITP) +

Victor Morales | Syllabus | ITPG-GT.2378 | Tues 6:00pm to 8:30pm in 370 Jay St, Room 411 Meetings:14
Last updated: November 11, 2024

This course explores the intersection of narrative storytelling and real-time game engines, focusing on the practical application of Unreal Engine to create immersive interactive and non-interactive narratives. Students will learn how to harness the power of this tool to blend traditional storytelling techniques with the unique capabilities of game engines. Through a combination of theoretical discussions, hands-on exercises, and a short final project, students will develop the basic skills required to begin to create immersive and dynamic interactive narratives.

Storytelling and media are deeply interconnected and complement each other. Understanding  different kinds of narratives is crucial for the effective delivery of a rich and meaningful message. How can we use these new real-time technologies to compose a story? What are the advantages and disadvantages of using real-time media in storytelling?  The students will review and experience different kinds of storytelling in video games, movies, and other interactive media in order to get a critical understanding of the power behind stories.

COURSE OBJECTIVES:

At the completion of this course, the student will be able to:

Understand the different kinds of storytelling and how they can be delivered using real-time media

Being able to explore real-time media as an inspiration and vehicle for delivering a story.

Utilize the knowledge and skills presented in class to create a final project.

Have a critical point of view of how to use real-time media in the creation of contemporary storytelling.

Outdoor Video Art: Projection in DUMBO (Topics in ITP) +

Gabe Barcia-Colombo | Syllabus | ITPG-GT.2378 | Tues 3:20pm to 5:50pm in Meetings:14
Last updated: November 11, 2024

Dumbo has a long, storied history of presenting projections / video art throughout the neighborhood. From mapping the Dumbo Archway during the Dumbo Arts Festival, to Light Year, a nine-year video art series that projected its 100th show on the Manhattan Bridge Anchorage in August 2023, the neighborhood has long been a canvas for light art. Additionally, the neighborhood is among the most iconic locations in New York City, photographed thousands of times a day by visitors from across the City and around the globe. This by application only course is a one time collaboration with the Dumbo Improvement District to create outdoor large scale video projections at several sites in DUMBO. The course will focus on content creation for outdoor video projection. How do we make time based media content that is mapped to specific outdoor spaces while retaining artistic context and meaning? Students will work in groups to produce video content which if selected will be featured outdoors in DUMBO through the month of May. This course will give students real world experience in pitching crafting and exhibiting public art. Please note that all students must apply in groups of 3 with a concept in order to be considered for this course. All final presentations will need to be vetted and approved by the Dumbo Improvement District before they will be projected.

Investing in Futures: The Art of Worlding (Topics in ITP) +

Marina Zurkow | ITPG-GT.2378 | Mon 3:20pm to 5:50pm in 370 Jay St, Room 407 Meetings:14
Last updated: November 11, 2024

What would it mean to unhinge the present from its current conditions and wildly create a world you want to live in? Through world-building exercises, students in this course will develop detailed alternate worlds, reimagining everything from laws of physics to societal habits and customs.

The term “world-building” originates primarily in science fiction and gaming. World-building and “futuring” models are often based on constraints—design limitations— that spark new imaginaries liberated from business-as- usual predictions. Future studies—also known as futurology—has been used since the 1970s by business and military interests as part of a strategic planning toolkit. This framework of speculating about the future in systemic ways has been adapted by many contemporary artist collectives and mission-driven organizations, in order to challenge present assumptions about future outcomes. In these artistic quests, the notion of the “future” has led to the development of productive utopias, foreboding dystopias, and queer heterotopias.

 

Similarly, in this course, students will engage in a combination of collaborative and individual creative work and research to imagine their desired future or alternate worlds. Students will complete three variously-scaled worldbuilding projects, in the forms of invented artifacts, writing, and storytelling, whose features will draw from Investing in Futures, a constraint-design platform, co-created by the instructor and Sarah Rothberg, which explores topics such as governance, living conditions, food, climate, and technology, and whose specific conditions range from the possible to the absurd.

The class will also draw on research and readings by neuroscientists, science fiction authors, anthropologists, artists, and worldbuilding experts, and touch upon future scenario design thinking and speculative design. In addition to a series of creative assignments and presentations, the class will culminate in co-producing a document of the worlds created, as well as reflections, backcasting, and commentary.

Creative Code Orchestra: Improvising with Computers (Topics in ITP) +

Daniel Fishkin | Syllabus | ITPG-GT.2378 | Mon 12:10pm to 2:40pm in 370 Jay St, Room 412 Meetings:14
Last updated: November 11, 2024

In this class, students use computers to play music together, improvising and composing with code. Using the Max graphical language, students will learn to create their own software for musical improvisation, exploring sample manipulation, digital synthesis, and also principles of psychoacoustics and sound spatialization. Students are encouraged to bring in their own instruments in order to explore sound processing of acoustic instruments. In the beginning of the class, students will solder and assemble their own portable amplifiers to create a spatialized laptop sound system. As students develop code together, the class forms a laptop ensemble, moving from theory to practice by designing software instruments for live-computer improvisation in the classroom. The class explores large format ensemble pieces, as well as smaller groups such as trios and duets. Students will learn to improvise, play existing repertoire for laptop, and can compose their own pieces. The class also explores hardware hacking topics such as microphone design and pressure transducers, bringing the sounds of the acoustic world inside and outside of our computers. The class will culminate in a group concert that features a range of performances, involving acoustic instruments, some duets, and large ensemble pieces.

Hand Held: Creative Tools for Phones (Topics in ITP) +

Max Bittker | Syllabus | ITPG-GT.2379 | Thur 09:30am to 12:00pm in Meetings:7-First Half
Last updated: November 11, 2024

The smartphone is not only the primary site for digital communication and consumption, it also hosts emerging forms of media production. Let’s investigate the potential of the mobile touchscreen as a creative instrument!
This is a project based course, and we will explore by creating and testing a series of functioning web-based toys – including drawing apps, character creators, and writing tools. You can expect to sharpen your skills in javascript and design.

Expressive Environments: Building 3D Worlds (Topics in ITP) +

Thomas Martinez | Syllabus | ITPG-GT.2379 | Thur 12:10pm to 2:40pm in Meetings:7-First Half
Last updated: November 11, 2024

In this course, we will explore the history and practice of virtual world building for art, games, and (sub)cultural expression. Lessons will be structured around the Unity game engine, but participants will be encouraged to experiment with socially networked creator tools such as Roblox, and Second Life as well. Coursework will take the form of creative, and technical exercises, with some critical responses to readings and other media. Guiding our practice will be an attunement to our own creative voice, and the ways in which it can take shape in virtual worlds. Students will come away with a broad grounding in contemporary approaches to game and immersive experience design through an art context. The class will culminate in a student showcase of experimental and interactive 3D works. Though some instruction in computer programming will be covered, no previous coding experience is required.

Art as Activism: Empowering Creative Change Makers through Socially Engaged Art Practice (Topics in ITP) +

Camila Morales | Syllabus | ITPG-GT.2379 | Mon 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 11, 2024

Art as Activism: Empowering Creative Change Makers through Socially Engaged Art Practices” offers a hands-on curriculum for aspiring artists, designers, and creative technologists, inviting them to explore the intersection of art and technology as a catalyst for social change. This course introduces students to socially engaged art and design practices by presenting case studies and guest lectures by artists and technologists at the forefront of this field. Throughout the semester students will examine fundamental questions about the role of art and technology in fostering equity, social and environmental justice while emphasizing ethical considerations and community engagement in the digital realm.

Students will develop a final project researching a specific topic to apply concepts and techniques learned throughout the semester to foster tangible real-world transformations. In a world increasingly shaped by technological advances, this course equips students to emerge as empowered changemakers, capable of leveraging their creative and technological skills to enact meaningful and lasting impact.

Data Storytelling for Memory Making and Social Resilience (Topics in ITP ) +

John Henry Thompson | Shindy Johnson | ITPG-GT.2379 | Mon 3:20pm to 5:50pm in Meetings:7-Second Half
Last updated: November 11, 2024

This course will use the open source The COVID-19 Impact Project as an entry point to explore humanizing data on systemic inequity and injustice on a global and local scale.

In this course we will:

● Explore and invent creative uses of data for advocacy and change.
● Discover how data flows from public github repositories and tools needed to visualize the data.
● Review other data-centric open source projects for the public good and discuss the questions they are trying to answer or problems they are trying to solve.
● Examine and draw inspiration from historical and contemporary data visualizations developed by advocates for social justice and the public good.
● Use data visualization as a scaffold to explore ways to support community driven mourning and memorialization after mass death events.

Students can choose to participate as creatives, artists, javascript coders, p5js explorers, UI/UX designers, citizen journalists, data science explorers or social justice advocates.

Course Outline
● Open Source Projects for the Public Good
● Data: Sourcing, Humanizing and Creating Visual Narratives from Data
● Storytelling with and from Data
● Data storytelling as a scaffold to support grief, ritual and memorialization after mass death events

** Students wishing to pursue their final projects beyond the class will be provided with information about resources at NYU for supporting student projects that amplify underrepresented narratives.

** Students wishing to continue their participation in The COVID-19 Impact Project after the course ends should notify us as we are seeking grant funding to implement viable concepts.

Reconstructing Lost Spaces (Topics in ITP) +

Yuliya Parshina-Kottas | Syllabus | ITPG-GT.2378 | Fri 09:30am to 12:00pm in 370 Jay St, Room 410 Meetings:14
Last updated: November 11, 2024

Using Blender as our primary software, we will create digital reconstructions of physical spaces lost to violence, natural disasters, climate change, urban renewal and eminent domain. Students will explore techniques such as photogrammetry, machine learning and Blender’s modeling tools to turn archival and contemporary references into 3D models. We will analyze evidence from maps, photographs, newspapers, archival documents and social media with a special emphasis on source inclusivity, journalistic ethics and cultural sensitivity. Students will be challenged to create 3D models in the service of telling human stories. Pre-requisite: Hypercinema or equivalent experience.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 11, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 7, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Immersive Web +

Staff | Syllabus | IMALR-UT.XXXX | TBD Meetings:
Last updated: November 5, 2024

In Immersive Web, students break out beyond the confines of static 2D web pages and explore the affordances created by 3D. This course hopes to introduce new avenues for creative expression and experimentation via the web and promote practical web development skills through experiential learning. Students use libraries such as Three.js, A-Frame, Theatre.js, GSAP, Lenis, and more to create dynamic and immersive web-based experiences that push the boundaries of what is possible online. While there are no course prerequisites for this course, students are expected to have some familiarity with web development principles and technologies, specifically HTML, CSS, and Javascript.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 5, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: November 4, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: October 30, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Biophilic Experiences – activating our sensory relationship to nature +

Leslie E Ruckman | ITPG-GT.2361 | Fri 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: October 28, 2024

As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview.

This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org.

Data Storytelling for Memory Making and Social Resilience (Topics in ITP) +

John Henry Thompson | Shindy Johnson | ITPG-GT.2379 | Mon 3:20pm to 5:50pm in Meetings:7-Second Half
Last updated: October 11, 2024

This course will use the open source The COVID-19 Impact Project as an entry point to explore humanizing data on systemic inequity and injustice on a global and local scale.

In this course we will:

● Explore and invent creative uses of data for advocacy and change.
● Discover how data flows from public github repositories and tools needed to visualize the data.
● Review other data-centric open source projects for the public good and discuss the questions they are trying to answer or problems they are trying to solve.
● Examine and draw inspiration from historical and contemporary data visualizations developed by advocates for social justice and the public good.
● Use data visualization as a scaffold to explore ways to support community driven mourning and memorialization after mass death events.

Students can choose to participate as creatives, artists, javascript coders, p5js explorers, UI/UX designers, citizen journalists, data science explorers or social justice advocates.

Course Outline
● Open Source Projects for the Public Good
● Data: Sourcing, Humanizing and Creating Visual Narratives from Data
● Storytelling with and from Data
● Data storytelling as a scaffold to support grief, ritual and memorialization after mass death events

** Students wishing to pursue their final projects beyond the class will be provided with information about resources at NYU for supporting student projects that amplify underrepresented narratives.

** Students wishing to continue their participation in The COVID-19 Impact Project after the course ends should notify us as we are seeking grant funding to implement viable concepts.

Topics in ITP: The Art of Projection Mapping +

Motomichi Nakamura | Syllabus | ITPG-GT.2379 | Tues 3:20pm to 5:50pm in Meetings:7-First Half
Last updated: March 7, 2024

The course aims to teach the technical and artistic aspects of
Projection Mapping, enabling the creation of immersive and
experiential art installations. The focus extends beyond acquiring the
necessary technical skills for producing Projection Mapping works; it
also emphasizes the effective use of the medium to bring concepts to
life. Encompassing various types of projection mapping, such as
outdoor mobile projection, interactive wall, and holographic
projection, the curriculum encourages students to experiment with the
medium as much as possible. The goal is to produce work that
authentically represents each artist and achieves a harmonious balance
between art and the technologies they employ.

Topics in ITP: Outside The Box: Site-Specific + Immersive Explorations +

Mia Rovegno | Syllabus | ITPG-GT.2379 | Mon 6:00pm to 8:30pm in Meetings:7-First Half
Last updated: March 7, 2024

This course introduces students to modalities for creating site-specific and immersive art and performance. Assignments will examine the work of artists who challenge the limitations of the physical, psychological and transactional spaces that have come to define conventional production models. Students will regularly receive prompts from which collaborative work will be workshopped, generated and presented. The sites and practices explored will de-center script/text as spine, institutional space as gathering place, linear storytelling as narrative, and separation between audience and artist as social contract. Through group performance projects and presentations, students will investigate how Site evokes Narrative and Event differently in brick & mortar, virtual, historic, liminal, dead, found, contested, democratized and community spaces. Our work will unpack the challenges and opportunities presented when we relinquish creative control of such unfixed elements as serendipity, impermanence, improvisation, audience agency, public space, weather, and pandemic.

Topics in ITP: Music Design and Discovery +

Elliot Cole | Syllabus | ITPG-GT.2379 | Mon 12:10pm to 2:40pm in Meetings:7-Second Half
Last updated: March 7, 2024

Students will gain competency in the music production and performance software Ableton Live through a series of creative exercises. These exercises are heuristics in the sense that they’re designed to help students find well-formed musical solutions quickly and improvisationally, without presupposing a background in musical theory or performance.

I’ll introduce these technical topics alongside their artistic applications: audio editing (collage), midi (rhythm/melody/harmony), synthesis and effects (sound design), randomness (generative systems design), recording, and interfacing with external sensors, controllers and data (instrument design).

Weekly assignments will solidify skills explored in class.

Topics in ITP: Innovation at Speed +

Melissa Jackson-Parsey | Syllabus | ITPG-GT.2379 | Mon 6:00pm to 8:30pm in Meetings:7-Second Half
Last updated: March 7, 2024

How do you get more teens to participate in sport? Ensure that generative AI tools don’t perpetuate bias? Or make the process of renting a car suck less? These are some the big, broad questions you’ll tackle as part of this course. 

The format: Each week you’ll be tasked with a new, real-world challenge to address as part of a team. To help you, subject-matter experts in research, strategy and design will share valuable, relevant knowledge and frameworks for you to pressure-test. Your team will be expected to use these frameworks to break-down the problem, ideate quickly and present-back solutions. The form and shape of these solutions is for you to define. The only limitation is time. 

The goal is to help you hone your skills through rapid, practical application, while also exposing you to new methodologies and expertise that can elevate your craft. Innovation is a practice, not just a process, and at the end of 7 weeks we hope you’ll be more confident approaching ambiguous questions and working with others to shape new, unexpected solutions. 

We can’t predict the future, but we know the questions we’ll need to collectively solve will only become bigger, and more urgent. This is a bootcamp for everyone and anyone who’s up for taking them on.

Masquerade +

Ziv Schneider | ITPG-GT.2044 | Sat 12:10pm to 6:25pm in > Sun 12:10pm to 6:25pm in Meetings:S-Special
Last updated: March 7, 2024

Masks have been used around the world since antiquity for ceremonial and practical purposes, as devices for protection, disguise, entertainment and bodily transformation, made to be worn or displayed. Sociologist Erving Goffman wrote about the everyday life as a masked theatrical performance. The performative aspect of our lives today is ever so present in our use of social media, where we present a curated version ourselves for the immediate visual consumption of others. In our `Selfies`, we can assume a multitude of identities and characters. Recent tools and platforms have evolved social media portraiture to an art form and have created new opportunities for artists to create and distribute interactive augmentations, forming new relationships between artists and viewers. This class explores the developing language of social media portraiture enhanced by Augmented Reality. Students will: – review masks in art history, leading up to today – ideate, design and develop an interactive mask (AKA effects/lenses/filters) – learn to use the Meta Spark software to create AR effects.

This course requires CL: Hypercinema or equivalent experience.

Experiments on the Embodied Web +

Lisa M Jamhoury | Syllabus | ITPG-GT.3013 | Sat 11:40am to 6:10pm in > Sun 12:10pm to 6:10pm in Meetings:S-Special
Last updated: March 7, 2024

Today’s internet, made up of mostly text documents and two-dimensional images and videos, is the result of historical limitations in bandwidth, graphics processing and input devices. These limitations have made the internet a place where the mind goes, but the body cannot follow. Recent advances in motion capture devices, graphics processing, machine learning, bandwidth and browsers, however, are paving the way for the body to find its place online. Experiments on the Embodied Web will explore the new realm of embodied interactions in the browser across networks. The course will include discussion of influential works in the development of online embodied interaction, including the works of Kit Galloway and Sherrie Rabinowitz, Susan Kozel, and Laurie Anderson. Together we’ll explore pose detection across webRTC peer connections in p5.js and Three.js. Experience with Node, HTML and JavaScript is helpful but not required. ICM level programming experience is required.

Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)

Topics in ITP: Real World Client Centered Design Studio +

Phil Caridi | Noah Pivnick | Syllabus | ITPG-GT.2378 | Fri 12:10pm to 2:40pm in Meetings:14
Last updated: March 7, 2024

At its most wondrous, ITP is a lavish imaginarium rich with abundant opportunity for individual creative expression. But outside the walls of 370 Jay, reality awaits. Post graduation most creative engagements will be work for hire compounded by the unique wants, needs, and desires of multiple parties, not least of which: the client.

This is a production-focused class predicated on satisfying a brief from a real-world client. The brief will likely come with its own set of specific, prescriptive requirements. As a collective, we will be tasked with the design and fabrication of an experiential interactive the scale and depth of which warrants a life of its own beyond the confines of ITP. Together, we will engage in a semester-long exercise in project planning, resource allocation, project management, and client relations born of concrete expectations and deliverables. We’re putting the Professional back into Master of Professional Studies.

This class is open to 2nd year graduate students only. To be considered you must submit an application. Students will interview and submit a portfolio for review. Ideal candidates are multidisciplinary; the sum of their contribution to the class will be a function of more than one kind of work. Resource scheduling and allocation are a significant part of this exercise, ensuring the load is distributed equitably across all class members. We’re targeting 2nd year students and running the class in the fall so as to give students an opportunity to develop skills and practices that hold them in good stead once thesis transitions to production in the spring.

Text-to-Image AIs +

Yuguang Zhang | Syllabus | ITPG-GT.3020 | Fri 3:20pm to 5:50pm in Meetings:14
Last updated: March 7, 2024

Over the past few years, the unprecedented advancement in text-to-image artificial intelligence models has sparked widespread attention, discussion, and mainstream adoption of these innovative co-creative interfaces, which has resulted in novelty, excitement, and curiosity, as well as concern, anger, and insult. Alongside this, the booming open-sourced text-to-image model development contributes to expanding access to working with AI tools beyond experts, tech giants, and professional technologists.

In this 14-week course, we will go over the landscape of text-to-image AIs and dive deep into some of the most well known ones (such as Stable Diffusion and its variants), to see what potential they have in terms of exploring new modes of content creation and helping us re-examine our language pattern. This will be a practice + technique course – in the first half, we’ll focus on building good prompting practices, and in the second half, we’ll explore different image synthesis skills related to text-to-image AIs, use Python to train our own models to create customized visuals, and create animations from text. We’ll also discuss how such tools could intervene in the workflows of artists and technologists, what they can provide for researchers, and what are the caveats and things we should look out for when we’re creating with these AIs.

Pre-requisites: Introduction to Computational Media (ICM) or the equivalent.

Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)

Programming with Data +

Allison Parrish | Syllabus | ITPG-GT.3049 | Mon 6:00pm to 8:30pm in Meetings:14
Last updated: March 7, 2024

Data is the means by which we turn experience into something that can be published, compared, and analyzed. Data can facilitate the production of new knowledge about the world—but it can also be used as a method of control and exploitation. As such, the ability to understand and work with data is indispensable both for those who want to uncover truth, and those who want to hold power to account. This intensive course serves as an introduction to essential computational tools and techniques for working with data. The course is designed for artists, designers, and researchers in the humanities who have no previous programming experience. Covered topics include: the Python programming language, Jupyter Notebook, data formats, regular expressions, Pandas, web scraping, relational database concepts, simple data visualization and data-driven text generation. Weekly technical tutorials and short readings culminate in a self-directed final project.

Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)

Programming from A to Z +

This course is a survey of programming strategies and techniques for the procedural analysis and generation of text-based data. Topics include analyzing text based on its statistical properties, automated text production using probabilistic methods, and text visualization. Students will learn server-side and client-side JavaScript programming and build single-page web applications as well as bots for social media networks. Additionally, this course will also include examples on how to interface with the latest open-source and commercial machine learning models for text and image generation. The writing of this course description may or may not have been assisted by one of these so-called “AI” models The course will include weekly homework coding exercises and an open-ended final project.

Designing the Absurd +

Pedro Galvao Cesar de Oliveira | Syllabus | ITPG-GT.2052 | Thur 3:20pm to 5:50pm in Meetings:14
Last updated: March 7, 2024

Inspired by the Japanese art of Chindōgu, this class will introduce a playful and whimsical approach to learn industrial design.

In this 14-week studio format class, students will develop gadgets, inventions, and electronic devices that present absurd solutions to problems, while learning concepts and techniques of design ideation, prototyping, model making, CMF (color, material, and finishes), and manufacturing.

This is a production heavy four-credit course, where students will learn about industrial design and tangible interactions.

Prerequisite: Intro to Phys. Comp. (ITPG-GT 2301)

BioDesigning the Future of Food +

Nikita Huggins | Syllabus | ITPG-GT.3030 | Fri 3:20pm to 5:50pm in Meetings:14
Last updated: March 7, 2024

For centuries, food production practices such as permaculture fostered ecosystems intended to be sustainable and self-sufficient, while producing nutrient-dense food. Modern farming has introduced harmful monoculture practices proven to cause collateral destruction of biodiversity and seasonal harvesting, distancing us from our food ecosystems. The future of food can be regenerative or continue to contribute to massive health and environmental issues. How can we challenge ourselves to regain connection to our food system? How might we use innovation, personal prowess, design, and biotechnology to reimagine healthier ecosystems? This course examines the historical context of the food ecosystems and encourages students to identify with these systems that we (in urban settings) are disconnected with. Students will build a project around exploring innovative approaches to the future of food and our relationships with it. These projects will incorporate design, technology, science, and research elements.