Critical Objects (ITPG-GT 2496)

Art, design and experimental electronics can be great tools for inciting discussions of complex issues such as privacy, sexism, racism, economic inequality and climate change. This course aims to provoke thoughtful discussions of pressing issues through the combination of Art, Industrial Design and Embedded Electronics (sensors, actuators, wifi enabled microcontrollers – ESP32, raspberry pis). Topics will include technological disobedience, adversarial design and critical engineering. In this 14 week class, students will combine technology, design, and critical theory to build Art Objects / Interactive Sculptures that are aesthetically intriguing while socially relevant. This is a production heavy four-credit course, where students will learn about new-media critical theory, design and electronics. Prerequisites include an open mind, the drive to make, and physical computing.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Fall 2025)


ITPG-GT 2496-000 (11360)09/04/2025 – 12/11/2025 Thu3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by Galvao Cesar de Oliveira, Pedro

Autonomous Artificial Artists (ITPG-GT 2497)

Autonomous Artificial Artists (AAA) is a class to explore ways of making artworks “autonomous.” In this context, “autonomy” brings together three independent but related criteria: 1) artificial intelligence being a primary determinant in an artwork’s aesthetics 2) autonomous software principles culled from peer-to-peer network design, blockchain and decentralization technology, serverless and federated machine learning, cryptoeconomics, and agent-based multiplayer simulation. 3) crowd-sourced art where mass, unbounded cooperation of many participants creates novel artworks which represent the “hive mind” or collective input. The goal of this class is to learn a little bit about each of these seemingly disparate fields, and see how they may interact in interesting new ways. The idea of autonomous artworks is very new, and is being actively discussed by a small group of interdisciplinary researchers and artists since 2016/2017. Although the topic is highly experimental, it is nevertheless based on concrete technologies, making simultaneous use of several techniques which are under active development and have potentially far-reaching ramifications well outside the domain of art. The time is ripe for people within more design-oriented fields to begin thinking about how they might be used in a broader context. The class has both a theoretical component (learning about each of the individual technologies and their interplay) as well as a practical component: training and deploying generative models on computational environments that are as close to decentralized or autonomous as possible. In addition, we will explore prior notions of crowd-sourced or mass-collaborative art, touching on older principles and strategies such as Oulipo, exquisite corpse, and crowd-sourced computational artworks like Electric Sheep, Exhausting a Crowd, and others.

Interactive Telecommunications (Graduate)
2 credits – 5 Weeks

Sections (Spring 2020)


ITPG-GT 2497-000 (22882)04/06/2020 – 05/11/2020 Mon3:00 PM – 6:00 PM (Late afternoon)at Brooklyn CampusInstructed by Kogan, Gennady

Music Interaction Design (ITPG-GT 2475)

This class is a project development studio for interactive music projects —that is, pieces of music that are not linear, but rather offer multiple dimensions for listeners to explore (on their phones in a crowded subway, at an abandoned factory in Palermo, back on their couches after a long day, at a classical concert hall). Students will take a project from concept to execution over several iterations, applying Interaction Design principles and techniques. During the first half of the semester, they will gather aural and visual references, compose graphic notations, and create interactive studies to explore specific elements of their composition. This work will lead to the implementation of the midterm project: a functional, high-fidelity prototype. For their final projects, students will evaluate their midterm pieces from the perspectives of music, visual design and interaction design, and refine them to produce an expressive piece of interactive music. ICM or equivalent experience is required. Some experience in making or producing music will be useful, but is not required.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2475-000 (22929)01/28/2020 – 05/05/2020 Tue12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Pereira Hors, Luisa

Escape Room (ITPG-GT 2491)

Over 7 weeks students in this course will explore different game mechanics, puzzle mechanics, group dynamics, and narrative structures and work in groups to design and build a room sized escape game. We will explore how to design immersive and participatory experiences through play and problem solving. Students will construct weekly puzzles and narratives and in the final week build and operate an “escape room” experience. Prerequisites: Physical Computing and ICM. Comfort with fabrication strongly encouraged.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2491-000 (22864)01/28/2020 – 03/10/2020 Tue9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Rios, David


ITPG-GT 2491-000 (22865)03/24/2020 – 05/05/2020 Tue9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Rios, David

Product Design: Designing for People (ITPG-GT 2479)

In this course, students will learn the process of developing products that address user needs. Students will go through the process of identifying a user need, developing a product prototype, evaluating the product with the target user, and outlining the next development steps. Topics will include such elements as need finding, archetype development, user journey maps, ideation, prototyping, user evaluation and validation.

Interactive Telecommunications (Graduate)
2 credits – 5 Weeks

Sections (Spring 2020)


ITPG-GT 2479-000 (22859)01/30/2020 – 03/05/2020 Thu9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Lobel, Inna

Sound in Space (ITPG-GT 2485)

Stereo (2-speaker) sound is the default way we produce and distribute most audio. This class challenges the stereophonic-centricity of digital sound and instead focuses on the context of listening, interfacing and interacting with audio beyond 2 speakers. We will take a novel approach to spatialization by interfacing web technologies (Javascript, Web Audio, WebRTC) with multichannel audio to create room-scale interactive music and sonic spaces, and then make our findings publicly available through musical artifacts, open source tools, and documentation. We will explore conventional and unconventional loudspeaker arrangements ranging from 3 to 40 channels and how distribution and context affects music. Together, we will participate in a semester-long project examining the affordances of spatial and multichannel sound, designing and build open source tools to interface Tone.js, Higher-Order Ambisonics (HOA) and other multichannel techniques. Students will perform/install their final on the 40-channel speaker array at Dave&Gabe’s studio in Bushwick. Topics include 3D sound, open source, space and listening. Prerequisites: willingness to listen critically, some programming experience. No formal music training required.

Interactive Telecommunications (Graduate)
2 credits – 12 Weeks

Sections (Spring 2020)


ITPG-GT 2485-000 (22868)01/27/2020 – 04/20/2020 Mon6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Mann, Yotam

Resist! Intro to Technology Political Activism [A Product Design Perspective] (ITPG-GT 2483)

This class will apply a product and service design lens to the rapidly evolving role of technology in politics, government services, and human rights, with a dual focus on the use of technology to advance the public good, and the threats that technology can pose to various aspects of civil society. On the one hand, there has been an explosion of technology tools that aim to promote healthy and peaceful democracies, provide more efficient government services, and promote human rights. This course will survey those efforts and the product design methodologies that guide them. On the other hand, 2018 has been a reckoning year for technology all over the world. The post-mortem of the 2016 US Presidential election shined a light on technology’s role in a promulgating a deeply polarized electorate, enabling election-meddling from foreign actors, and profiligating fake news, while also raising deep concerns about data privacy and security for everyday citizens. Meanwhile, new technologies like AI and Blockchain are poised to have deeply transformative effects on multiple aspects of society – from policing to education to financial services. This course will also explore the risks various technologies can pose to privacy, safety, liberty, and well-being. The course will feature guest speakers from leading practitioners in the space. Potentially including the ACLU, Higher Ground Labs, Elucd (YC17), NYU Better Policing Initiative, Microsoft, and more.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2483-000 (23099)01/29/2020 – 03/11/2020 Wed6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Resner, Lyel

Big LEDs (ITPG-GT 2481)

Credits: 2
Duration: 7 Weeks
Dates: Thu

Light Emitting Diodes or LEDs are used creatively all around us. They have the ability to emit light at different colors and intensities instantly and from very tiny points. How can we make creative visual works out of these amazing devices? What construction methods can we use to make those works reliable? Big LEDs will cover the process of designing large LED systems. We will cover LED array hardware and how to map pixels from computer generated media onto them. We will go through every major part of the hardware – different styles of LED arrays, drivers and gateways, cables, data protocols, and how to safely power all of them. We will learn to use the pixel mapping softwares Enttec ELM and Madmapper. We will also cover the paperwork needed to furnish a professional LED installation, including drafting riser diagrams, plan, section, and elevation views, creating a bill of materials, and writing instructions for users and installers. This year’s final project will be a site-specific LED sculpture installed in a public space at 375 Jay St. The installations will be able to display student chosen media that can be viewed for one minute. Students will work either in groups or alone and can choose from one of four installation options to present on: – A prepared square section of 2.0mm pitch LED video tiles (approx 256px x 256px, 2’-6” x 2’-6”) – A prepared low-resolution sculpture with diffused linear elements (approx 500px, 2’-6” x 5’-0” overall) – A student conceptualized LED video tile project – A student conceptualized low-resolution project Because of this year’s pandemic, unprecedented changes have come to the professional world of LED installations. As a result, we will be using remote tools such as networked-based cameras, remote desktop applications, and virtual private network connections to watch and operate the final projects. We will spend class time setting these tools up together. The two prepared options for the final project will be installed and maintained by the instructor.

Interactive Telecommunications (Graduate)
2 credits – 7 Weeks

Playful Experiences (ITPG-GT 2467)

Credits: 4
Duration: 14 Weeks
Dates: Thu

Forget the screen. People want to be part of the action. They don’t want to watch detectives and control superhero avatars. They want to solve the mystery and be the hero. They want to experience it. We see this craving for playful experience in everything from immersive theater to escape rooms to the Tough Mudder to gamified vacation packages. Designing live experiences for large audiences that demand agency offers a distinct set of challenges, from how much choice you give each participant to how many people you can through the experience. We’ll look at examples from pervasive games to amusement parks to immersive theater, examining both the design choices and technology that make the experiences possible. Along the way we’ll create large, playful experiences that put the participant at the center of the action.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Veillance (ITPG-GT 2469)

he course title, “Veillance” is a reference to the root of “surveillance” and “sousveillance”, watching from above and watching from below respectively. As digital media becomes a greater part of our everyday lives, it is important to understand the new forms of surveillance that it enables as well as to harness these capabilities and perhaps to create systems of sousveillance. Through the course, we’ll critically examine technologies that have become integral part of our lives; the technologies that drive the internet, the capabilities of web browsers, mobile phones, and the emerging class of networked devices such as IP cameras and Amazon’s Alexa and Google Home. Through the course of this examination, we’ll look at how this technology works, the policies that govern their use, what their benefits are, and finally look at what we are giving up by embracing them. This will be a hands-on endeavor; we’ll develop software to illustrate their use and misuse as well as looking for ways that we can harness their “veillance” capabilities for creative, educational, and possibly subversive purposes. Of course, in this process, we’ll pay particular attention to ethical and moral concerns. The course will have weekly reading and technical assignments, encompasses group work, and will culminate final projects.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2469-000 (23068)01/29/2020 – 05/06/2020 Wed12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Van Every, Shawn

Device to Database (ITPG-GT 2473)

How do you process data from connected devices? This class examines how to build systems to collect, process, store, and visualize data from connected devices. The class will review and discuss real world IoT systems using case studies and actual projects. We will build system using Arduino hardware and open source software. We will discuss how to IoT systems are built on commercial cloud infrastructure. Students will learn about IoT devices and the data pipelines for processing data. They will build an Arduino based device to send and receive data over WiFi via MQTT. Students will write code to move data from MQTT into a database. Students will learn how to query the database and present data as tabular data and graphs. To gain an understanding of an entire IoT system from device to application, we will start at a high level and then drill into each of the pieces — we will: * Discuss sensor hardware and wireless options (WiFi, Cellular, LoRaWAN, LTE-M, etc) for moving data to the server * Discuss transport options MQTT, CoAP, AMQP, HTTPS, etc. * Examine SQL, NoSQL, and Time Series Database * Look at tools and techniques for querying and visualizing data. Prerequisite: * Introduction to Physical Computing * Introduction to Computational Media (suggested) The class will be a mix of lecture, discussion, and building IoT systems. Real world examples and case studies will be used to demonstrate how IoT can be built.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2473-000 (22887)01/30/2020 – 03/12/2020 Thu12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Coleman, Don

Intro to Wearables (ITPG-GT 2189)

With emerging research and development with soft circuit technologies and its integration into textile and clothing design, the garment as a reactive interface opens up new possibilities in engendering self-expressions, sensory experiences and more. This 14-week class is to introduce students to this realm by creating connections between hardware engineering and textile crafting. The class is for students with basic physical computing knowledge to explore the possibility of wearables, and arouse discussion about the potential in re-imagining our relationship with personal devices, textiles and garment design as an interactive media.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2189-000 (23074)01/27/2020 – 05/11/2020 Tue6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Zhu, Jingwen

Digital Security and Human Rights (ITPG-GT 2188)

What do WhatsApp and Nelson Mandela have in common? How about Mr. Robot and the UN Council for Human Rights? When most people think “digital security”, they rarely think of these connections; but the connections are there. Digital security is much more than an industry buzzword— it encompasses techno-social idealism, open source development, and symbiotic coordination between sectors in tech, the humanities, and civic society. Certainly, we’re going to talk about Signal, Tor, VPNs, and OTR. But let’s dig even deeper. In this course, students will learn the principals of digital security; from end-to-end encryption, to circumvention technology, resilient communications, and beyond. Part lab exploration, part oral history, and part prototyping workshop, students will come away with the tools they need to undertake development projects with end-user security in mind; and foster an appreciation for digital security’s integral, timely, and often life-saving role in human rights struggles across the globe.

Interactive Telecommunications (Graduate)
2 credits – 8 Weeks

Sections (Spring 2020)


ITPG-GT 2188-000 (22879)01/27/2020 – 03/23/2020 Mon6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Holmes, Harlo

Technology, Media and Democracy: Addressing the Threats to an Informed Electorate (ITPG-GT 2184)

Credits: 3
Duration: 15 Weeks
Dates:

Across the City’s universities, the Technology, Media and Democracy program will bring together journalism, design, and technical disciplines to understand the various threats to journalism and media, and attempt to address these challenges using technical and computational methods and techniques. The free press, journalism and the media are some of the most critical elements of our democracy, but have been increasingly under attack by political and market forces. These challenges include: dwindling resources and support for deep investigative journalism; smear, law and technical and even physical assaults of media organizations and journalists; challenges to credibility and reliability including fake news and discrediting campaigns; and shifting business models and income sources that threaten both local and national news organizations and coverage. This course will include various elements that will help frame the problem and build/prototype solutions.

Interactive Telecommunications (Graduate)
3 credits – 15 Weeks

Choreographic Interventions (ITPG-GT 2175)

This course re-conceives interactive media as a form of choreographic intervention. Instead of asking how moving bodies can control media, we will ask how interactive systems can influence movement. How do you make someone feel soft inside? How do you shake an entire room? How do you orchestrate duets between strangers? To accomplish this, the class facilitates a semester-long collaboration between ITP students and dancers from the Barnard/Columbia Dance Department. Choreographers will learn to apply computational thinking to choreography and creative coders will learn to apply choreographic thinking to computation. To whatever extent possible, we will attempt to embody code. Using computer vision and visual media, we will look at directing both how people move (quality of movement) as well as where they move (pathways and spatial relationships). We will evaluate the strengths and weaknesses of the various sensing technologies available to us today. How wide is the gulf between what we can see and feel (strength, hardness, contortion) and what a computer can see and interpret (locations, contours, velocity, acceleration)? Class time will be split between movement exercises, playing with examples and deconstructing code. The class will culminate in a final showing of student work. All classes will take place at NYU with a separate weekly technical lab for ITP students.

Interactive Telecommunications (Graduate)
4 credits – 12 Weeks

Sections (Spring 2020)


ITPG-GT 2175-000 (22932)01/31/2020 – 04/24/2020 Fri3:00 PM – 6:00 PM (Late afternoon)at Brooklyn CampusInstructed by Yin, Yue

Synthetic Architectures (ITPG-GT 2177)

Credits: 4
Duration: 14 Weeks
Dates: Wed

For better or worse humanity is heading down the virtual rabbit hole. We’re trading an increasingly hostile natural environment for a socially networked and commercially driven artificial one. Whether it’s the bedrooms of YouTube streaming stars, the augmented Pokestops of Pokemon Go, the breakout rooms of a Zoom meeting, or even the “airspace” of Airbnb; we are witnessing a dramatic transformation of what occupying space means. The socially distanced measures as a result of the COVID-19 pandemic have only accelerated this societal embrace of the virtual. So where are these dramatic spatial paradigm shifts occurring? Who owns and occupies these spaces? Who are the architects and what historical and ethical foundations are they working from? What world do they want to build for humanity and where does the creative individual fit into it? Will it be a walled garden, a role-playing adventure or a tool for creating more worlds? The course will ask students to embrace the role of virtual architect, not in the traditional brick-and-mortar sense of constructing shelter, but in terms of the engagement with the raw concept of space. However this virtual space must be considered and evaluated as a “site,” that is activated and occupied by real people and all the limitations of physical space that they bring with them from the real world. This is the foundation of synthetic architecture; simulated space met with biological perception. This conceptual architecture is free from the confines of physics but host to a whole new set of questions: How do we embrace the human factors of a dimensionless environment? How do we make or encourage meaningful interactions within the limits of current technology? New models of interaction must inform and shape the architecture of virtual space – what does that look like? How can architecture and aesthetics inform the creation of virtual environments and immersive narratives? How do we acutely consider the psychological and social impacts of the worlds we design and what is the metaphorical ground plane to make sense of this virtual world, unbound by physics? About Jonathan Turner: http://www.jonathanwilliamturner.com/about/

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Collective Play (ITPG-GT 2176)

Rules of play shape competitive games from checkers to football. But how do rules of interaction shape everyday life? And what happens when there are no established conventions and the rules are being made up as we go along as they have been for the past 6 months of living almost exclusively online? In this course, we will explore, code and test design strategies for playful, serious and bizarre group interactions while at the same time interrogating both what it means to play and how individual identities and group behaviors emerge. (The interactions we create in this class will be designed specifically for synchronous, in-person, embodied experiences.) Some of the questions we will ask and attempt to answer: What motivates participation? What hinders it? When does participation become oppressive? What’s the difference between self-consciousness and self-awareness? Who has power? Who doesn’t? Are leaders necessary? What’s the difference between taking turns and engaging in conversation? What happens when the slowest person sets the pace? And most importantly, what happens when there are no rules? Interaction inputs we will play with will include: mouse, keyboard, mobile device sensors, and microphone. Outputs can include visuals, text and sound. We will use p5, websockets and node.js for real-time interaction. Class time will be split between group improvisation exercises, playing with and critiquing examples and translating design strategies into code and logic.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2025)


ITPG-GT 2176-000 (11384)01/22/2025 – 04/30/2025 Wed12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Yin, Yue

Mobile Lab (ITPG-GT 2180)

One of the most transformative consumer products in history, the iPhone remains the standard bearer for great design and user experience. With the latest version of iOS and the introduction of the iPhone X, Apple puts depth sensing and augmented reality in our pockets. How do we take advantage of this incredible platform to produce our own compelling experiences? This course will be a hands-on workshop where we explore the world beyond generic apps and push the boundaries of what’s possible on iOS hardware. We will cover both the design and technical elements that pertain to end-to-end mobile app development. Topics will include augmented reality, the Internet of Things, new interfaces for musical expression, voice interaction, wearables, and others… While the class will involve iOS programming instruction, the instructors will help facilitate coding using an established code base to ensure technical skills are not a bottleneck to implementation. Students should expect to spend additional time outside of class learning Swift and other related programming concepts. Full-time access to an iOS device and a Mac laptop running the latest operating systems are required. As part of the design process, we’ll host workshops and guest critiques with designers from top studios around New York City. At the end of the class, students will have a working app to add to their portfolios and a strong basis for future mobile application work.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2180-000 (23066)01/27/2020 – 05/11/2020 Thu3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by Lam, Nien · Buys, Sebastian

BioDesigning the Future of Food (ITPG-GT 2131)

We’ve been tinkering with the living systems that generate our foodstuffs for millennia. But climate change is radically and rapidly shifting these food landscapes, and the impacts include the extinction of many of the foods we love: chocolate, wine, beer, coffee and more importantly starvation for those in the world who are already food insecure. In this class, we’ll explore biotechnologies and bioengineering along with microbes and mushrooms to design and create pathways for the restoration of some of the damage we’ve wrought on our food system. We’ll also use art and design and systems thinking to build speculative and actionable projects that will focus not just on the future of food but the future of our planet and all of its inhabitants. This class is part of the Biodesign Challenge.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Summer 2021)


ITPG-GT 2131-000 (6365)05/24/2021 – 07/05/2021 Tue6:00 PM – 9:00 PM (Evening)at OnlineInstructed by Bardin, Stefani R