Category Archives: Graduate

Courses for IMA Juniors and Seniors Only

Device to Database (ITPG-GT 2473)

How do you process data from connected devices? This class examines how to build systems to collect, process, store, and visualize data from connected devices. The class will review and discuss real world IoT systems using case studies and actual projects. We will build system using Arduino hardware and open source software. We will discuss how to IoT systems are built on commercial cloud infrastructure. Students will learn about IoT devices and the data pipelines for processing data. They will build an Arduino based device to send and receive data over WiFi via MQTT. Students will write code to move data from MQTT into a database. Students will learn how to query the database and present data as tabular data and graphs. To gain an understanding of an entire IoT system from device to application, we will start at a high level and then drill into each of the pieces — we will: * Discuss sensor hardware and wireless options (WiFi, Cellular, LoRaWAN, LTE-M, etc) for moving data to the server * Discuss transport options MQTT, CoAP, AMQP, HTTPS, etc. * Examine SQL, NoSQL, and Time Series Database * Look at tools and techniques for querying and visualizing data. Prerequisite: * Introduction to Physical Computing * Introduction to Computational Media (suggested) The class will be a mix of lecture, discussion, and building IoT systems. Real world examples and case studies will be used to demonstrate how IoT can be built.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2473-000 (22887)01/30/2020 – 03/12/2020 Thu12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Coleman, Don

Veillance (ITPG-GT 2469)

he course title, “Veillance” is a reference to the root of “surveillance” and “sousveillance”, watching from above and watching from below respectively. As digital media becomes a greater part of our everyday lives, it is important to understand the new forms of surveillance that it enables as well as to harness these capabilities and perhaps to create systems of sousveillance. Through the course, we’ll critically examine technologies that have become integral part of our lives; the technologies that drive the internet, the capabilities of web browsers, mobile phones, and the emerging class of networked devices such as IP cameras and Amazon’s Alexa and Google Home. Through the course of this examination, we’ll look at how this technology works, the policies that govern their use, what their benefits are, and finally look at what we are giving up by embracing them. This will be a hands-on endeavor; we’ll develop software to illustrate their use and misuse as well as looking for ways that we can harness their “veillance” capabilities for creative, educational, and possibly subversive purposes. Of course, in this process, we’ll pay particular attention to ethical and moral concerns. The course will have weekly reading and technical assignments, encompasses group work, and will culminate final projects.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2469-000 (23068)01/29/2020 – 05/06/2020 Wed12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Van Every, Shawn

Playful Experiences (ITPG-GT 2467)

Credits: 4
Duration: 14 Weeks
Dates: Thu

Forget the screen. People want to be part of the action. They don’t want to watch detectives and control superhero avatars. They want to solve the mystery and be the hero. They want to experience it. We see this craving for playful experience in everything from immersive theater to escape rooms to the Tough Mudder to gamified vacation packages. Designing live experiences for large audiences that demand agency offers a distinct set of challenges, from how much choice you give each participant to how many people you can through the experience. We’ll look at examples from pervasive games to amusement parks to immersive theater, examining both the design choices and technology that make the experiences possible. Along the way we’ll create large, playful experiences that put the participant at the center of the action.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Digital Security and Human Rights (ITPG-GT 2188)

What do WhatsApp and Nelson Mandela have in common? How about Mr. Robot and the UN Council for Human Rights? When most people think “digital security”, they rarely think of these connections; but the connections are there. Digital security is much more than an industry buzzword— it encompasses techno-social idealism, open source development, and symbiotic coordination between sectors in tech, the humanities, and civic society. Certainly, we’re going to talk about Signal, Tor, VPNs, and OTR. But let’s dig even deeper. In this course, students will learn the principals of digital security; from end-to-end encryption, to circumvention technology, resilient communications, and beyond. Part lab exploration, part oral history, and part prototyping workshop, students will come away with the tools they need to undertake development projects with end-user security in mind; and foster an appreciation for digital security’s integral, timely, and often life-saving role in human rights struggles across the globe.

Interactive Telecommunications (Graduate)
2 credits – 8 Weeks

Sections (Spring 2020)


ITPG-GT 2188-000 (22879)01/27/2020 – 03/23/2020 Mon6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Holmes, Harlo

Technology, Media and Democracy: Addressing the Threats to an Informed Electorate (ITPG-GT 2184)

Credits: 3
Duration: 15 Weeks
Dates:

Across the City’s universities, the Technology, Media and Democracy program will bring together journalism, design, and technical disciplines to understand the various threats to journalism and media, and attempt to address these challenges using technical and computational methods and techniques. The free press, journalism and the media are some of the most critical elements of our democracy, but have been increasingly under attack by political and market forces. These challenges include: dwindling resources and support for deep investigative journalism; smear, law and technical and even physical assaults of media organizations and journalists; challenges to credibility and reliability including fake news and discrediting campaigns; and shifting business models and income sources that threaten both local and national news organizations and coverage. This course will include various elements that will help frame the problem and build/prototype solutions.

Interactive Telecommunications (Graduate)
3 credits – 15 Weeks

Intro to Wearables (ITPG-GT 2189)

With emerging research and development with soft circuit technologies and its integration into textile and clothing design, the garment as a reactive interface opens up new possibilities in engendering self-expressions, sensory experiences and more. This 14-week class is to introduce students to this realm by creating connections between hardware engineering and textile crafting. The class is for students with basic physical computing knowledge to explore the possibility of wearables, and arouse discussion about the potential in re-imagining our relationship with personal devices, textiles and garment design as an interactive media.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2189-000 (23074)01/27/2020 – 05/11/2020 Tue6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Zhu, Jingwen

Collective Play (ITPG-GT 2176)

Rules of play shape competitive games from checkers to football. But how do rules of interaction shape everyday life? And what happens when there are no established conventions and the rules are being made up as we go along as they have been for the past 6 months of living almost exclusively online? In this course, we will explore, code and test design strategies for playful, serious and bizarre group interactions while at the same time interrogating both what it means to play and how individual identities and group behaviors emerge. (The interactions we create in this class will be designed specifically for synchronous, in-person, embodied experiences.) Some of the questions we will ask and attempt to answer: What motivates participation? What hinders it? When does participation become oppressive? What’s the difference between self-consciousness and self-awareness? Who has power? Who doesn’t? Are leaders necessary? What’s the difference between taking turns and engaging in conversation? What happens when the slowest person sets the pace? And most importantly, what happens when there are no rules? Interaction inputs we will play with will include: mouse, keyboard, mobile device sensors, and microphone. Outputs can include visuals, text and sound. We will use p5, websockets and node.js for real-time interaction. Class time will be split between group improvisation exercises, playing with and critiquing examples and translating design strategies into code and logic.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2025)


ITPG-GT 2176-000 (11384)01/22/2025 – 04/30/2025 Wed12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Yin, Yue

Synthetic Architectures (ITPG-GT 2177)

Credits: 4
Duration: 14 Weeks
Dates: Wed

For better or worse humanity is heading down the virtual rabbit hole. We’re trading an increasingly hostile natural environment for a socially networked and commercially driven artificial one. Whether it’s the bedrooms of YouTube streaming stars, the augmented Pokestops of Pokemon Go, the breakout rooms of a Zoom meeting, or even the “airspace” of Airbnb; we are witnessing a dramatic transformation of what occupying space means. The socially distanced measures as a result of the COVID-19 pandemic have only accelerated this societal embrace of the virtual. So where are these dramatic spatial paradigm shifts occurring? Who owns and occupies these spaces? Who are the architects and what historical and ethical foundations are they working from? What world do they want to build for humanity and where does the creative individual fit into it? Will it be a walled garden, a role-playing adventure or a tool for creating more worlds? The course will ask students to embrace the role of virtual architect, not in the traditional brick-and-mortar sense of constructing shelter, but in terms of the engagement with the raw concept of space. However this virtual space must be considered and evaluated as a “site,” that is activated and occupied by real people and all the limitations of physical space that they bring with them from the real world. This is the foundation of synthetic architecture; simulated space met with biological perception. This conceptual architecture is free from the confines of physics but host to a whole new set of questions: How do we embrace the human factors of a dimensionless environment? How do we make or encourage meaningful interactions within the limits of current technology? New models of interaction must inform and shape the architecture of virtual space – what does that look like? How can architecture and aesthetics inform the creation of virtual environments and immersive narratives? How do we acutely consider the psychological and social impacts of the worlds we design and what is the metaphorical ground plane to make sense of this virtual world, unbound by physics? About Jonathan Turner: http://www.jonathanwilliamturner.com/about/

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Mobile Lab (ITPG-GT 2180)

One of the most transformative consumer products in history, the iPhone remains the standard bearer for great design and user experience. With the latest version of iOS and the introduction of the iPhone X, Apple puts depth sensing and augmented reality in our pockets. How do we take advantage of this incredible platform to produce our own compelling experiences? This course will be a hands-on workshop where we explore the world beyond generic apps and push the boundaries of what’s possible on iOS hardware. We will cover both the design and technical elements that pertain to end-to-end mobile app development. Topics will include augmented reality, the Internet of Things, new interfaces for musical expression, voice interaction, wearables, and others… While the class will involve iOS programming instruction, the instructors will help facilitate coding using an established code base to ensure technical skills are not a bottleneck to implementation. Students should expect to spend additional time outside of class learning Swift and other related programming concepts. Full-time access to an iOS device and a Mac laptop running the latest operating systems are required. As part of the design process, we’ll host workshops and guest critiques with designers from top studios around New York City. At the end of the class, students will have a working app to add to their portfolios and a strong basis for future mobile application work.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2180-000 (23066)01/27/2020 – 05/11/2020 Thu3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by Lam, Nien · Buys, Sebastian

Choreographic Interventions (ITPG-GT 2175)

This course re-conceives interactive media as a form of choreographic intervention. Instead of asking how moving bodies can control media, we will ask how interactive systems can influence movement. How do you make someone feel soft inside? How do you shake an entire room? How do you orchestrate duets between strangers? To accomplish this, the class facilitates a semester-long collaboration between ITP students and dancers from the Barnard/Columbia Dance Department. Choreographers will learn to apply computational thinking to choreography and creative coders will learn to apply choreographic thinking to computation. To whatever extent possible, we will attempt to embody code. Using computer vision and visual media, we will look at directing both how people move (quality of movement) as well as where they move (pathways and spatial relationships). We will evaluate the strengths and weaknesses of the various sensing technologies available to us today. How wide is the gulf between what we can see and feel (strength, hardness, contortion) and what a computer can see and interpret (locations, contours, velocity, acceleration)? Class time will be split between movement exercises, playing with examples and deconstructing code. The class will culminate in a final showing of student work. All classes will take place at NYU with a separate weekly technical lab for ITP students.

Interactive Telecommunications (Graduate)
4 credits – 12 Weeks

Sections (Spring 2020)


ITPG-GT 2175-000 (22932)01/31/2020 – 04/24/2020 Fri3:00 PM – 6:00 PM (Late afternoon)at Brooklyn CampusInstructed by Yin, Yue

BioDesigning the Future of Food (ITPG-GT 2131)

We’ve been tinkering with the living systems that generate our foodstuffs for millennia. But climate change is radically and rapidly shifting these food landscapes, and the impacts include the extinction of many of the foods we love: chocolate, wine, beer, coffee and more importantly starvation for those in the world who are already food insecure. In this class, we’ll explore biotechnologies and bioengineering along with microbes and mushrooms to design and create pathways for the restoration of some of the damage we’ve wrought on our food system. We’ll also use art and design and systems thinking to build speculative and actionable projects that will focus not just on the future of food but the future of our planet and all of its inhabitants. This class is part of the Biodesign Challenge.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Summer 2021)


ITPG-GT 2131-000 (6365)05/24/2021 – 07/05/2021 Tue6:00 PM – 9:00 PM (Evening)at OnlineInstructed by Bardin, Stefani R

Magic Windows and Mixed-Up Realities (ITPG-GT 2122)

Magic windows that allow us to peek into different realities without leaving our physical space, lenses that reveal hidden layers of objects or navigating new universes within the same room. More than ever, mobile devices are getting a human-scale understanding of space and motion allowing us to create more intimate interactions with our surrounding spaces, leveraging them as a canvas to experience other realities. We now have the potential to give life to inanimate objects, tell stories through space, customizing private views of public spaces and recognize places we’ve never been. We’ll question what it means and how can we blend reality exploring themes such as: augmented space and new paradigms in social interaction, public space and privacy; storytelling and navigating the physical space like turning pages in a book; tangible interfaces, mixed objects and animism; Magic windows, x-ray vision, time-machines and impossible universes; Far away so close: telepresence and remote collaboration. The course will survey the past, current and up and coming technologies and experiences in Mixed Reality including environmental augmented reality and interactive projection mapping, handheld devices while fostering a strong user experience perspective on the affordances and constraints of each. We’ll research and discuss the design principles and guidelines for creating mixed reality experiences focusing on the links between real and virtual objects, interaction space and asymmetries between physical and digital worlds, environmental semantics and multimodal and tangible interaction. Technologies explored will be focusing on mobile platforms (phones, tablets) including Vuforia, SLAM, image and object recognition, depth sensing, projection mapping. Unity3D will be the development platform: students must have previous working knowledge of Unity3D and feel comfortable with independently developing using this platform. A working knowledge of Unity3D may be gained by going through the Unity 5 3D Essential Training Lynda Course prior to the course (log in to Lynda for free via https://www.nyu.edu/lynda).

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2122-000 (23437)01/30/2020 – 03/12/2020 Thu6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Pereira, Rui

Light and Interactivity (ITPG-GT 2133)

Credits: 4
Duration: 15 Weeks
Dates: Tue

We use light in all aspects of our lives, yet we seldom notice it. Most of the time, that’s no accident. Lighting in everyday life, well-designed, doesn’t call attention to itself. Instead it draws focus to the subjects and activities which it supports. In this class, you’ll learn how lighting is used for utilitarian, expressive, and informational purposes. We’ll consider the intersection of lighting design and interaction design, paying attention to how people interact with light. We’ll practice both analyzing lighting and describing its effects, in order to use it more effectively. On the technical side, you’ll learn the basics of the physics of light, its transmission and perception. We’ll talk about sources of light, both current and historical. We’ll work with computerized control systems for lighting and modern light sources, and we’ll create a number of lighting designs for different purposes. You’ll get practice building AC and DC electronic circuits, programming microcontrollers for physical interaction, and learning digital communications protocols such as DMX512 and HTTP and REST. Projects in this class will range from indicator lighting on devices to task and wayfinding lighting in everyday environments to stage and environmental lighting. We won’t spend time on projection or light used for purely expressive purposes, but will look at how to put light to work instead. We’ll focus our attention on lighting the subject at hand, whether that subject is a person, a living environment, or a workspace. This class will be production-intensive throughout the course of the spring semester. Second-year students will not be able to combine the assignments in this class with their thesis projects, though some of the skills may be complementary.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Exploring Concepts From Soft Robotics (ITPG-GT 2125)

Credits: 4
Duration: 14 Weeks
Dates: Fri

Because the full potential of the emerging field of soft systems is unrealized, there are countless opportunities for curious innovators to discover or develop novel soft systems. Soft robotic skills and techniques also open up a world of possibilities for large scale or surprising artwork. This course teaches hands-on fabrication techniques for constructing simple pneumatic actuators from cast silicone and heat-sealed mylar, and challenges participants to design and build their own. Lectures and discussion center on concepts from soft innovation history, the current state-of-the-art, and sister disciplines of bio-inspired and hybrid (soft/hard) robotics. Consideration of both brand new soft materials, from a class visit to Material ConneXion library, and everyday overlooked soft mechanisms, found in average retail stores, will require participants to look at softness through a new lens. Final projects will be the development of an original soft/flexible/hybrid research or artistic concept presented with context, material swatches with justifications for choices, and physical or modeled proof-of-concept. About Kari Love: http://www.karimakes.com

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Hacking the Browser (ITPG-GT 2811)

Web browsers were originally used only for displaying simple HTML pages, but over the years they have become supercharged all-powerful web execution machines. In this class we’ll explore experimental new features and HTML5 APIs that allow browsers to communicate with the OS and their environment. APIs that will be covered may include: Battery Status, Geolocation, notifications, accelerometer usage, video access, speech recognition, and text-to-speech. We’ll cover the mechanics of bookmarklets and Chrome extensions, with a sustained multi-week focus on building extensions and exploring Chrome’s extensions APIs. Class workshops will include projects such as building an ad blocker, programmatically replacing text and images on a website, and making sites that respond to external events. Students will give weekly in-class presentations on web capabilities, complete small weekly assignments, and present a final project. This class leans heavily on web technologies, and experience with HTML, CSS and modern JavaScript (ICM with p5.js or Commlab Web/Networked Media) is required.

Interactive Telecommunications (Graduate)
2 credits – 5 Weeks

Sections (Spring 2020)


ITPG-GT 2811-000 (22881)01/28/2020 – 03/03/2020 Tue6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Forsyth, Cory

Open Source Cinema (ITPG-GT 2865)

The medium of motion pictures will be will be transformed by virtual reality technologies. But the emerging hybrid form will likely have less to do with the iconic VR headset and immersion, than in the newly possible flow of expression in the other direction, out of the participant. This class looks at the true potential of virtual reality as its mutability, to put ordinary users in the role of director of visual media as they already are in their dreams and fantasies. Democratizing media by breaking it down into discrete more easily remixable parts has historically, from DNA to alphabets to movable type led to an explosion of expression and knowledge creation. Motion pictures, perhaps our most convincing medium, is now undergoing such a transformation thanks to virtual reality technologies. Specifically, we will look at how tools like depth cameras, motion capture, and machine learning can treat a scene as a collection of elements instead of a collection of pixels. We will work with the real-time 3D rendering capabilities available, even in your phone, for the instant contrivance of visual reality using compositing, the transformation of images and models as well as virtual camera moves. The class will also consider how the more conceptual dissection of film by cinema scholars and psychologist into things like plots and character types might be templated into reusable formulas for non-experts to create an emotionally satisfying dramatic arcs.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks

Sections (Spring 2020)


ITPG-GT 2865-000 (22861)03/25/2020 – 05/06/2020 Wed3:00 PM – 5:00 PM (Late afternoon)at Brooklyn CampusInstructed by O’Sullivan, Daniel

Electronic Rituals, Oracles and Fortune-Telling (ITPG-GT 2120)

According to anthropologists Filip de Boeck and René Devisch, divination “constitutes a space in which cognitive structures are transformed and new relations are generated in and between the human body, the social body and the cosmos.” In this class, students will learn the history of divination, engage in the practice of divination, and speculate on what forms divination might take in a world where the human body, the social body, and even the cosmos(!) are digitally mediated. Starting with an understanding of ritual and folk culture, we will track the history of fortune-telling from the casting of lots to computer-generated randomness to the contemporary revival of Tarot; from reading entrails to astrology to data science; from glossolalia to surrealist writing practices to the “ghost in the machine” of artificial intelligence. Weekly readings and assignments culminate in a final project.

Interactive Telecommunications (Graduate)
4 credits – 15 Weeks

Sections (Spring 2020)


ITPG-GT 2120-000 (22892)01/27/2020 – 05/11/2020 Tue12:00 AM – 2:00 PM (Early afternoon)at Brooklyn CampusInstructed by Parrish, Allison

Subtraction (ITPG-GT 2719)

Subtractive fabrication is a common manufacturing process that produces durable and functional objects. This class will cover multiple techniques on machining and milling raw material into custom parts. We will focus on both traditional and digital fabrication tools: lathe, CNC router, 4 axis mill, etc. We will cover CAD, CAM, and machine setups as well as research affordable desktop milling solutions for personal shops. The class will be hands on and fabrication heavy, paying close attention to precision, accuracy, and craftsmanship. There will be weekly fabrication exercises, a midterm, and a final project. It’s mill-er time.

Interactive Telecommunications (Graduate)
4 credits – 14 Weeks

Sections (Spring 2020)


ITPG-GT 2719-000 (22906)01/30/2020 – 05/07/2020 Thu9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Light, Benjamin

100 Days of Making (ITPG-GT 2793)

Credits: 2
Duration: 6 Weeks
Dates: Tue

Iteration and its impact on your creative process is the theme of this class. The format of the course turns its head on the traditional class structure and instead of focusing on syllabus that builds to a final project, the course is focused on a daily, iterative practice. Students will identify a theme, idea or topic they would like to explore over the course of 100 days and must commit to making or producing a variation on that idea and posting social evidence of their work every day for 100 days. Projects can focus on building, writing, drawing, programming, photographing, designing, composing or any creative expression. In parallel to the making, in-class lectures will examine the work of artists whose work has been defined by iteration and discuss the role of discipline and routine in the creative process.

Interactive Telecommunications (Graduate)
2 credits – 6 Weeks