How does someone go about changing the world? What does social change theory suggest are the most effective tactics to change hearts and minds? What can we learn from the past about what it means to be an effective agent of change? How have social entrepreneurs created organizations that become engines of change? How has technology, social media and trends in mainstream media changed the rules of the game? This course will focus on social change theory and explore social movements in post-WWII America, including: the movement for Black civil rights, the LGBTQ Movement, Environment/Climate Activism, the Women’s Movement; the Conservative Movement, Corporate Social Responsibility and social entrepreneurship, Immigration, Healthcare, Journalism, Whistleblowing & Hacktivism, and the Free Speech movement.
“This introductory class is designed to allow students to engage in a critical dialogue with leaders drawn from the artistic, non-profit and commercial sectors of the new media field, and to learn the value of collaborative projects by undertaking group presentations in response to issues raised by the guest speakers. Interactive media projects and approaches to the design of new media applications are presented weekly; students are thus exposed to both commercial as well as mission-driven applications by the actual designers and creators of these innovative and experimental projects. By way of this process, all first year students, for the first and only time in their ITP experience, are together in one room at one time, and as a community, encounter, and respond to, the challenges posed by the invited guests. The course at once provides an overview of current developments in this emerging field, and asks students to consider many questions about the state of the art. For example, with the new technologies and applications making their way into almost every phase of the economy and rooting themselves in our day to day lives, what can we learn from both the failures and successes? What are the impacts on our society? What is ubiquitous computing, embedded computing, physical computing? How is cyberspace merging with physical space? WHY ARE WE HERE? -To see how the many things you might learn at ITP might be applied in the world (across many different fields), and to develop your own nuanced point of view on those applications -Think through the lens of designing engaging experiences -To build a shared language with your cohorts – about ITP, about your interests, about emerging technologies and ideas -To practice to collaboration in a way that emphasizes generosity, curiosity and communication -To practice a process of observation and articulation as a starting point for a design process. -To be inspired by different possible visions for your future. -To get a glimpse of the foundational character of the program: experimentation, play, thoughtfulness, emergence, interdisciplinarity, collaboration, criticality -To co-create a culture in which you have a sense of belonging / agency through your own ability to participate in its making WHAT HAPPENS IN CLASS? -Groups facilitate an experiences for the class, in response to the prior week’s guest -Small group discussions -Distribute invitations, made by you, to experiences in NYC -Hear from Guest Speaker -Short Q&A/ Final discussion with Guest”
Internship can fulfill a Tier 2 (elective) requirement. An internship is done with an outside agency that provides a student with opportunities to work on projects that enable the student to develop and demonstrate his or her practical abilities, and which involve both new interactive technologies and their users.
This course focuses on programming strategies and techniques behind procedural analysis and generation of text-based data. We’ll explore topics ranging from evaluating text according to its statistical properties to the automated production of text with probabilistic methods to text visualization. Students will learn server-side and client-side JavaScript programming and develop projects that can be shared and interacted with online. This fall the course will also explore topics in machine learning as related to text. There will be weekly homework assignments as well as a final project.
This course examines the social, economic and environmental dimensions of sustainable urban development. Some of the major themes explored include indicators of sustainability, urban demographic trends, environmental justice, green building, urban sprawl, sustainable energy and transportation, and global climate change. In addition, the role of information technology (IT) and social networks is discussed in the context of promoting ideas globally about sustainable development.
This course covers Passive DC circuit elements, Kirchoff’s laws, electric power calculations, analysis of DC circuits, Nodal and Loop analysis techniques, voltage and current division, Thevenin’s and Norton’s theorems, and source-free and forced responses of RL, RC and RLC circuits. Prerequisite: MATH-SHU 131 or MATH-SHU 201. Fulfillment: CE required; EE required; Core Curriculum Science Experimental Discovery in the Natural World.
This course will provide undergraduate students with an understanding of the political and governmental processes that influence New York City. The course will explore the structure of the municipal government, the role of the mayor and city council, the way in which state and regional agencies affect public services, and the role of the media in the political life of New York City.
Health care now constitutes almost 15f the U.S. economy. The broad range of issues involving health care and health care delivery are at the center of national and local policy debates: Disparities in access and outcomes for vulnerable populations; right to control decisions about treatment and about dying; medical malpractice; the adequacy of the evidence base underlying medical decisions; the pharmaceutical industry and its role in health care and politics; the impact of an aging population; and coping with accelerating health cost. This course is an introduction for undergraduate students to the major policy issues affecting health care and examines the role of government in the health care system. An important focus of the course is an assessment of the role of policy analysis in the formation and implementation of national and local health policy. Because much of government health policy relates to or is implemented through payment systems, several sessions involve some discussion of the policy implications of how government pays for care. The role of the legal system with respect to adverse medical outcomes, economic rights, and individual rights is also discussed. Proposals for health policy reform at the national and local level are examined throughout the course, with an emphasis on Medicare and Medicaid reforms currently being implemented or considered.
In the context of an increasingly polarized American society, this course seeks to train students to mobilize diverse faith communities together for the greater good. Unleashing the power of their own story, students will articulate their values and explore the ways it can be shared. The course will draw on case studies from historical and contemporary faith leaders who have achieved success in creating sustainable change, as well as interrogating relevant current affairs as they arise. Students will learn to recognize how stories are used to motivate action, to recognize the ways that race, power and privilege play a role in elevating and downplaying stories and to identify the role values play in motivating action.
In the context of a growing number of intersecting local, national, and global crises, each warranting political strategy, operational responses, and humanitarian planning across a range of states, agencies, movements, technical and political actors, this course focuses on exploring: the relationships between and among decision-makers and affected populations; the political economy of resource mobilization and distribution; the practical tools, frameworks, and blueprints used for response; questions of power in the context of emergency, and; historical determinants of humanitarian need, responsibility, and intervention. This course digs deeply into the political economy, politics, infrastructure, design, incentives, and dilemmas related to the current development and emergency paradigms, with specific exploration of what constitutes humanitarian action, aid, response, and ethics. Blending both practitioner and theoretical perspectives, this course takes a critical approach to the evolution of development concepts, slow and fast emergency, and structural inequality as they are shaped by historical events and processes, institutions, and ideologies – while simultaneously exploring the role of contemporary aid systems, political and social responses in perpetuating and remedying each. There is special emphasis on the perspectives and vantage points of people most directly affected by perpetual emergency. While not centered on or around the COVID-19 pandemic that has shaped our lives for the last three years, we will incorporate its context and reference it as an embodied case for better understanding the realities and power dynamics affecting “local populations” that we often speak about in this work, as well as a growing field of policy research and practice surrounding compounding crises, or “polycrises.” Throughout the course, which will utilize active learning modalities such as simulations, large and small group discussion, mapping and platform analysis, analysis of films, discussion of readings, guest speakers from other geographies, and individual reflection, we will engage (and often struggle with) fundamental (and technical) questions such as: • What are the political, social and economic underpinnings of contemporary development, emergency, and humanitarian discourse? • How does the design of development and humanitarian infrastructure and technical systems contribute to or alleviate structural inequality within and across societies as part of long-term development paradigms or short-term emergency response? • What does it mean to be an individual engaged in humanitarian, emergency, and development work as an affected population, as a decision-maker, as an insider or outsider? As an individual or as part of an institution? What are the historical and contemporary sources of these roles, norms, and practices? • What are the origins and starting points of an emergency? When can we say an emergency has ended? • How does a focus on underlying causes and power relations change our analysis of the problems and solutions? Should politics be removed from practice & intervention or amplified? • As people affected by an emergency are not a monolith, how can we define “local” and “sovereign” in mapping competing interests and power dynamics within communities affected by emergency? • Should we reform or abandon the current humanitarian/development aid system toward alternatives?
This multidisciplinary course allows students from a variety of backgrounds to work together to learn about and develop assistive technology, as well as cultivate a better understanding of the people being served. Students will work in teams to identify clinical needs relevant to their chosen client and learn the process of developing an idea and following that through to the development of a prototype product.
This course will cover a variety of academic topics within the field of Interactive Telecommunications. For further details, please refer to the individual class section notes and topic subtitle.
This course will cover a variety of academic topics within the field of Interactive Telecommunications. For further details, please refer to the individual class section notes and topic subtitle.
This course will cover a variety of academic topics within the field of Interactive Telecommunications. For further details, please refer to the individual class section notes and topic subtitle.
While all art is political, not all art is designed to engage directly with policy debates. This course will explore various ways that art is incorporated into advocacy, and how non-artistic advocates understand the role of art in their work. Students will leave this course with a better understanding of how advocates think about art and artists in their advocacy, how they might partner with advocates on issues they care about, and how to maximize the impact of their art on policy debates.
Focusing on motion capture (ak. MoCap), this class introduces basic performance skills alongside 3d graphic manipulation to create real-time virtual experiences. In this class we will have the opportunity to build sets, produce interactive props, and design unique characters to tell stories or engage with audiences. Utilizing Optitrack Motion Capture system, Blender, Motionbuilder, and Unreal Gaming Engine; we will create, rig, animate, and perform as avatars.
Over the past 3 years, we have seen many aspects of our lives thrust online. Increasingly, we are working, learning, socializing with family and friends, attending live performances and more through 2D grids of video feeds on platforms such as Zoom and Google Meet. These communication tools have become essential for remote communities to connect, yet fail to replicate many of the most engaging, messy and human aspects of our in-person experience. What happens when we break out of this grid and explore new forms of real-time social interactions online using webcam video and audio? Recent explorations in this realm have shown the promise of spatial metaphors in creating engaging real-time social interactions online. In this course, students will create their own series of experimental social spaces that explore these questions: how does the shape and nature of our environment affect the way we communicate? What unique forms of real-time expression and sharing might be possible online (and only online)? How might we design experiences for the unique social dynamics we want to support? Students will be exposed to principles of spatial design as well as a series of open source Javascript tools for arranging live webcam video and audio in 2D and 3D space in the browser. They will use WebGL (through the three.js library) to build 2D and 3D environments, and will be exposed to WebRTC (Web Real-Time Communications) and Node.js to add interactivity to those environments.
In study after study, people lying on their deathbeds overwhelmingly say they regret five things at their end of their life: 1. Not living a life of authenticity 2. Working too hard at the expense of their relationships 3. Not having the courage to express their feelings 4. Not staying in touch with friends. 5. Not letting themselves be happier. For leaders, it’s not any different. This course unpacks each of these “regrets” with readings, exercises, meditation, deep listening, skill development and leadership theory, examining historical and contemporary answers to the question of what really matters in life, and providing the space for students to grapple with the question themselves.
Code Lab 2 is a continuation in exploring how to craft game with programming. In Code Lab, we examined how to make games in openFrameworks, starting from scratch. This class will be a workshop, building off of that knowledge, but focusing on learning how to work with code that is already written. Students will learn to work with a new Integrated Development Environment (IDE), eclipse, learn to work with a version control system, and work in depth with Java and Processing. Over the course of the class, students will be given several versions of classic games (Pong, Space Invaders, Asteroids, etc.) that are incomplete or have an obvious bug. They will learn to read the code, identify how to correct the issue with the game, and then eventually modify it to make their own new version of the game. These skills are essential to work with code from other developers, whether they are members of the same team, open source projects, or examples provided in tutorials and readings.
This course is a general introduction to nonprofit management, with heavy emphasis on practical application. How do not-for-profit organizations actually function? How do they attract “customers?” How do these companies grow when there are no owners with financial incentives to grow the business? What are the core elements of a “good” not-for-profit company? What are the metrics for determining the health of a company without profit? And, what, exactly does not-for-profit even mean?
The class is to consider the depth of grief and loss within artistic responses and to inspire love and hope with our creative transformation. How does the artist process or respond to the emotions and events of loss? What are cultural heritage examples? What are ways we were taught in our families? What traditions do we wish to reimagine? Who needs to be commemorated? Is creative transformation possible? Is there a space for hope, love and joy within the complexity of these emotions? The course will have creative exercises and conceptual prompts that can be developed in the medium of your choice. We will consider creative texts such as visual, film, music, media, performance, installation, and poetic examples to broaden and inspire our understanding of ways to respond. There are other forms of expression to contemplate such as fashion, outsider art, architecture, archives, memorials, gardening, and cultural movements. We will have discussion, guests, field trips, and presentations. Is there a way to create an archive? How do we document or forget? Together we will be a collective of considering, contemplating and creating. Some of the strategies we will be considering are: metaphor, expression within nature, fairy tales, abstraction, fragments, love, celebration and the space of silence for restoration. Some of the artists /writers will be Maya Angelou, Dunbar, David Wognarowicz, Krishnamurti, Pamela Sneed, Barthes, Rilke and bell hooks. We will look at films such as the 1926 silent film, Page of Madness by Kunsuga, Let me Come in by Bill Morrison, or News From Home by Chantal Ackerman. I look forward to being your guide for the seminar, Grief, Loss , Love, Hope and Creative Transformation. Feel free to contact me with any questions karen.finley@nyu.edu
Data is the means by which we turn experience into something that can be published, compared, and analyzed. Data can facilitate the production of new knowledge about the world—but it can also be used as a method of control and exploitation. As such, the ability to understand and work with data is indispensable both for those who want to uncover truth, and those who want to hold power to account. This intensive course serves as an introduction to essential computational tools and techniques for working with data. The course is designed for artists, designers, and researchers in the humanities who have no previous programming experience. Covered topics include: the Python programming language, Jupyter Notebook, data formats, regular expressions, Pandas, web scraping, relational database concepts, simple data visualization and data-driven text generation. Weekly technical tutorials and short readings culminate in a self-directed final project.
This course explores the ways that we perform on and for the Internet. We’ll take a look at how artists have used social media, live-streaming, and multi-user online spaces as a site for performance. Students will conduct their own interventions with the web as a virtual stage. Note: Performance is a broad and amorphous term! You are encouraged to take this course even if you do not consider yourself a performer or someone who wants to be in front of a camera.
This course covers the next several years of evolution in technology, culture, and other trends. It uses scenario planning, a technique for considering complex interrelationships that can’t be predicted, distinguishing predetermined elements from critical uncertainties, and exploring the underlying patterns that influence events. Students will conduct original research on significant trends, use those trends to develop compelling, sophisticated, plausible stories about possible futures, and present the futures – and the strategies they suggest – to a public audience. The course will take place at a pivotal moment of historical uncertainty: recovering from a global pandemic, with AI and other digital technologies crossing a threshold, and dramatic political and economic tensions. All of these, and more, affect media development – and are deeply affected by them. The goal of the course is to enable you to make more robust decisions now in the face of uncertainty — applicable to planning for technological change, starting a business, plotting a career or making major life decisions. This class has developed a longstanding following at ITP because it helps us make sense of complex issues without oversimplifying them. In a climate of candid, respectful discussion and debate, the class explores theories about system dynamics, long-wave organizational and societal change, and economic and technological development.
“Designing for” classes focus on working with a real-world client or partner, preparing students for professional collaborations with institutions, publishers and media companies beyond the game industry who partner with game developers on playable experiences. Outside partners have included museums, non-profit organizations, non-digital publishers and digital media platforms. In each version of this class, students will interact directly with representatives from one outside partner and collaborate with other students on a single semester-long project tailored to the client’s goals, developing an initial idea from conceptualization through pitching and prototyping, based on criteria and feedback provided by the partner. Students will learn to follow a structured process for ideation, collaboration and prototyping, while taking care to understand the audience, content and goals of the partner organization’s industry and the context of play. The semester culminates in a final presentation of playable prototypes to the partner.
“What does biology have to do with art? Bioart is a discipline in which artists use life itself as a medium for creative experimentation and reflection on the social implications of cutting edge biological science. Biopolitics describes the ways in which DNA and other forms of biological knowledge combine with the accumulation of data to segment, categorize, and predict our behavior. In this course we will take a tour of the materials and techniques utilized by artists in the emerging field of biological art, with a focus on genomics and its political and social implications. This hybrid art and science class will introduce concepts in personal genomics, genetic engineering, speculative design, bioart, biopolitics, critical engineering, and bioethics as sites for activism and artistic exploration. Students will extract and analyze their own DNA while discussing human evolution and the social construction of identity. They will learn how DNA extraction and sequencing works, how to analyze real genomic data, and will incorporate this in creative and critical projects. Regular readings and in-class discussions will supplement artistic projects.”
“What does it mean to make something that lasts? In this 7-week studio, we will attempt to understand the collective hallucination that is the Internet, while rationalizing the intersection of permanence, mutation, utility and ownership in creative digital work. To support this investigation, we will: – Use hands-on workshops to understand and build various forms of generating digital art – Consider the implications of storage and longevity – Have a working knowledge of marketplace capabilities, and their influence on the art that they contain – Expand on our understanding of verifiable ownership, blockchain and otherwise, and how it can have impact beyond the digital landscape Through this class, you will develop work that considers time as a critical axis, be it the longevity of the outcome, or the impermanence of the idea. Work may live on the blockchain, utilize generative ai frameworks, or manifest as a performance in a snowstorm.”
Course Description: In this 14-week course, students will explore sound design fundamentals through modular synthesizers, leveraging the capabilities of microcontrollers. Modular synthesizers are a type of electronic musical instrument used to generate, manipulate, and shape sound through the interconnection of individual modules, or components. This course is designed to equip students with the skills and creative prowess required to craft their own unique devices that adhere to the Eurorack design format; a popular modular synthesizer standard. The curriculum blends the art of sound design with the technical aspects of hardware synthesizer architecture, building skills so that by the end of this course students will have the competence to bring their sonic visions to life in physical form through thoughtful interaction. By harnessing the modular nature of these components, students will work independently, taking into consideration the designs of their peers to ensure seamless compatibility between their devices, resulting in a distinct ‘voice’; a term used to describe a collection of components that define the signal path of a synthesizer. The first half of the course will focus on sound design coding techniques utilizing the Teensy microcontroller, with the second half dedicated to developing tangible hardware design skills. Prerequisites: Intro to Physical Computing No sound design/musical experience is required.
“How can we create services – digital or otherwise – that scratch psychological itches in ways that take into consideration the uncontrollable nature of users? In this course, we marry the art of design with the science of psychology. The offspring of this match is complicated, unexpected and never predictable – but indelibly informed by both its binary and analogue parentage. Leaning on a variety of international case studies that tickle our human passion for enquiry, for storytelling, for sensation, and for sense-making, plus short philosophical readings about the nature of the indefinable, each class will dissect what we know about something inherently human (from beauty to joy to elegance), and how technologists and machine-makers have tried to predict it. We will spend time in this course reverse engineering black boxes and imagining how they could have been designed otherwise. The final project will be an “”””engine”””” or machine – mock-up, paper design or working prototype – that proposes to produce the solution to a messy human question every single time. The course will be divided into three thematic sections of three classes each: a theory week, an analysis week, and a prototyping week. Each thematic section will examine single-topic human “needs” frequently designed for in apps and tech. Students will be expected to take part in group discussions, and brainstorming sessions that will imagine systems that could achieve that topic. Latterly, the last session will be workshops, in which students will work together or alone on their own projects based on one topic of their choice.”
“””Portraiture stands apart from other genres of art as it marks the intersection between portrait, biography, and history. They are more than artworks; when people look at portraits, they think they are encountering that person,”””” says Alison Smith, chief curator at the National Portrait Gallery in London. For thousands of years, artists have used cutting-edge tools and resources to create portraiture, giving viewers a glimpse into the subject’s life. A successful portrait embraces technology to bring the viewer closer to the subject but is not overshadowed by it. In this course, we will delve into portraiture through the lens of volumetric capture using the Depth Kit system. Through hands-on assignments, students will learn the entire pipeline of volumetric capture, from configuring the system to capturing our subjects and final output. Simultaneously, we will focus on fundamental aspects of portraiture, such as lighting, storytelling, production techniques, and historical foundations. The course will explain the techniques and considerations involved in creating volumetric portraits. We will explore various approaches to capturing subjects, employing advanced technologies to record their presence in 3D. Students will gain proficiency in the Depth Kit system to produce high-quality volumetric portraits that can be integrated into different mediums, including game engines, augmented reality (AR), or traditional 2D outputs.”
This course focuses on designing, developing and delivering multimedia live performances via a virtual platform. The class will have an emphasis on experimenting with different possibilities of virtual performances, pushing the boundaries of the performative medium, and using emerging technologies to create experiences that allow for the unfolding of engaging narratives, and/or generate compelling visuals in real time. We will look at various examples of both online and offline performances, explore how we can apply the technologies we have learned to design performative systems, and discuss methods we can use to make our performances more engaging. Students will practice quickly coming up with ideas and performing in class. A few weeks into the course, students will propose final project ideas and then develop the performances in the following weeks with support from the instructor. The class will culminate in a virtual event featuring solo and/or group performances by the students.
In this course students will be introduced to the role of the curator with a very brief history of curation, followed by a focus on the particular challenges and approaches to curating new media art. The class will give an overview of practical approaches to exhibition-making both online and offline, looking at artist-led approaches to curation in particular. The class will include a hands-on practicum in which students will work towards creating a mock exhibition plan.
“Surveillance is the most successful business model in cyberspace, maybe the most successful business model anywhere in history. But the internet is changing. New regulations, new technologies, new consumer preferences, new ways of making money, a new generation of technologists promising change. Will surveillance capitalism continue to be the dominant modality in the online world of the future? And if not, what would replace it? In this class we’ll examine the contemporary state of the surveillance industry and the technical infrastructures that underpin it, such as cookies, requests, and browser fingerprinting. And then look to the promised technologies of the future, from the cryptographic web3.0 to the metaverse to our own hypothesized models for the future of digital existence.”
By exploring and dissecting the field of STEM education, we will research how STEM education currently exists with clear biases and gatekeeping. Through that we intend to create a framework to challenge the biases and design more inclusive and accessible pathways. As a class we will engage in discussions around spaces (community/public spaces and private spaces), STEM as an inclusive element, and definitions of accessibility. The hope is to yield an experience where students can observe, inspire (or get inspired) by mundane things around their day to day lives and connect them to STEM experiences that might seem rather oblivious. Students will create assignments in dialogue with “making with everyday objects”, STEM pedagogy practice, social/emotional learning in spaces, and human-centered design. Students will be exposed to STEM literacy pedagogy, will curate a pop-up space, practice comprehensive user-testing, and reconstruct the framework around accessible and universal design. Students will engage in critical thinking, critiques, visiting artist lectures, field trips and class discussions. About Sharon De La Cruz: https://www.sharonleedelacruz.com/about-me, https://khushbukshirsagar.weebly.com/about.html
In this special format studio class, students will investigate techniques and frameworks to challenge the socioeconomics of planned obsolescence. We will research, design, and develop projects that rethink our strained relationship with smartphones and re-imagine the future of “old” devices. This is a production-heavy, four-credit course, where students will contribute to original research, and develop projects that combine HCI, design, and critical theory. Prerequisites include an open mind, the drive to make, and graduate-level Physical Computing.
The use of digital technology in mental health treatment, recovery, support, and prevention is rapidly gaining acceptance. For instance: The FDA recently approved the VR therapeutic EaseVRx to treat pain. Researchers recently found that exposure to natural environments in VR can provide emotional well-being benefits for people who cannot access the outdoors. Strobing lights can be tuned to stimulate temporary harmonic brain wave patterns usually only found in people who have been meditating for decades. Apps which help you track your mood could facilitate gaining knowledge and awareness of one’s mood patterns and thus help maintain emotional well-being. ASMR videos are reported to be effective in inducing sleep for those susceptible to insomnia, and assuaging a range of symptoms, including those associated with depression, anxiety and panic attacks. This class will focus on the use of technology to activate any and all of our senses to aid in mindfulness and meditation, distraction therapy, body awareness and acceptance, and more, via the use of tools and techniques shown to have a direct impact on our physiology as well as supportive and accessible user experience design with broad applications in other areas. Prerequisite: Basic coding and physical computing About Brian Lobser: http://light.clinic
This course examines magazines as collaborative sites for artists and writers internationally, leading the way to a global, networked cultural sphere. We will consider periodicals as both commercial and artist-driven enterprises and as material objects to be studied through the lens of the history of photography, journalism, and design.
Decentralization has become a buzzword in the technology space, and there is much more to decentralized technology than NFTs and cryptocurrency. In this course, we will examine the fundamental concepts of the existing internet infrastructure, work to define what decentralization means, learn about the “why” of decentralization, survey the landscape of decentralized, distributed, and p2p protocols, and develop decentralized applications. We learn about will examine the implementation of decentralized technology and throughout the course, we will look at different use cases of decentralization such as evading censorship, protecting privacy, and creating resilient applications. We will also consider ethical questions about the decentralization movement—how will it grow, who benefits from decentralization, and whether a decentralized internet is even a good solution at all. We will examine the underlying technologies that enable decentralization, as well as looking at the current implementations of decentralized protocols and apps built on top of decentralized protocols. Finally, we will touch on adjacent topics such as local networks, mesh networking, and p2p networks. While this course will cover a breadth of decentralized and self-hosted applications, we will steer away from decentralized financing and NFTs and instead focus on decentralized information sharing. The goal of the class is to challenge students to think critically about the future of the decentralized web and develop applications that leverage these technologies. Students with or without a background in networking are both highly encouraged to enroll.
How do we make things move, produce sounds, or maybe even emit light without batteries? Through this course, each student will design their own purely mechanical automaton. We will learn how to use simple materials and tools to hand prototype mechanisms in their early stages. CAD software will be used to refine the designs and then a series of traditional and digital fabrication tools (various wood shop tools, laser cutter, CNC, 3D printers, etc.) will be used to produce the final pieces. We will learn how to work iteratively in the shop through weekly exercises, and a midterm and final project.
“What capabilities does computational media have for depicting and conveying the experience of our minds? In this course we will start out using 3D graphics to depict the conventional physical reality that appears before us. Then we will turn inward to reflect the multidimensional reality of our minds, using artificial neural networks. Finally we return to embodied interfaces connected with cloud networking and databases to share with other people. The class will operate at a conceptual level, inviting students’ empirical psychological and philosophical investigations of the nature of their experience and how to convey it with art and story. It will ask students to look critically at existing computational media’s tendencies to bore, divide or inflame its users. But this is also very much a coding class where students will prototype their own ideas for new media first with 3D graphics using the threejs library, and then with machine learning models like Stable Diffusion using Huggingface APIs or Colab notebooks and finally with networking and databases using Firebase or P5 Live Media. Students can substitute other coding tools but game engines will not work for this class. The coding is in javascript, with a possible touch of python, and is a natural sequel to Introduction to Computational Media.” Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)
“As game and interaction designers we create systems and choices that can either prey upon our psychological foibles or help us avoid decision pitfalls. It is our responsibility to understand how we decide, to consider the ethics of the systems we create and to practice designing systems in a purposeful manner. Game Design & The Psychology of Choice will provide interaction and game designers with an understanding of the factors that influence behavior and decision-making by looking at the intertwining of cognitive psychology and economics through the development of behavioral economics. These disciplines study behavior on the individual and group level, often revealing some of the why behind the rules of thumb and folk wisdom that game designers come to intuitively. But understanding the why—why we fall into decision traps; why certain tradeoffs tax our brain more than others; why we are overconfident about our abilities; why certain decisions make us uncomfortable—allows us to more purposefully apply our design craft, both in and out of games. Finally, as a class, we will take what we learn about how we think and create series of game experiences based around key cognitive science concepts. Assignments may include: •Mod a cognitive science experiment into a game or experience •Analyze and present a game through the lens of cognitive science and behavioral economics •Create game or experience based around a particular insight from cognitive science or behavioral economics”
Our users have senses that they use to perceive information in different ways. Some perceive best through sight, some through hearing, others through touch. Designers often prioritize visual information, excluding those who benefit from other sensory modalities. In this class, we’ll take a multisensory approach to design that makes interfaces more accessible to disabled and nondisabled users. Students will learn how to design for the senses (think tactile controls combined with atmospheric sounds and olfactory or taste experiences), while gaining an understanding of the assumptions we make about our users’ sensory preferences. Students should come with prior experience with physical computing and fabrication techniques and can expect to learn technical processes for the user research, usability testing, and iterative design of multisensory interfaces. Over the course of 14 weeks, students will design an interface for the 5 senses (sight, hearing, touch, taste, smell), culminating in one final project that includes at least 3 sensory modalities.
This course introduces students to modalities for creating site-specific and immersive art and performance. Assignments will examine the work of artists who challenge the limitations of the physical, psychological and transactional spaces that have come to define conventional production models. Students will regularly receive prompts from which collaborative work will be workshopped, generated and presented. The sites and practices explored will de-center script/text as spine, institutional space as gathering place, linear storytelling as narrative, and separation between audience and artist as social contract. Through group performance projects and presentations, students will investigate how Site evokes Narrative and Event differently in brick & mortar, virtual, historic, liminal, dead, found, contested, democratized and community spaces. Our work will unpack the challenges and opportunities presented when we relinquish creative control of such unfixed elements as serendipity, impermanence, improvisation, audience agency, public space, weather, and pandemic.
For centuries, food production practices such as permaculture fostered ecosystems intended to be sustainable and self-sufficient, while producing nutrient-dense food. Modern farming has introduced harmful monoculture practices proven to cause collateral destruction of biodiversity and seasonal harvesting, distancing us from our food ecosystems. The future of food can be regenerative or continue to contribute to massive health and environmental issues. How can we challenge ourselves to regain connection to our food system? How might we use innovation, personal prowess, design, and biotechnology to reimagine healthier ecosystems? This course examines the historical context of the food ecosystems and encourages students to identify with these systems that we (in urban settings) are disconnected with. Students will build a project around exploring innovative approaches to the future of food and our relationships with it. These projects will incorporate design, technology, science, and research elements.
A programming course where we’ll explore various techniques and solutions for tracking and sensing people or objects in space. Students will get familiar with the terminology and algorithms behind many sensing topics such as computer vision, depth cameras, positional tracking, and coordinate mapping. As these subjects are explored, we will also dig into communication, and how this information can be transmitted from one tool to another, for example using OSC, Spout/Syphon, MIDI, DMX/ArtNet. The goal being to use the right tool for the job and not limit ourselves to a particular piece of software.
Live streaming is so seamlessly embedded into our online experience. We lay in bed, on our phones watching hearts flicker across the screen as the person we’re watching greets all of the competing messages in the chat, asking for birthday shout outs and follow-backs. While the ability to live stream feels more accessible than ever, it feels very tied to corporate structures, branding and self promotion. How can we push the concept of a live stream in a new direction and rethink what a live stream can be?
Throughout history, musicians have channeled their creativity into outrageous fashion statements and invented personas: think MF DOOM, Sun Ra, Ghostface Killah, Daft Punk, Leikeli47 and Rammellzee. By embracing their alter egos in extreme and outlandish ways, artists have found their authentic creative voices. This course will introduce participants to the art of masquerade using their resourcefulness to create costumes from found materials, and performance as an exploration in creative expression using new media and technology. Students will be introduced to ideas surrounding abstract storytelling, experimental audio video production, and A/V performance using a combination of technical and hands-on approaches. This course requires CL: Hypercinema or equivalent experience. Prerequisite: CL: Hypercinema (ITPG-GT 2004)
On Becoming is a two-part professional development course. Finding Your Artist Voice (part one) filters your fears and apprehensions so you can declare your creative process and practice courageously. The seven-week system will help you proclaim your artistic identity, theoretical underpinnings, and trajectory with clarity, precision, and commanding written language. Students will build personalized masterplans and workflows to facilitate measurable professional growth while learning to catalog and archive their work. Students will develop a working artist biography, artist statement, and fully documented work samples. For the final project, students will be supported in selecting and submitting a post-graduate fellowship, residency, grant, or open call!
“In this course, we will explore how to create narratives that leverage our lesser used senses like touch, taste and smell as well as lesser-known ones like space, time, balance and scale. We will dig into the history of experiential storytelling, starting from immersive theater and Smell-O-vision to cutting-edge haptics and mind-bending illusions of proprioception. To help center this back in practical applications, we will also explore how this evolving art is commonly used in exhibition design, experiential marketing and brick and mortar retail. The class will be a healthy mixture of game theory as well as experienced based learning (meaning there will be a couple field trips and multisensory VR projects to explore). A basic knowledge of game engines is ideal but not mandatory because we will be using predesigned templates in Unreal engine to be experienced and manipulated in real-time through virtual reality hardware.”
To be a VR creator, it’s not enough to learn the hard skills—it’s also our responsibility to prime ourselves for the human impact of our work. As a means to design VR that is both enjoyable and accountable, this class proposes we borrow design principles from Hedonomics, a branch of ergonomic science that facilitates pleasurable human-technology interaction. Through the Hedonomic Pyramid, we’re able to section our thinking off into regions (Safety, Function, Usability, Pleasure and Individuation) and map out industry-tested VR design guidance for each. The result is a hierarchical checklist of proven principles, specifications and practices—that promote a culture of inclusive and holistic design—built to serve as a quickstart guide to designing accountable VR interfaces and systems. This class, divided into units that represent each level of the Hedonomic pyramid, will unpack both technical and conceptual strategies for creating VR, from visual interface fidelity to avoiding locomotion cybersickness to designing safer social VR spaces.
“How can motion capture (MoCap) be used to archive, preserve, and share intangible heritage forms, such as performing arts, rituals, and other social practices and traditions? This course approaches motion capture through the lens of ethnography — drawing on techniques of observation, participation, and qualitative design research. This class will offer an overview of different motion capture technologies, such as 2D-3D pose estimation and depth mapping, with a practical focus on learning the OptiTrack system at ITP. We will start by covering the basics of OptiTrack and build up to other workflows and techniques used across animation, game design, and virtual production (e.g. OptiTrack to Unreal Engine or Unity).” Prerequisite: CL: Hypercinema (ITPG-GT 2004)
Your web browser is a digital canvas for 21st-century artists. While being one of the most common mediums today, web space has infinite possibilities for new aesthetics. This course covers Three.js fundamentals, providing students with the skills and insights to create arts in web 3D. This course requires ICM or equivalent coding experience. Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)
As software projects become more complex, it becomes increasingly important to keep the code organized and manageable; otherwise, it becomes extremely difficult to implement new ideas, and the project is much more likely to be prone to mysterious and frustrating bugs. This course will demonstrate several approaches to organizing code for larger-scale projects, including how to write and name functions and classes, DRY (Don’t Repeat Yourself), pure functions, unit testing and Test-Driven Development (TDD), and why to avoid “magic numbers” and global variables. The focus of the course will be on JavaScript, using P5.js, but the principles will apply to most languages. We will be doing an ongoing, step-by-step, in-class refactor* of a complex sketch. We will also be using version control to track our changes every class. Students will be expected to complete weekly readings and assignments, and to refactor one of their previous projects, using the principles learned in this course. * Refactoring means rewriting the code, without any changes to how the program behaves. Students should have some programming experience prior to taking this course, and would ideally have an existing software project they would like to develop.
“In even the tiniest fragment of digital sound (especially music) there lies a multiplicity of information hidden within. Using audio analysis techniques, this data can be distilled into a vast array of characteristics that describe various different features of the sound. These include things like the loudness, pitch, or the spectrum of frequencies being detected. Through additional analysis, these data points can be used to detect higher level musical features representing things like tempo, rhythm, or melody. Furthermore, the sound and music information can be used to train deep learning models that can then make accurate predictions (eg. what a sound is, what genre a song is, what mood a song evokes). Or, we can use machine learning for generative purposes using the data to guide the creation of new sounds, synthesizers, or even entire songs. The preceding are activities that fall under the areas of digital signal processing, music information retrieval, and machine learning, a trifecta that form the technological foundation for the research area known as machine listening. With a focus on ambient sound and music, this class will explore how tools and techniques from the field of machine listening can become a powerful aspect, or even strategy, in the realm of creative applications. This course will not cover, nor will it assume knowledge of, the underlying technical aspects of machine listening, or music theory. Resources for further pursuance of each week’s topics will be provided but will not be required for class. Instead, our aim will be on understanding what these techniques are doing, when and where to apply them, and how to access and apply them effectively through powerful software libraries. This high level approach will allow us to keep our efforts directed towards creative experimentation without becoming bogged down. Ultimately, students will synthesize the semester’s work into their own creative application involving sound. Here are some examples of the types of projects this class could support: An app that visualizes audio through graphics or DMX/LED lighting to create synesthesia-like effects An automatic system for transcribing music based off of a recording or real-time input A music remixing system where tracks are automatically selected, spliced, processed, and rearranged A musical instrument that adapts to its player based on real-time analysis of the played sound A synthesizer that uses machine learning to optimize and tune its parameters A music education software that visualizes rhythm and melody for the purpose of instruction A rhythm game that derives its gameplay from music information (Guitar Hero, Rock Band, DDR) A tool that analyzes the health of a machine based on its sound through a contact microphone The course will be taught in JavaScript with ICM-level programming experience recommended. No formal training in sound or music is expected or required. This course will be a great fit for any student that is interested in sound and wants to explore it more deeply. Please feel free to reach out to me via email with any questions about the class.”
“This 2-pt course aims to provide students with the critical thinking and practical skills for creating effective and compelling interfaces. We will dissect what a compelling user experience is, apply proven research techniques for approaching and defining UX problems and apply design frameworks including mapping and testing techniques. The class format will include lectures, discussion, in-class design exercises and a final project. Week 1: what is UX Week 2: inclusive research methods Week 3: frameworks for defining a problem Week 4: understanding behavior and motivation Week 5: mapping flow and visual strategies, final project intro Week 6: testing methods and future UX Week 7: final projects”
“What is the medium of memory? In this 14-week studio class, we will dig into this question through creative storytelling. Starting from a lens-based practice, this class will introduce traditional and bleeding-edge documentary methods to inform our own varied approaches to activating archival material. Through weekly “readings” (articles, podcasts, films), written reflections, and creative assignments, we’ll explore: • how technology has impacted our relationship to memory; • how visual interventions can can surface alternative narratives; • how to make under- and unrecorded histories visible, and call into question the power dynamics embedded in “official” records; and • how we might recast objects and sites of memory-keeping, like heirlooms, journals, and memorials, as a mode of engaged preservation. Mid-way through the course, students will identify either personal or collective histories to open up to their own individual creative reexamination, memorialization, or transformation––each producing a final project with the technology and approaches of their choosing that serves to answer the question we started with––what is the medium of memory?”
“Over the past few years, the unprecedented advancement in text-to-image artificial intelligence models has sparked widespread attention, discussion, and mainstream adoption of these innovative co-creative interfaces, which has resulted in novelty, excitement, and curiosity, as well as concern, anger, and insult. Alongside this, the booming open-sourced text-to-image model development contributes to expanding access to working with AI tools beyond experts, tech giants, and professional technologists. In this 14-week course, we will go over the landscape of text-to-image AIs and dive deep into some of the most well known ones (such as Stable Diffusion and its variants), to see what potential they have in terms of exploring new modes of content creation and helping us re-examine our language pattern. This will be a practice technique course – in the first half, we’ll focus on building good prompting practices, and in the second half, we’ll explore different image synthesis skills related to text-to-image AIs, use Python to train our own models to create customized visuals, and create animations from text. We’ll also discuss how such tools could intervene in the workflows of artists and technologists, what they can provide for researchers, and what are the caveats and things we should look out for when we’re creating with these AIs. Pre-requisites: Introduction to Computational Media (ICM) or the equivalent.” Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)
Today’s internet, made up of mostly text documents and two-dimensional images and videos, is the result of historical limitations in bandwidth, graphics processing and input devices. These limitations have made the internet a place where the mind goes, but the body cannot follow. Recent advances in motion capture devices, graphics processing, machine learning, bandwidth and browsers, however, are paving the way for the body to find its place online. Experiments on the Embodied Web will explore the new realm of embodied interactions in the browser across networks. The course will include discussion of influential works in the development of online embodied interaction, including the works of Kit Galloway and Sherrie Rabinowitz, Susan Kozel, and Laurie Anderson. Together we’ll explore pose detection across webRTC peer connections in p5.js and Three.js. Experience with Node, HTML and JavaScript is helpful but not required. ICM level programming experience is required. Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)
Lo-fi/High-impact is a hands-on workshop for learning rapid response prototyping and distribution techniques. We’ll look at examples of zine makers and artist and activist collectives, like the Guerrilla Girls, Dysturb, and the Illuminator, who create campaigns and interventions with purposeful urgency, and then flex our own creative muscles for getting ideas out of our heads and into our hands. Leveraging materials within reach, we’ll explore three paper-based methods of production: foldable books, enclosures, and wheatpasting. Using the cameo table-top cutting machines, the color and B&W printers on the floor, and materials sourced from our recycling bins, students will have the opportunity to try various techniques and have guided studio time to develop their own creative application/s for what they’ve learned. We will move quickly and get a little messy, and the outcomes will be reflective of the process!
With recent advances in hardware and software, millions of us now carry unprecedented spatial computing and world sensing technologies in our pockets. With these technologies in hand, how do we design AR experiences that are contextual at the core – that are sensitive to the spaces we inhabit and the behaviors of people in those spaces? How do we augment this better understanding of reality? This course will be a hands-on workshop where we create spatially aware, contextually driven AR applications unique to particular situations. We will examine the opportunities and challenges when designing for site-specific experiences – museums, live events, retail, medical settings, industrial environments, schools, and others. Topics will include image and object recognition, world mapping, people tracking, location anchors, the ARKit “depth api” (LiDAR enabled features), spatial audio, scene understanding and semantics, and more. For design and development, we’ll primarily use Apple technologies – ARKit, RealityKit and RealityComposer. We’ll also tap a variety of cloud services to store, move, process, and bring intelligence to the data generated and consumed in our experiences. 3D modeling skills are helpful but not required. While we’ll cover the basics, students should expect to spend additional time outside of class learning Swift and other related programming concepts. Full-time access to an iOS device (LiDAR-enabled is ideal but not required) and a Mac laptop running the latest operating systems are required. As part of the design process, we’ll host workshops and guest critiques with designers from top studios around New York City as well as directly interfacing with various teams at Apple.
This course covers the next several years of evolution in technology, culture, and other trends. It uses scenario planning, a technique for considering complex interrelationships that can’t be predicted, distinguishing predetermined elements from critical uncertainties, and exploring the underlying patterns that influence events. Students will conduct original research on significant trends, use those trends to develop compelling, sophisticated, plausible stories about possible futures, and present the futures – and the strategies they suggest – to a public audience. The course will take place at a pivotal moment of historical uncertainty: recovering from a global pandemic, with AI and other digital technologies crossing a threshold, and dramatic political and economic tensions. All of these, and more, affect media development – and are deeply affected by them. The goal of the course is to enable you to make more robust decisions now in the face of uncertainty — applicable to planning for technological change, starting a business, plotting a career or making major life decisions. This class has developed a longstanding following at ITP because it helps us make sense of complex issues without oversimplifying them. In a climate of candid, respectful discussion and debate, the class explores theories about system dynamics, long-wave organizational and societal change, and economic and technological development.
According to anthropologists Filip de Boeck and René Devisch, divination “constitutes a space in which cognitive structures are transformed and new relations are generated in and between the human body, the social body and the cosmos.” In this class, students will learn the history of divination, engage in the practice of divination, and speculate on what forms divination might take in a world where the human body, the social body, and even the cosmos(!) are digitally mediated. Starting with an understanding of ritual and folk culture, we will track the history of fortune-telling from the casting of lots to computer-generated randomness to the contemporary revival of Tarot; from reading entrails to astrology to data science; from glossolalia to surrealist writing practices to the “ghost in the machine” of artificial intelligence. Weekly readings and assignments culminate in a final project.
We experience screens daily in many forms: in our hands, on our desktops, on walls and public installations as we travel. This course will explore the creative possibilities of real-time interactive and reactive art on screens in various forms. Using the recently developed p5VideoKit we will create standalone installations. p5VideoKit is a new library of live video effects – building on p5js – presented as a dashboard for mixing video in the browser. This library allows the user to apply visual effects to live video from connected cameras and sensors or streaming from devices on the internet. p5VideoKit is open source and can be extended with the user’s p5js code for a plethora of visual effects and interactivity. One possible application of p5Videokit would be a public facing installation allowing anonymous people on the street to use their hand held devices to interact with large street facing screens, thereby collaborating on real time creation of “digital graffiti”. Building on ICM, students will learn how to adapt simple sketches into components of p5VideoKit so that algorithms can be quickly composited and orchestrated into more complex works. Students will also learn how to edit and share code beyond the p5js editor, use nodejs/javascript to automate deployment of installations, and remotely configure dedicated computers with long running installations. Several dedicated computers and screens will be available to preview installations on the floor and street facing areas of the 370 Jay Street campus. Prerequisites: ICM or equivalent coding experience. About John Henry Thompson: http://johnhenrythompson.com
By exploring and dissecting the field of STEM education, we will research how STEM education currently exists with clear biases and gatekeeping. Through that we intend to create a framework to challenge the biases and design more inclusive and accessible pathways. As a class we will engage in discussions around spaces (community/public spaces and private spaces), STEM as an inclusive element, and definitions of accessibility. The hope is to yield an experience where students can observe, inspire (or get inspired) by mundane things around their day to day lives and connect them to STEM experiences that might seem rather oblivious. Students will create assignments in dialogue with “making with everyday objects”, STEM pedagogy practice, social/emotional learning in spaces, and human-centered design. Students will be exposed to STEM literacy pedagogy, will curate a pop-up space, practice comprehensive user-testing, and reconstruct the framework around accessible and universal design. Students will engage in critical thinking, critiques, visiting artist lectures, field trips and class discussions. About Sharon De La Cruz: https://www.sharonleedelacruz.com/about-me, https://khushbukshirsagar.weebly.com/about.html
One of the most transformative consumer products in history, the iPhone remains the standard bearer for great design and user experience. With the latest versions of iOS and iPhone, Apple puts depth sensing and augmented reality in our pockets. How do we take advantage of this incredible platform to produce our own compelling experiences? This course will be a hands-on workshop where we explore the world beyond generic apps and push the boundaries of what’s possible on iOS hardware. Each week, you’ll be asked to complete a programming exercise meant to foster your understanding of iOS application development. We’ll leverage existing open source libraries to quickly build out your app with features such as real time communication and cloud storage. We aim to create distributed instruments for computed expression. Full-time access to an iOS device and a Mac laptop computer running the latest operating system and development tools are required. Prereq: Some programming experience (such as ICM) and willingness to learn Apple’s Swift programming language.
This course would focus on the questions of 1) what makes people healthy? and 2) how can we design tools and environments that support healthy lifestyles? Key topics to be covered include public health concepts like the multiple determinants of health and the social-ecological framework, plus a little evolutionary biology; the role of behavior in health, key tenets of behavioral economics and behavior change strategies; and systems thinking concepts from Donella Meadows and others. Students will come away with a much more sophisticated understanding of the complex system of factors and forces that affect people’s health; understanding of key systems concepts and some techniques for understanding systems; and experience designing for behavior at scale. A potential final project could be to reimagine/redesign a popular commercial service so that it would have a more health-producing impact — or, alternatively, to focus on designing changes to the ITP environment that would promote better health for students, faculty and staff. About Steve Downs: www.stevedowns.net
“Since the introduction of the iPhone in 2007, the touchscreen has become the dominant manner for navigating Mobile devices. UX pattern best practices are enshrined in documents such as Apple’s ‘HIG’ (Human Interface Guidelines) or Google’s more recent Material Design. ‘No Screens Allowed’ is a class that challenges this ’Touchscreen first’ interaction approach. Taught in the Kotlin language, students will prototype solutions in response to Instructor directed assignments. The various projects structured to interrogate mobile device capabilities such as: Voice Recognition, Computer Vision, Machine Learning, and built in sensors. Students will be provided with identical hardware: Pixel 3 phones running Android, the chosen development platform for the class. Successful completion of Introduction to Computational Media and Introduction to Physical Computing are required for entry into class. “
This introductory course will focus on giving students a practical understanding of how to make ‘serious’ video games. That is, games that challenge the player to think and learn. This is a class where we will be ideating and producing playable games each week over 7 weeks using the open-source Godot game engine. By the end of the course, you’ll have a small portfolio of ‘serious’ games to show and build upon. Throughout the course, students will become familiar with concepts such as iterative design, play testing, object-oriented programming, user-interface design, animation and basic art for 2D games. They will take a design-based approach to content creation, developing a proficiency in the Godot game engine and the overall indie-game development pipeline.
Quantum technologies are the next frontier of electronics and computing. Quantum Computers, Quantum Sensors, Quantum Materials are just beginning to emerge from laboratories and enter the realm of practical application. The course introduces the underlying principles of quantum physics, and reviews emerging capabilities of quantum computers and related technologies. Coursework will include programming quantum algorithms on a simulator, and running programs on actual cloud-based quantum computing hardware. The topics will be highly technical and will require the study of scientific principles and experimental apparatus. We will cover some basic mathematical operations in linear algebra, and we’ll be encountering some equations from physics and computer science.
In an era of remote everything, how can we create artwork that brings us back together IRL? This course explores our connection to physical objects within the context of community. How can sculpture, installation, immersive, and public art nurture our neighborhoods via collaboration, play, ritual, self-expression, and awe? Students will work collaboratively to radically imagine bold, sculptural, immersive works using innovative and lo-if techniques integrated with technology. Hands-on workshops include experiments creating found sculptures, AR prototypes, projection mapping, real-time interactive multimedia content, and more. We’ll reference ancient monuments, sacred objects, NYC relics, street art and contemporary works to envision new artifacts that create awareness by reflecting the needs of our communities. Prerequisite: Comm Lab: Hypercinema About Ali Santana: http://www.alisantana.com/bio
The use of digital technology in mental health treatment, recovery, support, and prevention is rapidly gaining acceptance. For instance: The FDA recently approved the VR therapeutic EaseVRx to treat pain. Researchers recently found that exposure to natural environments in VR can provide emotional well-being benefits for people who cannot access the outdoors. Strobing lights can be tuned to stimulate temporary harmonic brain wave patterns usually only found in people who have been meditating for decades. Apps which help you track your mood could facilitate gaining knowledge and awareness of one’s mood patterns and thus help maintain emotional well-being. ASMR videos are reported to be effective in inducing sleep for those susceptible to insomnia, and assuaging a range of symptoms, including those associated with depression, anxiety and panic attacks. This class will focus on the use of technology to activate any and all of our senses to aid in mindfulness and meditation, distraction therapy, body awareness and acceptance, and more, via the use of tools and techniques shown to have a direct impact on our physiology as well as supportive and accessible user experience design with broad applications in other areas. Prerequisite: Basic coding and physical computing About Brian Lobser: http://light.clinic
This course provides students an opportunity to sharpen their coding skills in several ways: by reviewing fundamental programming concepts, acquiring techniques to systematically develop code-driven projects, and then implementing those to develop an independent project with the structure and support of a classroom learning community. The first part of the semester consists of weekly exercises to practice strategies for learning new algorithms, writing pseudocode, pair programming, debugging, refactoring, version control, and more. Screen-based code examples for the activities and assignments draw inspiration from the history of creative coding. The second part of the semester shifts to a project development studio format for students to apply these strategies to a self-directed project. This could be an existing idea or one devised during the course. Ultimately this course aims to empower students to reflect on their process and teach themselves how to program with greater efficiency and independence. It is a direct follow-up to Introduction to Computational Media (ICM) or for anyone interested in advancing their coding practice. Examples and exercises will be provided in JavaScript using the p5.js library. However, students are welcome to consult the instructor about working with another programming library, framework, or language with which they have interest or prior experience. Prerequisite: ICM or equivalent experience
In this special format studio class, students will investigate techniques and frameworks to challenge the socioeconomics of planned obsolescence. We will research, design, and develop projects that rethink our strained relationship with smartphones and re-imagine the future of “old” devices. This is a production-heavy, four-credit course, where students will contribute to original research, and develop projects that combine HCI, design, and critical theory. Prerequisites include an open mind, the drive to make, and graduate-level Physical Computing.
Where does healing reside in media-making? How do we approach creating artistic processes and tools that move towards minimizing harm, supporting collective care, and understanding what healing means for ourselves and with one another? This course examines socially-engaged artistic processes and frameworks that reconstruct, reclaim, and decolonize ‘healing.’ Together, we will gather embodied data from our bodyminds, build language through readings, and map out artists in the field exploring disability, racial trauma, queerness, and diaspora within media and performing arts. Subsequently, we will develop our own processes as our final project: weaving together storytelling, embodied strategies, tool-making, performances, and/ or space-making.
This1-pt course examines the evolving paradigm of “Blockchain Aesthetics” using an interdisciplinary Art History and Science and Technology Studies (STS) perspective. Students will learn and discuss the dominant methods, concepts, and strategies of applied blockchain technology in contemporary digital art, and together attempt to analyze and theorize the potential affordances and harms of this new artistic medium as it intervenes in established visual art institutions and communities (e.g., from museums and galleries to auction houses, social media and the decentralized web). The class will also look backwards in history to situate “Blockchain Aesthetics,” and the wide artistic realm of “Crypto Art,” in a broad cultural and technological history beyond NFTs, highlighting how ideas around cryptography, contracts, reproducibility, decentralization, scarcity and financialization developed in modern and contemporary art. Approaching the blockchain as a novel artistic tool and a technology of power, this course considers recent aesthetic evaluations of Crypto Art against its sociopolitical, infrastructural, and ecological impact, centering its contested potential for—and negation of—equity.
As the scale of human impact on global climate and ecosystems deepens, we see the need to alter our trajectory, to be more inclusive of other species in our imagining of the future. This class sets out to investigate the relationships we humans have with nature and non-human animals, to dive deep into the meaning and utility of being in relationship, and ultimately to translate these ideas into tangible, multimedia experiences that expose a larger audience to a multi-species worldview. This class sits at the intersection of art, science, and technology. It combines studio practice and research with example case studies and critical texts. Together, we will meet artists, designers and scientists who build multispecies futures through urban ecology, biology, and public art. This class is for students who are eager to develop XD (experience design) and storytelling skills. The course follows a research-driven process that results in a design proposal and proof-of-concept that can be pitched to a public arts org. Keywords: bioArt, interactive installations, experience design, research, eco-activism
As you know, projection mapping and Light Art are becoming popular again because of large-scale pop-up installations worldwide: ARTECHOUSE, SuperReal, Meow Wolf, and TeamLab. Technology has advanced over the years, but how people enjoy light art have not changed so much. How do your ideas and artwork fit into these site-specific installations? This class is for anyone interested in creating a site-specific installation using mapping technologies to create new experiences for the public audience. This class guides students through conceptual and technical processes of project and artist development. It consists of three parts: Project & Artist Development, Projection Mapping, and LED Mapping. We will research and discuss the history of visual artwork, public engagement, and technical exercises using real international contests and festival sites. The student will learn the latest Projection and LED Mapping techniques using Madmapper. And we will also focus on advanced techniques like multi-projector projection, projector calculation, Interactive Mapping, and software & hardware to culminate in a final project. The class will also invite guest speakers to discuss the nuts and bolts of their art and business. About Chika Iijima: www.mappathon.com, www.imagima.com
In this course, students will explore the fundamentals of augmented reality by dissecting the interaction between camera, computer, and user. Each week we will focus on a different AR modality: image, face, body, environment, and object, and consider their real-world applications. Through weekly explorations, we will examine the existing affordances of AR as well as their impact. This course will culminate in a final project, and our tool of choice will be Lens Studio. Course syllabus: https://docs.google.com/document/d/1wMWVnDdzgz2bbsCNp7jRAiCe1job4glq61o67sWAP00/edit?usp=sharing
Focusing on motion capture (ak. MoCap), this class introduces basic performance skills alongside 3d graphic manipulation to create real-time virtual experiences. In this class we will have the opportunity to build sets, produce interactive props, and design unique characters to tell stories or engage with audiences. Utilizing Optitrack Motion Capture system, Blender, Motionbuilder, and Unreal Gaming Engine; we will create, rig, animate, and perform as avatars.
WEB ART AS SITE addresses the history and practice of art made for and inseparable from the web, while teaching basic coding for the web. We explore key examples of web art from the early days of the internet through today, asking questions about this idiosyncratic artistic medium like: How do different forms of interaction characterize the viewer and/or the artist? What happens to our reading practice when text is animated or animates? How is an internet-native work encountered, and how does the path we take to reach it affect our reading? Who is able to see a work of web art, and what does access/privilege look like in this landscape? How are differently-abled people considered in a web artwork? What feels difficult or aggressive in web art, and when is that useful? How do artists obscure or reveal the duration of a work, and how does that affect our reading? What are the many different forms of instruction or guidance online? As we ask these questions, we exploit the internet pedagogically, collaborating online, playing with anonymity, and breaking the internet spaces we know. Students learn web coding through specialized online tutorials; most of class time is reserved for discussion (of web art and supplementary readings) and critique. Throughout the semester, students will produce two major works of web art. Students need only a standard laptop, and will not be expected to purchase any software or text (cost of materials: $0).
The goal of this class is to gain an understanding and proficiency with Computer Aided Design (CAD). We will become familiar with CAD software, mechanical design, and simulation. The class will cover common CAD modeling techniques. We will use our designs to get physical parts made as well as use them in virtual projects. We will create parts both real and impossible.
This course will explore the history and meaning of the ubiquitous concept of “cursed” media, and provide students with a survey of digital art tools for the creation of their own cursed animation, video, photography, music, and web art. Many people were first introduced to the concept of cursed media when it exploded into mainstream internet discourse in 2016 with the @cursedimages Twitter account, which posted found photos bound by their unsettling effect on the viewer. Cursed media predates this account, however, stretching back to medieval notions of cursed objects. We will demonstrate how throughout time, cursed media has functioned like a slip of the tongue that provides a window into the cultural unconscious, where we encounter uncensored thoughts and feelings about race, gender, class, and what it means to be human. From Amazon Muzak generators to Artbreeder’s GAN tools for image creation, from machine learning text generators to robots who work at Walmart, cursed media and tools for its creation bring into view the ways that that culture reacts to tension between the increasingly precarious position of human beings in the capitalist 21st century and the threat of human erasure by the powerful forces of nature. Students will be introduced to digital art tools for creating music, manipulating photography and video, working with 3d animation, and building web art. Students will attempt to create their own cursed media, and in the process will gain a deeper understanding of the unconscious biases and ethical implications of contemporary digital creation tools.
This course will use the open source COVID-19 Impact Dashboard as a basis to explore ways to humanize the unfolding data on the coronavirus pandemic. Students are invited to collaborate on the COVID-19 Impact Project. Students will discover how data flows from public github repositories and tools needed to visualize the data. We will review other data-centric open source projects related to COVID-19 and discuss the questions they are trying to answer or problems they are trying to solve. We will examine historical and contemporary data visualizations. Using data visualization as a scaffold, we will explore ways to support community driven mourning and memorialization. Students can choose to participate as javascript coders, p5js explorers, UI/UX designers, citizen journalists, or data science explorers.
Computational simulation and videogame engines offer thinkers and makers a new way to reflect on the question “If I can make a world, what would it be like?” In Worldmaking with Unity, students will be exposed to various theories and approaches of worldmaking, and realize their own creative visions by constructing an original, conceptual, and playfully simulated world with indie game development engine Unity. This seven-week seminar/studio course will include a gentle introduction to computer programming, 3D modeling, character and scene design, and rendering techniques with Unity, as well as related production tools such as Blender. Projects may address system, agency, narrative, generative design, critical computing, and more. Student projects created in Unity can be compatible with augmented reality (AR) and virtual reality (VR). This course is designed as an intro-level game design and development course. There is no prerequisite. More advanced production techniques such as shader language and AI might be introduced as optional topics only. More information at: https://docs.google.com/document/d/1UppRjSyFlMpGPNLMowqKmP7wwq29s5Oexnpvrj4Gubs/edit?usp=sharing
Cooking programs with an image based language is a fundamental skill in the production and design of modern digital processes. Visual programming is not only an alternative way to code, but a solution to approach generative and interactive media. This class reviews the past, present and future of visual programming languages used to procedurally generate and manipulate media such as Max/MSP(Nato.0 55 3d), Isadora, Quartz composer, Touch designer, Houdini, cables.gl and Unreal Engine among others. The core of this course is the study of Unreal Engine’s Blueprint Visual Scripting system as a way to produce an interactive program in an executable form using only Visual Programing. We will study how to create actors, functions, interfaces and how they communicate with each other. We will also take a look into 2 other visual editors, The material/shader editor for the creation of HLSL like shaders and visuals and the new Metasound editor for the manipulation, generation and sequence of sound within the engine. A general understanding of Unreal Engine is a prerequisite for this class. Students will learn how to use blueprints to produce an interactive program that can be a video game, an installation or a Real Time digital Performance.
From the crass rattle of early pager motors to the sophisticated clicks and purrs of the iPhone Taptic engine, the ability to buzz has increasingly worked its way into our devices. This course focuses on physical prototyping and interaction design for non-visual feedback. Specifically, it will explore how haptic feedback can be utilized and integrated into handhelds, wearables, objects, and environments – anything that we touch or that touches us. Traditional tools such as eccentric rotating mass (ERM) motors, linear resonance actuators (LRAs), and haptic motor drivers will be introduced as well as less conventional methods such as gentle poking, prodding, warming, cooling, squeezing, and tickling. Through hands-on experimentation and a review of research to date, students will emerge from this course well-positioned to incorporate haptic feedback into their future projects. Note: This course is designed for students who have previous experience with physical computing and Arduino.
This course provides critical and curatorial insight into global art practices and interactive technologies from a post colonial perspective. Designed to provide a critique of imperialism the course is underpinned by ideas pertaining to the rise of the Global South, decoupling, indigenous knowledge and ancient and contemporary innovation through contemporary art, emergent technologies, new media and exhibition practices. Students will also investigate the role of shifting digital landscapes and conservation of new media coupled with museum collecting practices, from both a deconstructive and ethical lens, providing regular opportunities to reflect upon their own respective practices. Presented as a combination of presentations/ critiques, seminars, readings, virtual field trips as well as special guest visits with noted experts, the course presents a compact and timely overview of globalization, and the effects of rapid interactive and technological innovative, in lieu with ideating towards a more equitable and diverse art and technological ecosystem.
Listening is not something we do through hearing alone. Engaging with multiple perspectives, from Deaf studies and critiques of ableist hearing ideologies, to the possibilities and pitfalls presented through machine listening and imaginative sonic speculation, we will playfully deconstruct and question what it means to listen at all. Each week, readings will be assigned and students are asked to respond to prompts in the form of light-weight exercises that will orient most of our in-class discussion. Time will be spent discussing readings, presenting, and providing critique for each other’s projects in order to help draw connections between theory and practice. Through in-class presentations, we will encounter works by Christine Sun Kim, George Lewis, Pauline Oliveros and read from Jennifer Lynn Stoever, Tina Campt, and François Bonnet. The class has no technical prerequisites, and students are welcome to respond with works using tools and techniques from other classes (audio/video presentation, programming and physical computing, installation and fabrication, etc.). Through this work, we will unpack how the way in which we attend to the physical world and its inhabitants through our listening has real consequences. In much the same way our interpretation of the world is informed and influenced by factors outside of ourselves, our capacity to listen is conditioned through societal, political, economic, historical, and racial dimensions. We will disentangle listening from hearing and consider listening as a practice that begins not with how we hear sounds but how it allows us to (or prevents us from) interfacing and relating to our exteriors (and interiors). By the end of the class we will attempt to converge and coalesce our own ideas and perspective of what it means to listen.
Over the past 3 years, we have seen many aspects of our lives thrust online. Increasingly, we are working, learning, socializing with family and friends, attending live performances and more through 2D grids of video feeds on platforms such as Zoom and Google Meet. These communication tools have become essential for remote communities to connect, yet fail to replicate many of the most engaging, messy and human aspects of our in-person experience. What happens when we break out of this grid and explore new forms of real-time social interactions online using webcam video and audio? Recent explorations in this realm have shown the promise of spatial metaphors in creating engaging real-time social interactions online. In this course, students will create their own series of experimental social spaces that explore these questions: how does the shape and nature of our environment affect the way we communicate? What unique forms of real-time expression and sharing might be possible online (and only online)? How might we design experiences for the unique social dynamics we want to support? Students will be exposed to principles of spatial design as well as a series of open source Javascript tools for arranging live webcam video and audio in 2D and 3D space in the browser. They will use WebGL (through the three.js library) to build 2D and 3D environments, and will be exposed to WebRTC (Web Real-Time Communications) and Node.js to add interactivity to those environments.
On October 8th, 2015, a team in Ecuador identified 431 species of birds – the world record for number counted in a single day. Earlier that year in Myanmar, a scientist counted one Jerdon’s babbler, the first in nearly eight decades. In December of 2019, eBird announced that its database held over 737 million bird observations. This morning, in Brooklyn Bridge park, I counted 38 house sparrows, 4 black-and-white warblers and an ovenbird. This course will consider birding as a practice, and will dive deep into the processes by which observations become data. As a collective, we will investigate how crowd-sourced data is transforming ornithology, and will explore ways to tell stories about the natural world through visualization and more radical forms of data representation.
The class will focus on the many overlooked aspects of paper, and how it can be used as a three-dimensional material. We will learn the disciplines of making Pop-Ups, Origami, Paper Crafting, and Visual Design. Using these methods as a starting point, students will build prototypes to explore new ways to tell stories, inform, interact, play with, engage, and challenge a younger audience. Most classes are hands – on. The rest, dedicated to criticism (including from children), analysis, and refinement, technical and conceptual. We will discuss how they could be mass produced and distributed. Students will build three prototypes, during the semester. From these, each student will select a favorite to fully develop as the final.
Language is more than just words and meanings: it’s paper and ink, pixels and screens, fingertips on keyboards, voices speaking out loud. Language is, in a word, material. In this course, students will gain an understanding of how the material of language is represented digitally, and learn computational techniques for manipulating this material in order to create speculative technologies that challenge conventional reading and writing practices. Topics include asemic writing, concrete poetry, markup languages, keyboard layouts, interactive and generative typography, printing technologies and bots (alongside other forms of radical publishing). Students will complete a series of weekly readings and production-oriented assignments leading up to a final project. In addition to critique, sessions will feature lectures, class discussions and technical tutorials. Prerequisites: Introduction to Computational Media or equivalent programming experience.
Introduces problems raised by the nature of art, artworks, and aesthetic judgment. Considers the expressive and representational properties of artworks, aesthetic attention, and appreciation, as well as the creation, interpretation, and criticism of artworks. Readings from classical and contemporary sources.
Considers contemporary science fiction as literature, social commentary, prophecy, and a reflection of recent and possible future trends in technology and society. Writers considered include such authors as Isaac Asimov, J. G. Ballard, Octavia Butler, Arthur C. Clark, Samuel Delany, Philip K. Dick, William Gibson, Robert Heinlein, Frank Herbert, Ursula K. Le Guin, Neal Stephenson, and Bruce Sterling.
Auto Fictions is a studio class focusing on the creation of immersive, multi-path and interactive experiences based on personal narrative. Documentary art has included the art of installation for decades, but new technologies have given artists affordable tools that allow them to rapidly prototype and then refine immersive media experiences. Auto Fictions is an interdepartmental course that may include students from Film, ITP and Theater disciplines. Students will create production teams. Each team will make a project and each student will help the other create their work through intensive collaboration. The intention here is to practice collaboration across disciplines, methods, values, and artistic cultures to create a work of immersive fiction based on materials gathered from the past, captured or created in the present and/or imagined for the future. We will look at several possible approaches to the creation of immersive media works. Including multiplexing software programs. Students with the requisite knowledge in these tools or gaming engines with similar capabilities may use them for the creation of their works. But it is not required. There may be an opportunity for building intuitive interactivity into some of the experiences. In response to the Covid-19 pandemic we will be exploring how to adapt our working methods and our work itself to these conditions as they develop. The goal of the course will be to physically realize the works but to do that we will go through a detailed comprehensive design, planning and budgeting process so that if conditions permit all aspects of the work will be fully created or planned and ready to build. If conditions permit, we will meet one day at the beginning of the semester to install and introduce the platform, create teams, and review the assignment. Otherwise we will meet online and begin work there. Students will be provided with access to online tutorials for relevant software and systems.
If so much of life is circumstance, being in a certain place at a certain moment in time… Can we shape a life or at least a few brief moments of a life by designing the circumstances in which that life inhabits a space? In this course, we will treat space as a time-based medium and ask how interactive spaces can generate narratives that are lived rather than told. We will do so by interrogating four so-called “space-narrative” forms: Wandering The Desert, Processions, Circles and Territories. Through play, discussion and hands-on workshopping of both technical topics and ideas we will ask and attempt to answer some of the following questions: What constitutes a space? How do we experience a space over time? How does space shape our experience of time? How can space form a personal narrative? Media outputs we will employ include: lights, projection and sound. Interaction input sources will come from cameras and microphones. We will use p5.js, websockets and node.js for real-time interaction. Class time will be split between group improvisation exercises, playing with and critiquing examples and translating design strategies into code and logic.
Course description (optional): Not all innovation starts in the West and gets exported to other parts of the world. In many places with less developed capitalist economies and infrastructures, technology is rapidly developed and adapted for hyper-local use. We’ll gain inspiration from a broad spectrum of creative uses of technology in the developing world(s) — from art and design, hacktivism, and community-oriented work that increase social good, and then conceive of and prototype our own projects. Special attention will be paid to speculative 3D fabrication tools and processes, web-based platforms, circuit bending and making them all work together! Students will experiment and research at the intersections of art and technology to develop the beginnings of work grounded in post-colonial reality and the late capitalist near-future.
This course equips students with the skills and tools necessary to address applied data science problems with a specific emphasis on urban data. Building on top of the Principles of Urban Informatics (prerequisite for the class) it further introduces a wide variety of more advanced analytic techniques used in urban data science, including advanced regression analysis, time-series analysis, Bayesian inference, foundations of deep learning and network science. The course will also contain a team data analytics project practice. After this class the students should be able to formulate a question relevant to urban data science, find and curate an appropriate data set, identify and apply analytic approaches to answer the question, obtain the answer and interpret it with respect to its certainty level as well as the limitations of the approach and the data.
Visualization and visual analytics systems help people explore and explain data by allowing the creation of both static and interactive visual representations. A basic premise of visualization is that visual information can be processed at a much higher rate than raw numbers and text. Well-designed visualizations substitute perception for cognition, freeing up limited cognitive/memory resources for higher-level problems. This course aims to provide a broad understanding of the principals and designs behind data visualization. General topics include state-of-the-art techniques in both information visualization and scientific visualization, and the design of interactive/web-based visualization systems. Hands on experience will be provided through popular frameworks such as matplotlib, VTK and D3.js.
The course targets current and future urban practitioners looking to harness the power of data in urban practice and research. This course builds the practical skillset and tools necessary to address urban analytics problems with urban data. It starts with essential computational skills, statistical analysis, good practices for data curation and coding, and further introduces a machine learning paradigm and a variety of standard supervised and unsupervised learning tools used in urban data science, including regression analysis, clustering, and classification as well as time series analysis. After this class, you should be able to formulate a question relevant to Urban Data Science, locate and curate an appropriate data set, identify and apply analytic approaches to answer the question, obtain the answer and assess it with respect to its certainty level as well as the limitations of the approach and the data. The course will also contain project-oriented practice in urban data analytics, including relevant soft skills – verbal and written articulation of the problem statement, approach, achievements, limitations, and implications.
The UCSL at CUSP is a series of online sessions designed to build a common skillset and familiarity with techniques, concepts, and models for urban informatics computing. The online sessions focus on data explorations, programming skills and statistical methods needed for scientific computing in the field of Urban Informatics.
Majors Only:This course will introduce incoming Master’s students to some of the concepts, terms, and theoretical genealogies that they can expect to encounter in Performance Studies. What makes performance studies performance studies, and why do it? In considering this question we will consider the specificity of performance as an object of study, a mode of inquiry, a practice of self-hood and sociality, and as an aesthetic practice; we will also focus on the specific challenges and potentialities in writing about/as performance.
Flash Frames explores the moving image, the pixel, color, and composition, through two weekends of intensive, hands on image fabrication. Students gain a coherent understanding of the technicalities involved in producing artistic and professional quality videos. The workshop applies technical and creative approaches to capturing video, editing, and adding the finishing touches on short productions. Projects are focused on strengthening design and editing skills, understanding media management practices, applying video effects, color correction, motion graphics, and sound. Students broaden their understanding of digital design and video production, while learning the basics of video editing, animation, sound mixing, and motion graphics.
Hollywood in your palm. That is what this combination of lectures, screenings, demonstrations and practical production workshop will offer to the students in this course. There will be several professional guests making presentations and Q&A sessions from the mobile phone filmmaking industry. In addition to the historical and critical overview of the emergence and exponential growth of global cell phone cinema, students will shoot all footage on cell phones and download them for computerized editing. The final project will be under three minute shorts. Projects will include all genres of film and television: news, mini-documentaries, animation, music videos and narrative shorts. Completed student projects will be suitable to be posted on the Internet and entered into domestic and international mobile phone film festivals. For example, two minute long improvisations of Bollywood Style Music Videos shot on Cell Phones by the students have been projected at the Tribeca Cinemas as part of the New York Indian Film Festival. It is suggested but not compulsory that students bring to the class a cell phone capable of recording video.
In this course, we will explore how to create narratives that leverage our lesser used senses like touch, taste and smell as well as lesser-known ones like space, time, balance and scale. We will dig into the history of experiential storytelling, starting from immersive theater and Smell-O-vision to cutting-edge haptics and mind-bending illusions of proprioception. To help center this back in practical applications, we will also explore how this evolving art is commonly used in exhibition design, experiential marketing and brick and mortar retail. The class will be a healthy mixture of game theory as well as experienced based learning (meaning there will be a couple field trips and multisensory VR projects to explore). A basic knowledge of game engines is ideal but not mandatory because we will be using predesigned templates in Unreal engine to be experienced and manipulated in real-time through virtual reality hardware.
To be a VR creator, it’s not enough to learn the hard skills—it’s also our responsibility to prime ourselves for the human impact of our work. As a means to design VR that is both enjoyable and accountable, this class proposes we borrow design principles from Hedonomics, a branch of ergonomic science that facilitates pleasurable human-technology interaction. Through the Hedonomic Pyramid, we’re able to section our thinking off into regions (Safety, Function, Usability, Pleasure and Individuation) and map out industry-tested VR design guidance for each. The result is a hierarchical checklist of proven principles, specifications and practices—that promote a culture of inclusive and holistic design—built to serve as a quickstart guide to designing accountable VR interfaces and systems. This class, divided into units that represent each level of the Hedonomic pyramid, will unpack both technical and conceptual strategies for creating VR, from visual interface fidelity to avoiding locomotion cybersickness to designing safer social VR spaces.
Buildings produce a large percentage of the carbon emissions threatening the planet and multi-family residential buildings make up a significant portion of it. With Covid-19 changing the way we live and work, and the increasing amount of data available from buildings, a key to fighting the climate crisis will be turning this data into action. In this course, learn how to analyze interval data and explore visualizing data to motivate tenants and building operators to change their behavior to reduce energy usage at the optimal times. This will involve analyzing the data streams coming from installed sensors and building equipment, understanding how usage varies over time, and transforming raw data into visual interfaces that mobilize us all in the fight to save the planet. This course will teach basics of how time series data can be stored, how to query time series data, and how to understand energy usage from a data set. With these new skills students will design a project using time series data and their JavaScript skills to visualize this data.
Throughout history, musicians have channeled their creativity into outrageous fashion statements and invented personas: think MF DOOM, Sun Ra, Ghostface Killah, Daft Punk, Leikeli47 and Rammellzee. By embracing their alter egos in extreme and outlandish ways, artists have found their authentic creative voices. This course will introduce participants to the art of masquerade using their resourcefulness to create costumes from found materials, and performance as an exploration in creative expression using new media and technology. Students will be introduced to ideas surrounding abstract storytelling, experimental audio video production, and A/V performance using a combination of technical and hands-on approaches.
Artists and creative practitioners are widely seen as responsible for destabilizing or critiquing dominant cultural norms and social systems; for example, in her book “Race After Technology”, Ruha Benjamin argues that artists “…can better understand and expose the many forms of discrimination embedded in and enabled by technology”. But when we talk about resistance or refusal enacted through creative means, what exactly do we mean? How does artistic work serve to resist, protest and subvert—and where does it sit in relation to the ideas it aims to critique? This class engages with the notion of “creative resistance”, unpacks the meanings and ethical stances associated with the term, and evaluates how it has been applied in both artistic and academic contexts. Students will explore theories of resistance, refusal and solidarity, and experiment with applying them to (or discussing them through) creative work. In the first half of the class, through reading, class discussion and student presentations, we will engage with scholarly and activist literature on resistance, protest and subversion, and look at examples of creative technological works that purport to achieve these goals. We will discuss commonly used strategies such as dark sousveillance (or “looking back” at the machine), speculative design, and distributed or guerrilla artmaking; examine their mechanisms of action; and debate their effectiveness in achieving their professed goals. In the second half, students will apply this thinking to their own project ideas. Students can choose to produce either a final project responding to the themes of the course, accompanied by a short written artist statement, or a more academic written piece that engages relevant literature from the class readings and beyond in service of an argument about the role of resistance in creative practice.
With recent advances in hardware and software, millions of us now carry unprecedented spatial computing and world sensing technologies in our pockets. With these technologies in hand, how do we design AR experiences that are contextual at the core – that are sensitive to the spaces we inhabit and the behaviors of people in those spaces? How do we augment this better understanding of reality? This course will be a hands-on workshop where we create spatially aware, contextually driven AR applications unique to particular situations. We will examine the opportunities and challenges when designing for site-specific experiences – museums, live events, retail, medical settings, industrial environments, schools, and others. Topics will include image and object recognition, world mapping, people tracking, location anchors, the ARKit “depth api” (LiDAR enabled features), spatial audio, scene understanding and semantics, and more. For design and development, we’ll primarily use Apple technologies – ARKit, RealityKit and RealityComposer. We’ll also tap a variety of cloud services to store, move, process, and bring intelligence to the data generated and consumed in our experiences. 3D modeling skills are helpful but not required. While we’ll cover the basics, students should expect to spend additional time outside of class learning Swift and other related programming concepts. Full-time access to an iOS device (LiDAR-enabled is ideal but not required) and a Mac laptop running the latest operating systems are required. As part of the design process, we’ll host workshops and guest critiques with designers from top studios around New York City as well as directly interfacing with various teams at Apple.
This course will serve as an incubator to imagine a speculative product advertisement in the year 2030. In films like Blade Runner, or Her adverts fill the world and become an important aspect of exposition for the film. And in the real world, works such as Alisha Wormlsey, Alexandra Bell, and Hank Willis Thomas begin to re-imagine advertisements as an art practice in society today. Our work will begin to speculate on near-future objects in which topics such as communication, energy storage, transportation can begin to be re-imagined in the next industrial revolution. Using 3D tools, students will gain experience in speculative design thinking, industrial design modeling, product lighting, and custom post-production methods. The final project will be a product advert that will be designed to promote a speculative design entirely made from 100% Biodegradable plastics. The course will look at the ready-made objects all around us as a launching pad. We will be starting with modeling an object in detail. Using Moi 3D, Maya, Render Engine TBD, After Effects, and premiere over the course of the semester. I will go through some of the latest tools within the VFX industry and support this course with a series of artists who have re-imaged the role of cultural production. The final will be an advertisement poster and animation.
If social change begins in the imagination, how then can creators better envision and render the more just and beautiful worlds we want to make? Storytelling has the power to be an alchemical force for revolutionary change. Together, we seek to interrogate and apply interactive storytelling as a technology we can deploy in service of our collective liberation. In this course, we pair a study of story as liberatory praxis with a hands-on grounding in emerging tech tools that allow viewers/players to take an active role. Interactive storytelling technology in video, audio, and text powerfully situates viewers inside constructed narrative worlds. Creators in these emerging media gain the capacity to design choices and respond accordingly, propelling imagination toward agency and enhancing empathic connections between viewers/players and characters. What will it mean to use these tools to tell deeper stories that ask urgent questions about how we want to live in the world? “Part of being a revolutionary is creating a vision that is more humane. That is more fun, too. That is more loving. It’s really working to create something beautiful.” —Assata Shakur
Not all innovation starts in the West and gets exported to other parts of the world. In many places with less developed capitalist economies and infrastructures, technology is rapidly developed and adapted for hyper-local use. We’ll gain inspiration from a broad spectrum of creative uses of technology in the developing world(s) — from art and design, hacktivism, and community-oriented work that increase social good, and then conceive of and prototype our own projects. Special attention will be paid to circuit-bending and designing custom PCB boards using open-source software like CircuitMaker and EAGLE.
Project-based development studio incorporating dramaturgy techniques, user/audience planning, and social/contextual awareness. You bring in a project. We explore how to make it more engaging through paying close attention to medium, context, and details. Students bring existing project ideas and we investigate various methods and ways to make and direct experience within the infinite combinations of contexts of the present moment together. This particular studio is just as appropriate for projects in the areas of interactive art, programming, physical computing, XR as it is in the areas of performance, sculpture, and sound walks (everything). Everything you make is time-based the moment a user interacts with it (even a painting). All time-based work can be thought of in terms of how a user is led (or not led) through it. I call this directing. We will apply various techniques of story-telling and world-building equally to seemingly “non-narrative” projects as we do to traditional-narratively structured projects. No matter what you are working on, I believe that you are a maker / director of experience. You are making / directing with intent (whether you know it or not). Your user (audience, tester, public, patron) brings with them the entirety of their life’s experience. Your intent cannot possibly meet every user’s lived experience. It is your job as the maker / director to draw a circle that encompasses both. This is the studio’s lens. Students will be directed to make using placeholders instead of waiting for perfection to manifest. Step one will tell you what step two is. We will pay rigorous attention to detail, while holding close to the notion that art-making thrives in adaptability. We will critique using various, structured, co-facilitated methods. Let’s pay close attention. Let’s learn through failure. Let’s listen to what we are making. And let’s listen to each other. Here we go.
Live streaming is so seamlessly embedded into our online experience. We lay in bed, on our phones watching hearts flicker across the screen as the person we’re watching greets all of the competing messages in the chat, asking for birthday shout outs and follow-backs. While the ability to live stream feels more accessible than ever, it feels very tied to corporate structures, branding and self promotion. How can we push the concept of a live stream in a new direction and rethink what a live stream can be?
What can an object tell us about the world? What can the world tell us about an object? As students and practitioners in creative media, investigating the world around us is a core part of an art/design/tech practice. This course focuses on a specific research approach for doing so: the implosion method (developed by Joseph Dumit based on Donna Haraway’s work). Over the course of this two-weekend workshop, we will individually and collectively critically examine, break down, rearrange and communicate as Haraway says, the “sticky economic, technical, political, organic, historical, mythic, and textual threads that make up [an object’s] tissues.” Students will choose an object at the beginning of the class and over the course of a week will follow the implosion method process, culminating in a presentation of findings the following weekend. The implosion methodology will be supplemented by lectures, group conversation, hands-on activities and skill building of complementary research methods. The final presentation will be to communicate findings and learnings through a multimedia or art/design/tech-based form. By working through the implosion method, students will build skill sets in methods and tools for 1) conducting research in the media studies/creative tech/art fields and 2) structuring and communicating the information they collect by creating a media-based representation. This class is for students interested in fostering, developing, starting, or deepening a research-based art practice with topical interests in how technology relates to society, social issues, and ethics.
This course traces along the scholarship of Anna Tsing and Donna Haraway, and Animist and Perspectivist cosmologies to study and consider our positions within multispecies relations via material exploration and interspecies storytelling. This is a hands-on course engaging in communal growing and fabrication using biomaterials such as bacterial cellulose, mycelium, lactobacilli, yeast, and more. During the course students will participate in guided somatic exercises and writing as a generative pathway to create their own multispecies allegories and exploratory projects. We will look over and talk about the work by artists such as: Natalie Jeremijenko, CAConrad, Alexis Pauline Gumbs, Anicka Yi, Bo Zheng, Una Chaudhuri, Agnieszka Kurant and Ernst Karel.
This course aims to provide students with the analytical skills to interpret current trends, policies and problems into futuristic (5 years) product proposals and the thought leadership and communication skills to clearly articulate and pitch those ideas. Projects can range from how prolonged quarantine will impact home exercise to the future of entertainment in self driving cars. Students will research and explore an opportunity space of their choosing where they will infer future problems from current trends then create a speculative solution. They will package their product thinking into a pitch deck and present back to the class. The class format will include lecture, in-class and out-of-class design exercises that apply the concepts covered in the class lecture and a final presentation and critique.
For most of its brief history, the domain of “smart cities” has belonged to large corporate vendors who promise and offer ubiquitous, citywide intelligence that utilizes their proprietary systems. More recently, an increasing number of startups have developed solutions which can make the technology somewhat more accessible. Unfortunately for municipalities, working with product vendors can be a heavy lift and the commitments involve lengthy procurement and contracting processes. In the past five years or so, the access to connected technology has increased and the hobbyist or “maker” movement has seen an uptick in offerings related to IoT. From the Arduino IoT Cloud and Adafruit.io software, to the Raspberry Pi and Particle hardware, building connected IoT devices has become easier than ever before. Through platforms like Google Coral and Nvidia Jetson, even edge computing and AI has become available to those with coding skills and a modest budget. What this course aims to explore is what happens when low-cost, readily available electronics platforms address the data needs of municipal governments. Rather than thinking of smart cities as large scale, big data projects that provide intelligence across a city, we will look at targeted applications that would be too small or costly to pursue as a conventional IoT procurement. What intelligence can be gathered in a short period of time with a small budget? During this course, we will examine successful and troubled smart cities projects, discuss the ethics of public technology projects, and review the prevailing best practices and guidelines relating to the Internet of Things in government use. Thinking in terms of “rapid IoT” and “little big data,” students will partner with NYC agency representatives* to uncover insights about a particular issue related to their work. Students will undertake a semester-long project, working to understand the agency’s data needs and develop an IoT solution to gather data for analysis that could inform the agency on planning, policy, or operational issues. The course will cover current connected microcontroller platforms and connectivity options like WiFi, Cellular, and LoRaWAN as well as the software tools needed to store and present data in user-friendly dashboards.
A new world is emerging at the intersections of machine learning and physical computation that will offer wide-scale access to bringing intelligence to everyday devices and spaces at extremely low costs. In this course, students are offered the opportunity to become pioneers in a new field of hardware machine learning as they are introduced to the most used machine learning platform in the world (TensorFlow) that has been embedded into an incredibly small microcontroller, called TinyML. Students will learn about building with machine learning, the ethics and societal impacts of ML, and how to start realizing creative computation through ML-based physical computing.
Narrative holds a place in discourses of health, illness, caregiving, and disability, carrying and conveying the densely detailed, nuanced, and complex threads of personal emotion, social experience, and cultural meaning that accompany all instances of these subjects. Narrative also plays a growing role in clinical practice, research, and health education, as increasingly registered in the burgeoning field of Medical Humanities. This course introduces students to texts, practices and major works in the emergent fields of Graphic Medicine and Narrative Medicine, using traditional humanities methods of critical reading and analysis as well as experimental and creative methods including field observation and art-making in a variety of media. Building upon a series of practice-based assignments throughout the semester, students will complete a final project that exemplifies some of the ways narrative and graphic design foster understanding and knowledge in contexts of illness.
So much of life is circumstance, being in the right place at the right moment in time. Can we shape a life or at least a few brief moments of one by designing a space for it to inhabit? In this course, we will treat space as a time-based medium and ask how experiential spaces can generate narratives that are lived rather than told. We will look to a broad range of storytelling traditions to interrogate four so-called “space-narrative” forms: Wandering The Desert, Processions, Circles and Territories. Through play, discussion and technical and conceptual workshops, we will ask and attempt to answer some of the following questions: What constitutes a space? How do we experience a space over time? How does space shape our experience of time? How can space shape both a personal and collective narrative? We will build spaces with lighting, projection, sound and physical objects. Class time will be split between group improvisation exercises, playing-testing and critiquing projects. The class will culminate in a showing of work at the end of the semester.
Is it a plaything? Sculpture? Nostalgia? A Product? Art toys exist at the center of a unique Venn diagram. Each student in this class will develop an original limited edition art toy. We will cover toy fabrication, character design, material selection, packaging design, and art toy culture. The class will be fabrication heavy, there will be weekly assignments, and a final project.
The course focus is on the design and creation of digital musical instruments. Music in performance is the primary subject of this class. We approach questions such as “What is performance?” “What makes a musical interface intuitive and emotionally immediate?” and “How do we create meaningful correlations between performance gestures and their musical consequences?” Over the semester, we look at many examples of current work by creators of musical interfaces, and discuss a wide range of issues facing technology-enabled performance – such as novice versus virtuoso performers, discrete versus continuous data control, the importance of haptic responsiveness as well as the relationship between musical performance and visual display. Extensive readings and case studies provide background for class discussions on the theory and practice of designing gestural controllers for musical performance. Students design and prototype a musical instrument – a complete system encompassing musical controller, algorithm for mapping input to sound, and the sound output itself. A technical framework for prototyping performance controllers is made available. Students focus on musical composition and improvisation techniques as they prepare their prototypes for live performance. The class culminates in a musical performance where students (or invited musicians) will demonstrate their instruments. Prerequisites: H79.2233 (Introduction to Computational Media) and H79.2301 (Physical Computing). Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048) & Intro to Phys. Comp. (ITPG-GT 2301)
This course will focus on the prototyping of wearable electronics projects for a single user: you. In this class we will wear what we make, following an iterative cycle of research-design-make-wear. Lectures, readings, and discussions will serve to provide historical and contemporary framing for our work. Wearable technology prototyping strategies and techniques will be shared and tested. Special focus will be placed on circuit building and fabrication approaches that are compatible with a home studio environment. Previous experience with electronics or physical computing is strongly encouraged. Students will emerge from the course with a deeper knowledge of what it takes to develop and refine a robust, bespoke wearable electronics project.
50 Days of Making is a 1.0 unit online course that offers students the opportunity to pursue a creative passion and develop or refine a skill over a 50-day period. Students choose a topic of interest and produce an expression of that topic every day for 50 days. For examples of past projects from the 100-days version of the class see here: https://itp.nyu.edu/classes/100days/. This course will meet four times on a bi-weekly basis over the course of the 1st 7-weeks of the term (every other week). Class time is spent discussing student progress and reflecting on students’ creative journey. Note that this class is a heavy lift for 1.0 unit, so only committed students should consider registering for it. Failure to complete the 50-day challenge may result in an incomplete grade for the course.
Time to get your hands dirty. Prototypes need to be created, motors have to be mounted, enclosures must be built. Understanding how things are fabricated makes you a better maker. But hardware is hard. You can’t simply copy and paste an object or working device (not yet anyway), fabrication skills and techniques need to be developed and practiced in order to create quality work. You learn to make by doing. In this class, you will become familiar and comfortable with all the ITP shop has to offer. We will cover everything from basic hand tools to the beginnings of digital fabrication. You will learn to use the right tool for the job. There will be weekly assignments created to develop your fabrication techniques. There will be in class lectures, demos, and building assignments. Emphasis will be put on good design practices, material choice, and craftsmanship.
Can the future be foretold? No, but the long-term outcomes of present-day actions can be foreseen — and, as the 2008 economic crisis showed us, lack of foresight can have grave implications.Using a technique called scenario planning, students consider the present and future ramifications of knotty, large-scale problems related to the evolution of the internet and other aspects of the telecommunications infrastructure. In exploring this, we touch upon the global economy, demographics, international politics, environmental concerns, and other large-scale issues. Scenario planning is a rigorous but highly engaging technique, in which people share information and judgment to create a picture of the future larger than any individual could produce alone. The technique has been used since the mid-1950s decades to distinguish certainties from uncertainties, and to learn to be prepared for multiple eventualities. Students will conduct original research on significant trends, use those trends to develop compelling, plausible stories about possible futures, and present the futures – and the strategies they suggest – to a public audience. As part of the process that we co-develop, the class explores theories about system dynamics, organizational and societal change, the causes of economic failure and success, and the nature of technology.
This course expands the students’ palette for physical interaction design with computational media. We look away from the limitations of the mouse, keyboard and monitor interface of today’s computers, and start instead with the expressive capabilities of the human body. We consider uses of the computer for more than just information retrieval and processing, and at locations other than the home or the office. The platform for the class is a microcontroller, a single-chip computer that can fit in your hand. The core technical concepts include digital, analog and serial input and output. Core interaction design concepts include user observation, affordances, and converting physical action into digital information. Students have weekly lab exercises to build skills with the microcontroller and related tools, and longer assignments in which they apply the principles from weekly labs in creative applications. Both individual work and group work is required.
The internship program promotes the integration of academic theory with practical experience. Internships expand student understanding of the dynamics of the ever-changing field of communication.
This course examines Modern Cryptography from a both theoretical and applied perspective, with emphasis on “provable security” and “application case studies”. The course looks particularly at cryptographic primitives that are building blocks of various cryptographic applications. The course studies notions of security for a given cryptographic primitive, its various constructions and respective security analysis based on the security notion. The cryptographic primitives covered include pseudorandom functions, symmetric encryption (block ciphers), hash functions and random oracles, message authentication codes, asymmetric encryption, digital signatures and authenticated key exchange. The course covers how to build provably secure cryptographic protocols (e.g., secure message transmission, identification schemes, secure function evaluation, etc.), and various number-theoretic assumptions upon which cryptography is based. Also covered: implementation issues (e.g., key lengths, key management, standards, etc.) and, as application case studies, a number of real-life scenarios currently using solutions from modern cryptography. | Prerequisite: Graduate standing.
This course addresses the design and implementation of secure applications. Concentration is on writing software programs that make it difficult for intruders to exploit security holes. The course emphasizes writing secure distributed programs in Java. The security ramifications of class, field and method visibility are emphasized. | Knowledge of Information, Security and Privacy equivalent to CS-GY 6813. Prerequisite: Graduate standing
This course is an introduction to the field of machine learning, covering fundamental techniques for classification, regression, dimensionality reduction, clustering, and model selection. A broad range of algorithms will be covered, such as linear and logistic regression, neural networks, deep learning, support vector machines, tree-based methods, expectation maximization, and principal components analysis. The course will include hands-on exercises with real data from different application areas (e.g. text, audio, images). Students will learn to train and validate machine learning models and analyze their performance. | Knowledge of undergraduate level probability and statistics, linear algebra, and multi-variable calculus. Prerequisite: Graduate standing.
This course is about experimental game design. Design in this context pertains to every aspect of the game, and these can be broadly characterized as the game system, control, visuals, audio, and resulting theme. We will explore these aspects through the creation of a few very focused game prototypes using a variety of contemporary game engines and frameworks, high-level programming languages, and physical materials. This will allow us to obtain a better understanding of what makes games appealing, and how game mechanics, systems, and a variety of player experiences can be designed and iteratively improved by means of rapid prototyping and play-testing. The course combines the technology, design, and philosophy in support of game creation, as well as the real-world implementation and design challenges faced by practicing game designers. Students will learn design guidelines and principles by which games can be conceived, prototyped, and fully developed within a one-semester course, and will create a game from start to finish. The course is a lot of (team)work, but it’s also a lot of fun. Programming skills are helpful, but not a hard requirement. Artistic skills, or a willingness to learn them are a plus. | Prerequisite: (Graduate Standing AND CS-GY 6533) for SoE students OR (OART-UT 1600 and OART-UT 1605) for Game Center MFA students OR instructor permission.
Big Data requires the storage, organization, and processing of data at a scale and efficiency that go well beyond the capabilities of conventional information technologies. In this course, we will study the state of art in big data management: we will learn about algorithms, techniques and tools needed to support big data processing. In addition, we will examine real applications that require massive data analysis and how they can be implemented on Big Data platforms. The course will consist of lectures based both on textbook material and scientific papers. It will include programming assignments that will provide students with hands-on experience on building data-intensive applications using existing Big Data platforms, including Amazon AWS. Besides lectures given by the instructor, we will also have guest lectures by experts in some of the topics we will cover. Students should have experience in programming: Java, C, C , Python, or similar languages, equivalent to two introductory courses in programming, such as “Introduction to Programming” and “Data Structures and Algorithms. | Knowledge of Python. Prerequisite: Graduate Standing.
An important goal of artificial intelligence (AI) is to equip computers with the capability of interpreting visual inputs. Computer vision is an area in AI that deals with the construction of explicit, meaningful descriptions of physical objects from images. It includes as parts many techniques from image processing, pattern recognition, geometric modeling, and cognitive processing. This course introduces students to the fundamental concepts and techniques in computer vision. | Knowledge of Data Structures and Algorithms, proficiency in programming, and familiarity with matrix arithmetic. Prerequisites: Graduate standing.
This course takes a top-down approach to computer networking. After an overview of computer networks and the Internet, the course covers the application layer, transport layer, network layer and link layers. Topics at the application layer include client-server architectures, P2P architectures, DNS and HTTP and Web applications. Topics at the transport layer include multiplexing, connectionless transport and UDP, principles or reliable data transfer, connection-oriented transport and TCP and TCP congestion control. Topics at the network layer include forwarding, router architecture, the IP protocol and routing protocols including OSPF and BGP. Topics at the link layer include multiple-access protocols, ALOHA, CSMA/CD, Ethernet, CSMA/CA, wireless 802.11 networks and linklayer switches. The course includes simple quantitative delay and throughput modeling, socket programming and network application development and Ethereal labs. | Knowledge of Python and/or C. Prerequisite: Graduate standing.
Artificial Intelligence (AI) is an important topic in computer science and offers many diversified applications. It addresses one of the ultimate puzzles humans are trying to solve: How is it possible for a slow, tiny brain, whether biological or electronic, to perceive, understand, predict and manipulate a world far larger and more complicated than itself? And how do people create a machine (or computer) with those properties? To that end, AI researchers try to understand how seeing, learning, remembering and reasoning can, or should, be done. This course introduces students to the many AI concepts and techniques. | Knowledge of Data Structures and Algorithms. Prerequisite: Graduate standing.
This is a standard digital photography course designed for those with little or no experience in photography. This course will emphasize personal expression through the application of technique to the presentation of subject matter. Open Arts will have enough Sony A7r cameras for students to share. If students plan to borrow the DSLR cameras, they are first required to purchase College Student Insurance, (CSI). While it is not required that you own your own digital camera to enroll in this course, it is recommended that you borrow or acquire your own camera for the duration of this course, or if you would like to avoid having to share one of the department’s cameras with another student. If you would like to purchase your own camera, a digital single lens reflex (SLR) or mirrorless digital camera is highly recommended for this course. The camera needs to have manual aperture and shutter speed controls. The purpose of this course is to develop an understanding of the technical and aesthetic aspects of making photographic images. We will apply fundamental photographic techniques such as composition, framing, lighting and manual camera controls to the images we create. We will discuss the way we see, compared to how cameras and lenses see, evaluate the similarities and differences and how that impacts the creation of images and how we analyze them. Students will make photographs that are effective as individual images and photographs that work together in a series. Students will learn how to create a narrative with a series of photographs and express a feeling or mood with a series of photographs. Class discussions will introduce students to a variety of concepts related to visual literacy. Students will also be introduced to the work of historically significant photographers from a broad range of backgrounds. Students will learn how to use Adobe Creative Cloud software to adjust images for print and digital publishing. By the end of the course, students will understand how to use a digital SLR or mirrorless camera to create compelling photographs using manual controls, process their images using Adobe Creative Cloud software and best practices for publishing their images digitally as well as best practices for printing their images. Finally, students will enhance their critical thinking skills while developing a deeper understanding of visual/photographic language. Students are expected to shoot a minimum of 108 exposures (photographs) each week.
The purpose of this course is to enable the student to gain a heightened awareness, appreciation, and knowledge of dance through movement and performance. We focus on the foundations of dance such as control, aesthetics, alignment, dynamics, athleticism, musicality, use of space, development of learning strategies within a group context, and personal, artistic expression. The students exploration of their creativity, expression and concepts, as well as their work on other dancer’s bodies is part of the work of this course. Through individual and collective kinesthetic participation in unfamiliar patterns, the student is physically and conceptually challenged and informed. Students will be asked to problem solve as homework assignment and in-class composition exercises. Dance experience is recommended, but formal dance training is not required.
This is a standard digital photography course designed for those with little or no experience in photography. This course will emphasize personal expression through the application of technique to the presentation of subject matter. Open Arts will have enough Sony A7r cameras for students to share. If students plan to borrow the DSLR cameras, they are first required to purchase College Student Insurance, (CSI). While it is not required that you own your own digital camera to enroll in this course, it is recommended that you borrow or acquire your own camera for the duration of this course, or if you would like to avoid having to share one of the department’s cameras with another student. If you would like to purchase your own camera, a digital single lens reflex (SLR) or mirrorless digital camera is highly recommended for this course. The camera needs to have manual aperture and shutter speed controls. The purpose of this course is to develop an understanding of the technical and aesthetic aspects of making photographic images. We will apply fundamental photographic techniques such as composition, framing, lighting and manual camera controls to the images we create. We will discuss the way we see, compared to how cameras and lenses see, evaluate the similarities and differences and how that impacts the creation of images and how we analyze them. Students will make photographs that are effective as individual images and photographs that work together in a series. Students will learn how to create a narrative with a series of photographs and express a feeling or mood with a series of photographs. Class discussions will introduce students to a variety of concepts related to visual literacy. Students will also be introduced to the work of historically significant photographers from a broad range of backgrounds. Students will learn how to use Adobe Creative Cloud software to adjust images for print and digital publishing. By the end of the course, students will understand how to use a digital SLR or mirrorless camera to create compelling photographs using manual controls, process their images using Adobe Creative Cloud software and best practices for publishing their images digitally as well as best practices for printing their images. Finally, students will enhance their critical thinking skills while developing a deeper understanding of visual/photographic language. Students are expected to shoot a minimum of 108 exposures (photographs) each week.
The purpose of this course is to enable the student to gain a heightened awareness, appreciation, and knowledge of dance through movement and performance. We focus on the foundations of dance such as control, aesthetics, alignment, development of strength and flexibility, dynamics, athleticism, musicality, use of space, development of learning strategies within a group context, and personal, artistic expression. The student’s mastery of their body, expression with their body and creativity through their body is the center of the work. Through individual and collective kinesthetic participation in unfamiliar patterns, related, but not limited to China, West Africa, United States, and Japan, the student is physically and conceptually challenged and informed. Using these learned dances as inspiration, students go on to re interpret, improvise and choreograph their own variations on dance forms in their class assignments. Dance experience is not necessary.
This course will combine a history of video art and experimental film with practical training in the use of live video performance art technology. Students will explore new ways to create and edit films and videos using VJ software, projections, and multi-channel video surfaces. Workshops will demonstrate concepts and software that can be integrated into the creative process of video performance art and video art installations. COURSE OBJECTIVES At the completion of this course, the student will be able to: Draw inspiration from the recent history of incredible video and multi-media artists. Develop an understanding of audio and visual hardware used by VJ’s. Use live VJ software to manipulate digital media in real time to create Video Performance Art. Use Projection Mapping techniques to project video art onto 3D surfaces. Create original video performance art, video installations, and other performance pieces. Utilize skills to make video art in the professional market.
Making Webisodes is an intensive production workshop in which students create unique and compelling content for the web. Students will explore the basics of online video production, working with – concept creation – writing – directing – acting – production design – camerawork – sound – editing – online distribution – social media – web monetization – and advertising. Web series are an exploding new art form. Embedded ads, 5 second hooks, instagram stories, tik-tok, and viral videos all present a variety of new media approaches within the entertainment industry, business, lifestyle, and politics. Webisodes are short visual presentations that either entertain us, directly sell us product, indirectly sell us product, share a powerful message, investigate social issues, expose problems, celebrate joy, engage our perspective, shock us, or challenge us. Students will work with Sony FS5 cameras, microphones, and LED lights and they will also be trained to use their own dslrs and cellphones, in order to practice creating a wide variety of webisodes. Workshop assignments employ practical exercises to help the students conceive and create their own unique webisode, which can be fiction or non-fiction, experimental or satire, personal or political. Combining the powerful tools of traditional filmmaking with innovative new digital media tools, this class guides students to create dynamic web based projects. As the students produce their digital media, they learn by doing and they gain practical knowledge of the art, craft, and commerce of webisodes.
This course will explore the basic tools of digital imaging. We will cover the three main Adobe products for creative imaging – Illustrator, Photoshop, and InDesign. Through a series of short assignments we will look at various graphic design and layout ideas using Illustrator and InDesign and will touch on the wealth of image enhancement techniques afforded by Photoshop. The short assignments introduce the basics of design, typography and compositing images. Students have the opportunity to complete a small project of their own for the end of the term. Class time will be divided between lectures, critiques, and work in class sessions. This course is not intended to completely cover the software listed, but will give students a fundamental understanding of the possibilities of digital imaging. While the majority of the class focuses on print media (images, books and magazines), we discuss the growing importance of screen output. We do not have time to cover specific web or media projects, but will address transferable skills and understanding. We will incorporate some Adobe apps to augment the desktop applications. Additional reading materials will be distributed during the semester. Students should have access to the Adobe Creative Suite through the NYU license.
“The smartphone is not only the primary site for digital communication and consumption, it also hosts emerging forms of media production. Let’s investigate the potential of the mobile touchscreen as a creative instrument! This is a project based course, and we will explore by creating and testing a series of functioning web-based toys – including drawing apps, character creators, and writing tools. You can expect to sharpen your skills in javascript and design. “
In this course, students will be exposed to different qualitative research methodologies and disciplinary approaches to those methods (in terms of technique, ethical standards, approaches to citation, etc.). Students will practice using research methods to study subjects of their choosing and produce reflections, sketches, or prototypes based on weekly research findings. By practicing the act of “doing research” students will think about ways to incorporating research into their practice and better understand and articulate how research is already part of their practice.
The class will teach how to architect and lead a virtual production by creating a dialogue between the Producer, Director, and Cinematographer in filmmaking with the Technical Producer and Director in creative technology. The class will cover an overview of all of the technical skills required to produce a remote virtual production through the lens of a project manager making administrative and creative decisions. This class will culminate in a real-time 3D project exploring motion capture and virtual production that will adapt a pre-existing cinematic work with the class themes in mind.
Today’s internet, made up of mostly text documents and two-dimensional images and videos, is the result of historical limitations in bandwidth, graphics processing and input devices. These limitations have made the internet a place where the mind goes, but the body cannot follow. Recent advances in motion capture devices, graphics processing, machine learning, bandwidth and browsers, however, are paving the way for the body to find its place online. This course will explore embodied interactions in the browser and across networks. Specifically, we’ll explore TensorFlow.js models like PoseNet and BodyPix, and Microsoft Kinect in p5.js and Three.js. Assignments will consider designing engaging embodied experiences for individual and social interactions online. Experience with Node, HTML and JavaScript is helpful but not required. ICM level programming experience is required. The course will have weekly assignments that explore embodied interaction online. Assignments will begin with exploring single points of interaction (i.e. one mouse or one joint), and progress to considering full bodies and multiple bodies in one browser. Students will have a 2-3-week final project with which they will delve more deeply into the subject matter in one piece of work. Students will have readings/watchings focused on embodied and networked user experience. Some influential works that will likely be assigned/discussed are Laurie Anderson’s “Habeas Corpus,” Todd Rose’s “The End of Average,” and Myron Krueger’s “Artificial Reality.” The course examples will be taught in Javascript using web technologies/frameworks. However, students are welcome to work in their preferred medium.
When technology advances, teaching styles regress. Every new wave of technology touted as a boon to education — radio, TV, DVDs, the internet — has tended to revive the idea that the ideal class structure is the lecture, where faculty broadcast information to disconnected student recipients. Yet we’ve known for decades that lectures are poor ways to create learning experiences, and that actively involving students–with the class, the teacher, each other–is far more effective. The thesis of Imagination and Distributed Learning is that the range of possible experiences available online is larger, more varied, and more interesting than most of what is on offer from colleges and universities’ online courses. Students will read teaching and learning research, and do field work where they set out to learn something online and reflect on the experience, and then set out to teach something online, and reflect on that experience. The goal of the course will be for students to build up alternatives to existing (and often quite dull) online educational practices today. The final project will be a proposal, plus designs or partial implementation, for online tools or experiences that will create experiences users can learn from. These proposals will be presented to a panel of people managing existing online programs at NYU and elsewhere.
This course is about how to tell stories with your projects. Like a classic linear story, we’ll start at the beginning with the question of how good stories are told. We’ll learn about classical storytelling techniques and conventions from a variety of cultures, genres, and media. Next, we’ll explore what various tech and media can and can’t do in the context of story. We’ll end the semester throwing linearity out the window to create narrative work that engages with the tropes and conventions of non-linear storytelling. Chaos may ensue, as the defining feature of non-linear storytelling is that the author cedes some control of the narrative to the audience. There is no creative writing involved. Students will not be asked to invent new stories for this course—non-writers are welcome! The work of the class will involve reading, reading responses, active class discussion, and group work/play with projects riffing on assigned existing stories and narratives. For example, we might ask students to use a specific canonical story, poem, myth, parable, or film plot as a narrative jumping off point for assignments. The course is co-taught by Kio Stark, a researcher/writer of both fiction and nonfiction and Mia Rovegno, a theater writer/director who focuses on site-specific and immersive work. The semester is divided into three units. Unit 1: Narrative structures. In this unit, we dig into what it means to tell a story. Some of our major themes include: • What are the most commonly used story structures in media such as the novel, graphic novel, film, TV, and theater—and what expectations do they set up for the audience? • What are the techniques, tropes, and conventions of both western and nonwestern storytelling traditions? • What are some approaches that are in dialogue with or rebel against these traditions? • How do we understand and manipulate the audience’s narrative expectations? • What makes a story ‘work’ / how do we define a good or successful story? Unit 2: Using tech to tell a story. In this unit, we will do something that in other contexts is a terrible idea—we will start with the technology. We’ll explore briefly what counts as technology in our conversation, and then play with what specific technologies make possible, complicate, and make impossible when it comes to exploring narrative work. • What can and can’t we do with sensors, motion, projection, AR/VR, paper, film, light, voice etc in the context of the storytelling knowledge we’ve gained in Unit 1? • What unique storytelling conventions might be available to us as makers? • What kinds of objects, interfaces, situations, and places can be experienced as narrative? Unit 3: Non-linear storytelling. In this unit, we will play with situations in which the creators do not have total control over how the narrative is experienced and in what order it unfolds. • How do we use the viewer’s relationship/familiarity with conventions of linear storytelling to engage them in a non-linear narrative? • What are the storytelling conventions we see used in media beyond the page, big screen, and stage, where non-linearity is a common feature? For example, AR/VR, video games, social media, site specific performance, and museum design. • How do we make a story that works in more than one direction? • How do we play with the audience’s expectations? • How can we experiment with the temporal to establish duration and clear beginnings and endings for audience entry and exit? • How can we creatively engage both facility and innovation in a user journey? • How can we explore engagement of the audience’s “role” when the work demands a virtual, immersive or interactive experience? • How can we prime audiences for fluency in our storytelling modalities, without depending on cumbersome directions, real time interceptions or demonstrations of technology? In other words: how do we hide the man behind the curtain?!
In this class students learn how to use data. If you can learn to live with uncertainty, you can make something beautiful and true. Students will learn about data as another form of evidence. We will collect our own datasets to learn about challenges and opportunities. We will explore sources of uncertainty, and how imagination and empathy can help uncover ways that data can lead to insight or alternatively, lead one astray. We cover basic stats principles to show how even properly collected data may lead you astray; we cover design principles, we introduce technical tools for visualizing data. Students collect their own data set, share reactions to assigned readings, and find their own examples of data usage that are positive or misguided.
What can cybernetics, the study of how we shape and are shaped by systems, teach us about the sexual and social reproduction of gender and sexism? How does sex become gender and what are the politics surrounding who gets reproduced? We will explore how social regulatory systems are encoded into technological platforms and disentangle how they produce social pressure and govern behavior through somatic exercises, discussion, and project making. In this class, we will not shy away from difficult conversations and work closely together to cultivate a space of openness and mutual support. Discussion and project-making is core to this class. Together we will read the work of scholars such as Donna Haraway, Ruha Benjamin, Paul Preciado, Silvia Federici, & Audre Lorde. Along with lecture, discussion, and in class activities, students will be encouraged to explore their own research interests and personal histories. When projects are discussed, we will practice communicating ideas through presentation as a medium and will co-create a culture of constructive feedback.
Juxtaposed to traditional comics, Experiential Comics combines emergent tech, unconventional comic book art/structure, and game engines to offer users a more immersive, continuous storyworld experience. Challenging the status quo of classic and contemporary digital comics, students will explore new technologies/world-building techniques better suited to craft innovative comic book narratives and formats –worthy of the Fourth Industrial Revolution. Students will ingest a brief history of classic and digital comics formats, collaborate with comic book artists to design engrossing characters, engage in world-building sessions, play with Unity/Unreal engines to generate avatars/ virtual environments, work with actors in motion capture/volumetric capture studios, learn the latest iteration of the Experiential Comics format, and share their unique expressions of Experiential Comics in a final presentation. Throughout a 7-week period, the course will be divided into 7 themes 1) The Disconnection of Digital Comics 2) Classic and Unconventional Comics Continuity 3) Marvel vs DC vs Insert Your Universe Here 4) Fourth Industrial Revolution Technologies 5) Capture & Creation 6) Infinite Engagement and Unlocking Immersive Format 7) Experiential Comics Presentations. Each weekly class will be divided into two halves 1) Exploration of Theme/Discussion 2) Process, Practices, & Play. This course requires CL: Hypercinema or equivalent experience.
This course is designed to provide an overview of visual storytelling in the newsroom. We will explore a variety of narrative formats and design principles, learn about reporting techniques for visual stories, touch on the best practices and ethics of journalism and work on collaborative exercises and assignments.
Course description (optional): We are currently living in a society that operates under the principle that one body equals one agent, one vantage point, one identity. But emerging technologies may create a future in which the notion of a single personal identity becomes outdated. That future includes: machine learning techniques that make emulating the style and behavior of other people fast and easy; widely available AR/VR headsets that get people to identify with however many faces and bodies they choose, instead of just those they were born with; cryptocurrencies enabling the use of pseudonymous economic identities to transact across the planet in a permissionless manner. This is a course where we will get to explore and anticipate the utopian and dystopian aspects of this weird future of identity.
This course will provide students with an introduction to the area of machine listening. Machine listening is the general field studying algorithms and systems for audio understanding by machine. It deals exclusively with general audio as opposed to speech recognition. The most basic goal of all machine listening systems is to reliably recognize and react to very specific sounds. Over the course of the semester, we will create our own unique machine listening systems that provide us with new and interesting ways to interact with our projects. We will use live coding and real-time data visualization to demystify some of the more daunting underlying topics like digital signal analysis, music information retrieval, and machine learning.
Masks have been used around the world since antiquity for ceremonial and practical purposes, as devices for protection, disguise, entertainment and bodily transformation, made to be worn or displayed. Sociologist Erving Goffman wrote about the everyday life as a masked theatrical performance. The performative aspect of our lives today is ever so present in our use of social media, where we present a curated version ourselves for the immediate visual consumption of others. In our `Selfies`, we can assume a multitude of identities and characters. Recent tools and platforms have evolved social media portraiture to an art form and have created new opportunities for artists to create and distribute interactive augmentations, forming new relationships between artists and viewers. This class explores the developing language of social media portraiture enhanced by Augmented Reality. Students will: – review masks in art history, leading up to today – ideate, design and develop an interactive mask (AKA effects/lenses/filters) – learn to use the Meta Spark software to create AR effects. This course requires CL: Hypercinema or equivalent experience.
How can light, sound and design transform the human experience within a given space? How can psycho-geography be manipulated through audio-visual techniques? In what ways have and will technology allow spaces for sonic entertainment to be more immersive and experimental? Through an exploration of audio-visual techniques (i.e. VJing, MIDI-ing devices, sound synthesis, projection mapping, experiments with spatial sonic composition) along with discussions on how counterculture movements have used music and design as a vehicle for political dissent and community building, students will be invited to imagine new club spaces for social contexts beyond pure aesthetics. Assignments will include the development of different forms of interactive spaces for expression. Ableton (and free DAWs), MaxMSP, Isadora, and Unity will be used within this course.
A programming course where we’ll explore various techniques and solutions for tracking and sensing people or objects in space. Students will get familiar with the terminology and algorithms behind many sensing topics such as computer vision, depth cameras, positional tracking, coordinate mapping, machine learning, and pattern recognition. As these subjects are explored, we will also dig into communication, and how this information can be transmitted from one tool to another, for example using OSC, Spout/Syphon, MIDI, DMX/ArtNet. The goal being to use the right tool for the job and not limit ourselves to a particular piece of software. The first classes will consist of theory and in-class exercises covering these techniques, and remaining classes will be dedicated to a special project, which should use a combination of what we’ve learned to create a new work. Students will work in small groups to build this special project, but we’ll review proposals, milestones, and work in progress collectively on every class, encouraging discussion and collaboration.
Time is at once fundamental and mysterious. From the 2000-year-old Antikythera Mechanism to modern cesium-fountain clocks, humans have long sought to understand temporal patterns in nature, and build mechanisms to measure, reflect and predict those patterns. We’re at a unique moment, one in which we’ve developed the ability to perceive relativistic effects on time at the smallest scales, while struggling to think and plan across generations. In this course, we’ll reflect on the deep mysteries of time while also gaining hands-on skills applicable to temporal media and technologies. Topics will range from historical clock and orrery design through modern computer architecture (“A computer is a clock with benefits” writes Paul Ford in Bloomberg’s issue dedicated to code). Practically, we’ll build mechanical and software clocks; experiment with time-series data and time protocols; and survey techniques for digital signal processing and real-time operating systems. Students will execute several short assignments and a final project. Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048) & Intro to Phys. Comp. (ITPG-GT 2301)
Time-based art, performance – and theater most specifically – should be perfect manipulators of experience. Many creators of time-based art look for the “universal” in content and overlook what we all have in common in form: brains. What happens in the minds of all truly happens (what happens in the lobby also truly happens). How can we use art to make our brains experience the same things? What behind-the-scenes work can we employ to manipulate experience. Film scoring works on us in ways we don’t perceive in the moment. Can we pay closer attention to this when making work? Sometimes what we have for lunch effects our experience of art more than the hours of labor that went into the most minuscule of decisions when making that art. Is empathy always ethical? Show don’t tell. How does the art take place in the room in front of us? How can public performance not be awkward? How do we experience a performance rather than watch it.
In an age of pressing and complex problems like climate change, extreme inequality, and surveillance capitalism, “problem solving” is a central feature of innovation, design, and planning. But can these wicked problems actually be “solved”? And why does the cutting edge of problem solving look so limited? Machine learning. Predictive analytics. Algorithmic decision-making…Is planning for the future being outsourced to machines? In this class, we’ll take back control of the future by learning how it has historically been predicted, planned, and produced in board meetings, think tanks, writers’ rooms, and policy circles, and how those methods are being impacted by new technologies. During a series of discussions and hands-on workshops, we will learn specific, tangible, and collaborative practices for prediction and planning that can augment and transcend computational capabilities, making for marketable future-proof skills that can help redefine the future for humanity.
Today we no longer solely connect to the digital world through computers. The result of this push to connect the digital and the analog world is the increase necessity for low cost, low power, and self-contained electronics. This course is an applications-driven intro to electronics for inventors. Through a hands-on approach students will learn basic concepts about analog circuits, boolean logic, digital devices interfaces, and low-cost code-free electronics. Topics will include basic principles of electricity, as well as understanding of electronics components such as resistors, capacitors, diodes, transistors, audio amplifiers, and timers.
If we consider drawing as one of the most ancient forms of interaction, it has the power to engage users like no other technology. With the right setup and call for action – I’m always taken aback by how a cup full of crayons and a pile of paper can bring the child out of a serious businessman. But how do you pass the strong barriers of users who are afraid to draw? In this weekend workshop we’ll examine various techniques that can spark an interaction which is all focused on the action of drawing. Workshop topics include an exploring into collaborative drawing platforms, interactive drawing installations, drawing machines and drawing as a form of interactive storytelling. We’ll discuss the differences between digital and analog drawing and how to marry the benefits of both mediums. We’ll cover the work of important artist and researchers who are creating inspiring work in the field of drawing and interaction such as Shantell Martin, Zach Lieberman, Tobias Gutmann, David Ha and more There will be various collaborative drawing exercises in class. This workshop is meant for students who wish to focus on drawing as the driving force of their interactions and possibly expand it into thesis. Each student will design and prototype an interaction which is based on the subject of drawing. Alon Chitayat graduated from ITP in 2015, He works at Google as a Sr. UX and motion designer and on a collaborative digital whiteboard called Jamboard.
he virtual expansion of screens began during the 1960’s with the exploration of head-mounted displays. Since the 60’s, virtual reality has been explored in a multi-disciplinary context including philosophy, design, arts, behavioral therapy. Baudrillard, with his publication of Simulacra and Simulation (1981), declared that human experience is being replaced by a simulation of reality (HyperReality). His theories brought the dystopian narrative of the virtual to mainstream pop-culture, as seen in films such as The Lawnmower Man and The Matrix . Contrary to Baudrillard, Canadian VR Pioneer Char Davies brings a more positive perspective to Virtual Reality, “facilitating a temporary release from our haitial perceptions and culturally biased assumptions about being in the world, to enable us, however momentarily, to perceive ourselves and the world us freshly.” Throughout the class, the friction between Baudrillard and Davies will create the foundation of our exploration of Virtual Reality, where we will use room scale headsets and game engines to create meaningful “temporal experiences” exploring themes from behavioral sciences to narrative storytelling. We will be exploring ● existing VR projects, popular culture references and theory. ● concepts such as sense of embodiment (SoE), social VR design, and interactive storytelling techniques. ● methods for designing, modeling and rigging avatars for VR. ● live and pre-recorded animation. ● spatial audio techniques such as ambisonic sounds engines. ● packaging and distributing applications for social VR. This is a production class, along with a theoretical foundation, in which we will prototype projects with networking, inverse kinematics, raycasting and face tracking technologies to explore questions such as “how does the viewer become part of the experience?” and “how does the real space relate to the virtual worlds we design?” In the second half of the class, students will work in groups to build a final social VR project based on their exploration of the above framework.
Libraries like TensorFlow.js and ml5.js unlocked new opportunities for interactive machine learning projects in the browser. The goal of this class is to learn and understand common machine learning techniques and apply them to generate creative outputs in the browser. This class will start with running models in the browser using high-level APIs from ml5.js, as well as explore the Layer APIs from TensorFlow.js to train models using custom data. This class will also cover preparing the dataset for training models. At the completion of this course, students will have a better understanding of a few machine learning models, how do they work, how to train these models, and their use case to creative projects. Students will also be able to create interactive ML web applications with pre-trained models or their own models. Prospective students are expected to have taken an ICM (Introduction to Computational Media) course, or have an equivalent programming experience with JavaScript, HTML, CSS.
Want to make an interface that can be squished, stretched, stroked, or smooshed? This course will introduce the use of electronic textiles as sensors. Focus will be placed on physical interaction design – working with the affordances of these materials to create interfaces designed to invite or demand diverse types of physical interaction. This course does not require knowledge or love of sewing – a variety of construction methods will be introduced. It will rely on a physical computing approach, with Arduino being used to read sensor values. Working with a breadth of conductive and resistive materials, students will learn to design and create bespoke alternative interfaces that can live in our clothing, furniture, and built environments. Prerequisite: Intro to Phys. Comp. (ITPG-GT 2301)
Genspace is collaborating on this course with ITP so that students can learn science literacy through several specialized workshops that will take place Genspace – topics include Biohacking (with an introduction to CRISPR) Biomaterials. Students will create projects throughout the semester utilizing both Genspace and ITP resources. Additionally, students will learn the basics of biodesign and bioinformatics to help them frame and conceptualize their research and their projects and how best to use these skills ethically and responsibly in aesthetic and scientific ways. Since 2009 Genspace has operated a community biology laboratory in Brooklyn stemming from the hacking, biohacking, and DIYbio movements. It currently supports citizen science and public access to biology, biotechnology, synthetic biology, genetic engineering, citizen science, open source software, open source hardware.
Small, affordable single board computers enable you to blend the principles of Physical Computing with media playback and capture. This course uses the Raspberry Pi computer as a platform for creating portable devices that have the capability to display graphics, play video, play audio, take photographs, and capture video. As a foundation for the course, students will learn the basic workflow of using the Raspberry Pi computer for physical projects. This foundation includes an gaining an understanding of the Linux software, Python, and digital input and output. Students will work independently or collaboratively to build on this foundation to create their own media playback and capture devices.
This course will focus on a range of human-centered design research and innovation workshop methodologies including Design Thinking, LEGO Serious Play, Lean UX, Google Ventures Sprints, Gamestorming, Futurecasting, and Service Design. Students will look for design opportunities within the unprecedented challenges that we are currently facing as global citizens. Students will define a problem space based on the drivers that they’re most interested in exploring and will have the option to work alone or form small design research teams. They will learn how to conduct primary and secondary research, creating deliverables such as personas, journey maps, concept canvasses, and prototypes. Students will be required to apply design research approaches and workshop methodologies, develop and test a rapid prototype and then share their work in a final presentation.
As game and interaction designers we create systems and choices that can either prey upon our psychological foibles or help us avoid decision pitfalls. It is our responsibility to understand how we decide, to consider the ethics of the systems we create and to practice designing systems in a purposeful manner. Game Design & The Psychology of Choice will provide interaction and game designers with an understanding of the factors that influence behavior and decision-making by looking at the intertwining of cognitive psychology and economics through the development of behavioral economics. These disciplines study behavior on the individual and group level, often revealing some of the why behind the rules of thumb and folk wisdom that game designers come to intuitively. But understanding the why—why we fall into decision traps; why certain tradeoffs tax our brain more than others; why we are overconfident about our abilities; why certain decisions make us uncomfortable—allows us to more purposefully apply our design craft, both in and out of games. Finally, as a class, we will take what we learn about how we think and create series of game experiences based around key cognitive science concepts. Assignments may include: •Mod a cognitive science experiment into a game or experience •Analyze and present a game through the lens of cognitive science and behavioral economics •Create game or experience based around a particular insight from cognitive science or behavioral economics
Beginning with the release of Crowther and Woods’ “Colossal Cave Adventure” in 1977, the potential and unique affordances of computation as a means of storytelling have become more and more apparent. Combining approaches from literary theory, anthropology, computational creativity and game design, this class considers how narrative structure can be represented as data and enacted through computation, and invites students to implement practical prototypes of their own interactive and procedurally-generated narratives using a variety of technologies. Topics include (but are not limited to) hypertext fiction, “choose your own adventure”-style branching narratives, text adventures, visual novels, story generation from grammars and agent-based simulations. Students will complete a series of bite-size weekly assignments to present for in-class critique. Each session will also feature lectures, class discussion, and technical tutorials.
Computers are able to understand human speech better than ever before, but voice technology is still mostly used for practical (and boring!) purposes, like playing music, smart home control, or customer service phone trees. What else can we experience in the very weird, yet intuitive act of talking out loud to machines? The goal of this course is to give students the technical ability to imagine and build more creative uses of voice technology. Students will be encouraged to examine and play with the ways in which this emerging field is still broken and strange. We will develop interactions, performances, artworks or apps exploring the unique experience of human and computer conversation. Students will learn how to use text-to-speech and speech-to-text technologies, voice assistant devices, generative text techniques, open speech APIs, Node.js, and conversational UI design. There will be weekly assignments leading up to a final project. ICM or comparable programming experience required.
“Lies. Hoaxes. Conspiracies. Rumors. Propaganda. Fake news is an age-old phenomenon—but the internet is making targeted misinformation cheap and scalable. That is affecting politics, public opinion, and the everyday experience of the internet. In this 6-week class, we will explore the cutting edge of “fake news” by engaging in ethical research and fabrication. Participants will manufacture and observe a controlled “fake news” event. We will experiment with command-line tools for doctoring video, neural nets and deepfakes to fabricate reality, Twitter bots, behavioral psychology, and the dark underbelly of the ad economy.”
Whether it’s through photo realistic scans found in current-gen video games or the cartoonish and low-fi aesthetic of Bitmoji there is no limit to ways in which the body and the self are represented in digital spaces. This 2 credit class will look at how avatars have been historically used in the realm of art, commerce, and entertainment and utilize existing avatar creation tools to develop projects that examine identity, body politics, and contemporary performance. In class we will cover the basics of Unreal Engine, photogrammetry, 3D scanning, and model rigging although students will be encouraged to use existing skill sets and creative thinking to complete some of the smaller week-by-week assignments. The class will culminate with a short performance, small installation or single/multi-channel video piece using one or more of the techniques covered in class. This can be a solo project or a group project. In this class students will: – Explore how avatars can be utilized in your creative practice – Gain an introductory understanding of Unreal Engine, photogrammetry, model rigging, and 3D scanning. – Learn how to recontextualize digital spaces for the purposes of art, installation, and performance. – Broaden your thinking of what performance can be, both in a physical setting and digital setting. – Think critically about how physical bodies inhabit digital spaces and how the hardware and software we use reinforces the acceptance and value of certain kinds of bodies.
“Digital tools of all kinds are deeply embedded in how our society operates. Innovations in basic communication, data processing, image manipulation, and even financial systems have transformed our social worlds and our artistic practice. This became even clearer and more present during the global pandemic, where, during times of social isolation, digital and networked tools almost fully replaced in-person social life. This course will examine the ethical and esthetic implications of a digital and networked world through the lens of socially engaged art and explore how digital tools are and can be used in socially engaged art practice, where art and creative work intersect directly with people and civic life. This includes discussion of how digital and networked tools both increase and complicate physical, economic, and cultural accessibility, and the ethical and social implications of the newest technologies, including AI, Web3, and quantum computing. We will work on how digital tools have been used in socially engaged art and how they could be used further, guided by the understanding that working digitally with socially engaged concepts means both using digital tools within projects AND interrogating the inner workings of how digital practices operate socially and culturally. We will also have some meetings and activities in public spaces, field trips to organizations such as Eyebeam and Genspace, and guest lecturers. Please feel free to reach out to me directly if you have questions about taking the course, or the course content.”
The most difficult part of prototyping is not the building process, but the process of deciding how to build. If we choose proper technology for prototypes, we can improve their robustness and simplicity. This course will cover available and affordable technologies for ITP students to build prototypes. The course will start with soldering, wiring and LED basics. Then students will design an Arduino compatible board in Eagle, get it fabricated, assembled. And then using the debugger to dig deeper to understand how a microcontroller works. The class will also cover multitasking, signal processing, communication, document writing and advanced skills beyond the Intro to Physical Computing class. Each session will have lectures followed by in-class practices with guidance. The 14-week long assignment is called Do It Once – Do It Again. Bringing an idea or ongoing projects is highly encouraged. This course requires Physical Computing or equivalent experience. Prerequisite: Intro to Phys. Comp. (ITPG-GT 2301)
Until recently 3D sound was a novelty reserved for special uses and reaching a limited audience, no medium in popular culture has been as inherently dependent upon spatial audio as virtual reality. The widespread and standardized implementation of surround sound in film brought cinema to a new level of immersion, but is limited to theatrical exhibition and home theater systems. Today a considerable amount of content is consumed on mobile devices and laptops which excludes the cinematic experience of spatial sound. With the current rise of cinematic VR and the blurring line between gaming and experiential VR, spatial audio is no longer just an added bonus, but rather a necessity in designing immersive VR experiences. In this course we will explore the emerging field of 3D sound design and for both 360 video and game engine-built VR using a digital audio workstation, Unity, and 3D audio plugins.
The ability to digitally fabricate parts and whole pieces directly from our computers or design files used to be an exotic and expensive option not really suitable for student or designer projects, but changes in this field in the past 5 years have brought these capabilities much closer to our means, especially as ITP students. ITP and NYU now offer us access to laser cutting, CNC routing, and 3D stereolithography. In this class we will learn how to design for and operate these machines. Emphasis will be put on designing functional parts that can fit into a larger project or support other components as well as being successful on a conceptual and aesthetic level. In this class we will discover methods to design projects on CAD applications for total control of the result, and we will develop algorithmic ways to create designs from software (Processing) to take advantage of the ability to make parts and projects that are unique, customizable, dependent on external data or random. The class will include 3 assignments to create projects using the three machines (laser, router, 3D) and the opportunity to work on a final project.
This studio and seminar course explores the basic principles of food biochemistry, enzymology and food processing and how they relate to memory, the senses and the processing of information. Students will also learn basic principles of molecular gastronomy and modernist cuisine as framing devices for understanding how food also functions in the context of bodily health, environmental health as well as cultural and political narratives. Our food system consists of more than food production and consumption and this class will address how science and food science plays a more integral role in this system and how this knowledge can be mined for work that creatively and functionally contributes to this emerging field. Assignments for the class will be based on the incorporation of food science into design and technology projects that uses food as a substrate to explore and illuminate information within the food system. Workshops involve using liquid nitrogen hydrocolloids as well as creating performative food objects and a Futurist meal.
This course explores how sound, code, and interaction can merge to create musical experiences that invite listeners to shape the music, not just hear it. Students create a series of browser-based musical systems that respond to users, incorporate randomness, and draw patterns from existing music. We begin by creating a series of audio-visual interfaces—an instrument, a score/mixer, and a loop-based piece—that invite deeper listening through play. Incorporating elements of sound and music production, these projects turn tools normally hidden in the studio into interactive spaces where listeners, performers, and audiences can engage with music in new ways. From there, we dive into the inner workings of music, examining how sound organizes into rhythm, melody, timbre, and harmony, and how these patterns can be expressed in code. Students design interactive studies on each musical element, reimagining tools like drum machines, sequencers, and synthesizers into experimental, playful, or educational systems that incorporate creative coding, machine listening, and machine learning techniques. Classes combine lectures, coding tutorials, listening sessions, design exercises, and discussions of existing interfaces. Throughout, students bring their own musical sensibilities into the work while developing their creative coding skills using p5.js and Tone.js. Students regularly share work and receive feedback, using input from the class to develop and iterate on their ideas. The semester culminates in an interactive or generative piece that builds on the semester’s studies, documented through sketches, demos, and code. Prerequisites: Introduction to Computational Media (ICM) or equivalent programming experience is required. About Luisa Hors: https://www.luisapereira.net/
“Interactive technologies seldom stand alone. They exist in networks, and they facilitate networked connections between people. Designing technologies for communications requires an understanding of networks. This course is a foundation in how networks work. Through weekly readings and class discussions and a series of short hands-on projects, students gain an understanding of network topologies, how the elements of a network are connected and addressed, what protocols hold them together, and what dynamics arise in networked environments. This class is intended to supplement the many network-centric classes at ITP. It is broad survey, both of contemporary thinking about networks, and of current technologies and methods used in creating them. Prerequisites: Students should have an understanding of basic programming. This class can be taken at the same time as, or after, Intro to Computational Media or an equivalent intro to programming. Some, though not all, production work in the class requires basic programming. There is a significant reading component to this class as well. Learning Objectives In this class, you will learn about how communications networks are structured, and you will learn how to examine those structures using software tools. By the end of this class, you should have a working knowledge of the following concepts: * The basics of network theory, some history of the internet and the organizations and stakeholders involved in its creation and maintenance * The Open Systems Interconnect (OSI) model and standard internet protocols such as Internet Protocol (IP), Transmission Control Protocol (TCP) , Universal Datagram Protocol (UDP), and Hypertext Transport Protocol (HTTP). * Network addressing, private and public IP addresses * What hosts, servers, and clients are and a few ways in which they communicate * What a command line interface (CLI) is and how to use the tools available in one * The basics of internet security * How telecommunications networks are similar to other infrastructural networks, like power and transportation, and how they are different.”
Making words and images public used to be difficult, complex, and expensive. Now it’s not. That change, simple but fundamental, is transforming the media landscape. A publisher used to be required if you wanted to put material out into the public sphere; now anyone with a keyboard or a camera can circulate their material globally. This change in the economics of communication has opened the floodgates to a massive increase in the number and variety of participants creating and circulating media. This change, enormous and permanent, is driving several profound effects in the media landscape today. This course covers the transition from a world populated by professional media makers and a silent public to one where anyone who has a phone or a computer can be both producer and consumer. This change, brought about by the technological and economic characteristics of digital data and networks, is upending old industries — newspapers, music publishing, moviemaking — faster than new systems can be put in place. The result is chaos and experimentation as new ways of participating in the previously sparse media landscape are appearing everywhere. This course covers the history and economics of the previous media landscape, the design of digital networks that upend those historical systems, and new modes of participation from weblogs and wikis and Twitter to fan fiction and lolcats. The course centers on readings and field observation, with three papers due during the course of the term.
This course focuses on programming strategies and techniques behind procedural analysis and generation of text-based data. We’ll explore topics ranging from evaluating text according to its statistical properties to the automated production of text with probabilistic methods to text visualization. Students will learn server-side and client-side JavaScript programming and develop projects that can be shared and interacted with online. This fall the course will also explore topics in machine learning as related to text. There will be weekly homework assignments as well as a final project.
This is an environment for students to work on their existing project ideas that may fall outside the topic areas of existing classes. It is basically like an independent study with more structure and the opportunity for peer learning. This particular studio is appropriate for projects in the area of interactive art, programing, physical computing and digital fabrication. There are required weekly meetings to share project development and exchange critique. Students must devise and then complete their own weekly assignments updating the class wiki regularly. They also must present to the class every few weeks. When topics of general interest emerge, a member of the class or the instructor takes class time to cover them in depth. The rest of the meeting time is spent in breakout sessions with students working individually or in groups of students working on related projects.
Assistive or Adaptive Technology commonly refers to “products, devices or equipment, whether acquired commercially, modified or customized, that are used to maintain, increase or improve the functional capabilities of individuals with disabilities.” This multi-disciplinary course allows students from a variety of backgrounds to work together to develop assistive technology. Partnering with outside organizations students work in teams to identify a clinical need relevant to a certain clinical site or client population, and learn the process of developing an idea and following that through to the development of a prototype product. Teams are comprised of ITP students as well as graduate rehabilitation, physical and occupational therapy students. Prerequisites (for ITP students): H79.2233 Introduction to Computational Media and H79.2301 Introduction to Physical Computing. This course has a lab fee of $201.
This course introduces the Python programming language as a tool for reading and writing digital text. This course is specifically geared to serve as a general-purpose introduction to programming in Python, but will be of special interest to students interested in language and computer-generated text. Among the topics we’ll discuss are: the history and aesthetics of computer-generated writing in literature and the arts; computational linguistics; ethics and authorship in the context of computer-mediated language; poetic structure and sound symbolism; performance and publishing. Programming topics covered include: data structures (lists, sets, dictionaries); strategies for making code reusable (functions and modules); natural language processing; grammar-based text generation; predictive models of text (Markov chains and neural networks); and working with structured data and text corpora. Weekly programming exercises and readings culminate in a final project. Prerequisites: Introduction to Computational Media or equivalent programming experience. Prerequisite: ICM
The World Wide Web has grown up to be a great platform for asynchronous communication such as email and message boards. More recently this has extended into media posting and sharing. With the rise of broadband, more powerful computers and the prevalence networked media devices, synchronous communications have become more viable. Streaming media, audio and video conference rooms and text based chat give us the ability to create content and services tailored to a live audience. During this course, we focus on the types of content and interaction that can be supported through these technologies as well as explore new concepts around participation with a live distributed audience. In this course, we look at new and existing platforms for live communication on the web. We leverage existing services and use Flash, PHP, AJAX and possibly Processing/Java to develop our own solutions. Experience with ActionScript/Flash, PHP/MySQL and HTML/ JavaScript are helpful but not required.
This course addresses the design and implementation of secure applications. Concentration is on writing software programs that make it difficult for intruders to exploit security holes. The course emphasizes writing secure distributed programs in Java. The security ramifications of class, field and method visibility are emphasized. | Prerequisite: CS-UY 3923
This course examines Modern Cryptography from a both theoretical and applied perspective, with emphasis on “provable security” and “application case studies”. The course looks particularly at cryptographic primitives that are building blocks of various cryptographic applications. The course studies notions of security for a given cryptographic primitive, its various constructions and respective security analysis based on the security notion. The cryptographic primitives covered include pseudorandom functions, symmetric encryption (block ciphers), hash functions and random oracles, message authentication codes, asymmetric encryption, digital signatures and authenticated key exchange. The course covers how to build provably secure cryptographic protocols (e.g., secure message transmission, identification schemes, secure function evaluation, etc.), and various number-theoretic assumptions upon which cryptography is based. Also covered: implementation issues (e.g., key lengths, key management, standards, etc.) and, as application case studies, a number of real-life scenarios currently using solutions from modern cryptography. | Prerequisite: (CS-UY 2134 or CS-UY 1134) and (CS-UY 2124 or CS-UY 1124) (C- or better) and MA-UY 2314.
This course takes a top-down approach to computer networking. After an overview of computer networks and the Internet, the course covers the application layer, transport layer, network layer and link layers. Topics at the application layer include client-server architectures, P2P architectures, DNS and HTTP and Web applications. Topics at the transport layer include multiplexing, connectionless transport and UDP, principles or reliable data transfer, connection-oriented transport and TCP and TCP congestion control. Topics at the network layer include forwarding, router architecture, the IP protocol and routing protocols including OSPF and BGP. Topics at the link layer include multiple-access protocols, ALOHA, CSMA/CD, Ethernet, CSMA/CA, wireless 802.11 networks and link-layer switches. The course includes simple quantitative delay and throughput modeling, socket programming and network application development and Ethereal labs. | Prerequisite for Brooklyn Students: (CS-UY 2134 or CS-UY 1134) and (CS-UY 2124 or CS-UY 1124) (C- or better) | Prerequisite for Abu Dhabi Students: ENGR-UH 3510 or CS-UH 1050 (C- or better) | Prerequisite for Shanghai Students: CSCI-SHU 210 (C- or better)
With platforms like Steam and Itch.io making independent games more accessible to the public, we’re starting to see a movement toward physical installations of indie games as well. The New Arcade pays tribute to arcade cabinet designs of the 80’s and 90’s, but infuses them with new interfaces and digitally fabricated components. In this class, students will learn how to use the Unity game engine to design a simple arcade game. They’ll learn about aspects that separate an arcade game from other types of games, and interface their game with different kinds of hardware using microcontrollers. In the second half of the class, students will use Fusion360 to construct a new arcade experience using digital fabrication tools like laser cutters, and CNC machines. The class will culminate in a physical installation that showcases their game in a public gallery. Prerequisites: Physical Computing About Mark Kleback: https://wonderville.nyc
This advanced experiential production course will introduce students to the latest techniques for stereoscopic 360 video, manual 360 video stitching and depth map creation, camera-paired Depthkit volumetric video, and mixed-format photogrammetry. Techniques introduced in the class will presume some working knowledge of more basic forms of these capture methods as well as how to integrate them into Unity. Alongside an intense technical focus, the course will also deconstruct recent groundbreaking experiential works that utilize similar experimental production designs. The format of each class will combine lectures and workshops with the ultimate goal of introducing students to the expectations demanded by professional productions. All of the techniques introduced are being employed by top experiential creators and creative studios. The course will try to show viable paths for students to engage with immersive media pipelines, at an expert level, with an expanded sense of possibility and inspiration. Topics heavily examined throughout the course include: surveillance, race, socioeconomics, carceral capitalism and technoscience, algorithmic bias and oppression, and post-work societal structures.
In this class students will learn math tools to boost their digital practice, fix common problems, and understand the math behind our human perception of the physical world. This course spans different branches of math including geometry, linear algebra, logarithmic thinking, and statistics as they relate to a programmer making digital art with our contemporary media ecosystem. The aim of this course isn’t to become calculators, rather strengthen our intuition through historical and ethnomathematics perspectives and foster a new relationship to math. The prerequisites to this class are basic arithmetic skills and an introduction to programming. We will create applications using free and open-source software, including Python and p5.js.
This course will focus on researching, designing, and defining Intangible Interactions together, and unveiling artistic potential in it. Intangible interactions are those that we engage in without involving direct physical contact. Some examples would be automatic toilets, shopping carts that stop rolling outside the shop, contactless thermometers, gesture-based interactions, theremin, artwork activated by your presence, and mid-air haptic experiences. Intangible interfaces don’t have a tangible form that explicitly instructs us how to interact with them, and these interactions utilize other forms of feedback than those we feel through touch. Hence, Intangible Interactions tend to be more nuanced rather than direct, and the system is intricately designed to read your intentions using sensors. While technologies used for intangible interaction–such as computer vision and sensors are now more available and accessible, knowledge around the design and implementation of effective intangible interactions is a much less explored subject. We will explore practical, artistic, and whimsical applications of intangible interaction and look at the ways it can enhance human-computer interactions in our everyday lives. For example, it can allow new ways to interact with educational exhibits, artifacts, and artworks. We will explore intangibility as a poetic medium that can open up possibilities for creating work that challenges human senses and perception. We will discuss what are cultural and social implications that we need to consider in designing intangible interactions—what does it mean for an interaction to be “intuitive” and what are some of the assumptions that are embedded into designs that we need to challenge? You will also be introduced to working with sound frequencies that are outside the hearable spectrum to create mid-air haptic feedback. Technical topics that will be discussed in the class include: non touch-based sensors including optical sensors; proximity sensing; presence detection; optimizing sensor readings on Arduino; extending capability of sensors with light pipes and lenses; body tracking with cameras; signals outside visible spectrums; environmental sensing; mid-air haptic. Assignments will include relatively small-scale production assignments, labs, thinking, ideating, and reading. For the final project, you will be prompted to conceptualize a project that is larger than a classroom scope. You will respond to a call-for-projects with a proposal along with a solid prototype for the project so you have fully fleshed materials to apply to resources such as grants and other opportunities in the near future. I want you to think big and equip yourself with practical and essential skills to build a sustainable art or design practice! A proposal writing workshop and structured peer reviews will be provided to support this process. Tags: intangible, interaction, artistic, poetic, physical, sensors, physicalcomputing, haptic, hci, research, art, design, environment, playful, fun, proposalwriting
Tangible interfaces are interfaces that you touch. You control them with your hands, feet, and other body parts. Their shape, feel, and arrangement provide feedback. This is where interaction design meets industrial design. In this class, you’ll design, program, and build devices with tangible controls in order to better understand how humans understand and control technical systems through our sense of touch. We’ll discuss physical interaction concepts such as expressive interfaces and utilitarian ones, real-time control vs. delayed control, and implicit vs. explicit interactions. You’ll learn programming and electronic techniques to sense state change, thresholds, peaks, and other signs of user action. You’ll also learn how to design, shop for, and construct housings for the devices you build. On the electronics side, the primary tools will be the microcontroller and common tangible controls: pushbuttons, switches, rotary encoders, rotary and slide potentiometers, force sensors and touch sensors. The class will also cover on-device feedback through LEDs, speakers, and force-feedback actuators. On the fabrication side, you’ll work with the tools of the shop and XXX CAD program. You’ll design and build four projects in the course of the semester. Projects will be designed (and parts specified). Projects will build on the skills learned in Intro to Physical Computing and Intro to Fabrication. Prerequisites: Intro to Physical Computing and Intro to Computational Media, or a working knowledge of microcontroller programming in Arduino; Intro to Fabrication or basic knowledge of laser cutter.
As demographics in consumer markets and the global labor forces shift rapidly, diverse, equitable and inclusive (DEI) designers are necessary in all facets of business, from product and service design, to organizational and business design. In this multimedia and interactive Intro to Design for Diversity™(D4D), students will be provided with critical thinking skills to begin viewing diversity, equity and inclusion as design processes necessary for the future wellbeing of humans. D4D is a design framework that marries design thinking with diversity, equity and inclusion best practices and frameworks to illuminate cultural and racial biases. D4D is not only a means to harm reduction, but also a way-finding tool for better business. Students will be provided with historical context and case studies of racially biased practices that are now prevalent in biased algorithms in tech, as well as the lineage of culturally biased media narratives and how that plays a central part in today’s design practices, as well as their negative impacts. Students will be provided with a shared language and the outline of the D4D framework’s 5 Key Areas to enable them to design away from dominant culture, and instead, design for all people.
What is the relationship between American musician and poet, Gill Scott-Heron and cybernetics? Heron’s “The Revolution Will Not be Televised” was created in hopes to wake-up 1970’s America from complicity in societal oppression to then realize the revolution begins in your mind and something created through active participation, not passive media consumption. While, iterated forms of cybernetics also challenge the notion that “technology [or society] is self-correcting”, through fostering design thinking and systems theory through a meta-scale analysis of computational practices, essentially promoting being an observer of systems through conversation with process and feedback loops. Both ideologies center intention and holistic design within innovation — concepts vital to the equitable well-being of society in a technocratic era. In this course, students will explore the origins and history of the internet and HCI technologies as stemming from hippie communes, counterculture and warfare; survey historical and current social relations in the U.S.; study how these social relations have been replicated and embedded into everyday technologies; and consider potential futures in tandem with rapid technological advancements. We will study the works of pioneering designers and thought-leaders from Norbert Wiener, Stewart Brand, and Victor Papanek to Alondra Nelson and Ruha Benjamin. Phenomena discussed throughout the course range from the power of Black Twitter, the social media revolution of Egypt’s Tahrir Square, to cryptocurrency being used in bail reform. After in-depth historical analysis of societal structures, geo-political dissent, and algorithmic patterns, students will engage with futurism and speculative practices, techno-culture manifestos, and design and systems theory to develop a variety of research-driven projects. We will conclude with using both second-wave cybernetics as a design framework, and an anthropological lens to imagine, innovate and design more equitable technocratic futures. Topics heavily examined throughout the course include: surveillance, race, socioeconomics, carceral capitalism and technoscience, algorithmic bias and oppression, and post-work societal structures.
There is a substantial gap between what AR/VR is capable of today and the future that enthusiasts envision. The hardware is progressing, yet there are lack of design tools and methodologies. Effective augmented and virtual reality games and experience require good storytelling, animation, production and solid graphics. Students will learn a myriad of processes including spatial interface design, volumetric capture, working with spatial audio, porting animations and game programming. This course presumes no prior knowledge and is intended to jump start a career in AR/VR development and interaction design. The goal is to have relevant portfolio projects for entering industry. Students will create content in Unity 3D to agnostically deploy on headsets, mobile phones or tablets. Students will have access to a wide range of available hardware. In the beginning of the course, students will learn to implement the most important AR/VR interaction concepts – concepts such as selection, manipulation, travel, wayfinding, menus and inputting text in Unity3D. In the latter part of the course, students will implement prototypes that will be periodically critiqued by experts at Oculus, Magic Leap, Google, and other top companies. *You do not need to be a programmer. This is intended for students interested in 3D art, interaction design, sound design and game development. All are important for immersive development*
Inspired by the Japanese art of Chindōgu, this class will introduce a playful and whimsical approach to learn industrial design. In this 14-week studio format class, students will develop gadgets, inventions, and electronic devices that present absurd solutions to problems, while learning concepts and techniques of design ideation, prototyping, model making, CMF (color, material, and finishes), and manufacturing. This is a production heavy four-credit course, where students will learn about industrial design and tangible interactions. Prerequisite: Intro to Phys. Comp. (ITPG-GT 2301)
This class will introduce the basic skills and resources required to pursue a career as an artist. Students will learn the day to day tasks of working artists, such as writing critically about their own work, drafting grant proposals, and planning the business administration of their studios. They will also learn how to balance commercial and experimental projects, collaboration and community work, and teaching and studio practice. They will engage in the critical text about ethical dilemmas of working with art institutions, corporations and academia. By the end of class, students will write a personal statement, update an art portfolio, and apply for an artist residency. While the class will focus on contemporary art and artists, students who are interested in other disciplines may benefit from learning about entrepreneurship, authorship and cultural industry.
In this course, we’ll investigate two closely related ideas: public data and data publics. We’ll learn how to access and represent data from an assortment of existing public data sources, how to liberate currently obfuscated data sets, and how to create our own useful/whimsical/critical APIs from scratch. We’ll also investigate the act of putting data into public space – through sculpture, projections, performance, and participatory interventions. Particular attention will be paid to methods which bring data back to communities from which it was collected, and to tactics which build grassroots literacies, respect local ways of knowing and reinforce capabilities for stewardship and sovereignty.
Generative machine learning models open new possibilities for creating images, videos, and text. This class explores the idea of how artists, designers and creators can use machine learning in their own design process. The goal of this class is to learn and understand some common machine learning techniques and use them to generate creative outputs. Students will learn to use pre-trained models, and train their own models in the cloud using Runway. For each week, we will discuss the history, theory, datasets, application of the machine learning models, and build experiments based on the model. In addition to Runway, we will be using JavaScript libraries like the p5.js, ml5.js, and TensorFlow.js, and software like Photoshop, Unity and Figma. Students are expected to have taken ICM (Introduction to Computational Media), or have equivalent programming experience with Python or JavaScript. A list of ML models we will be covering: Image generation: StylanGAN: https://github.com/NVlabs/stylegan BigGAN: https://github.com/ajbrock/BigGAN-PyTorch Style Transfer Fast-style-transfer: https://github.com/lengstrom/fast-style-transfer Arbitrary-Image-Stylization: https://github.com/tensorflow/magenta/tree/master/magenta/models/arbitrary_image_stylization Semantic Image Segmentation/Synthesis Deeplab: https://github.com/tensorflow/models/tree/master/research/deeplab Sapde-coco: https://github.com/NVlabs/SPADE Image-to-Image Translation: pix2pix: https://phillipi.github.io/pix2pix/ pix2pixHD: https://github.com/NVIDIA/pix2pixHD Text Generation LSTM gpt-2: https://github.com/openai/gpt-2
The ways in which we communicate has changed radically in the last 100 years. As the communication systems we use have increased in complexity, so has the effort it takes to understand how they work. Most of us use protocols like LTE, HTTP, TCP/IP, and BLE every day. We take them for granted, almost like we do the laws of nature. But there are more than the laws of physics, more than techniques of engineering, embedded in the design and implementation of our protocols of communication. To understand their role in our lives, we need to look into the societal and economic contexts in which they came to be. In this class, we will examine communication protocols using Raspberry Pi’s, Arduinos, Software Defined Radios, and other connected devices. We will look closer at organizations like iSOC, ICANN and IEEE to better understand how protocol designs are implemented and standardized. Through readings, research and hands-on work we will build an understanding of how these protocols work, how their designs incorporate the physical, technical, cultural, corporate and political assumptions of the actors behind them. In the first half of the class readings and assignments will help familiarize students with some of the different protocols we rely on every day. In the second half, students will work in groups to investigate a communications protocol and consider its impact from a technical, societal and environmental perspective. Final projects will communicate their findings in whatever form students deem appropriate – explanatory blog posts, physical or digital installations, or even videos and podcasts.
With Machine Learning models are getting smaller, and microcontrollers are getting more computing power, Machine Learning is moving towards edge devices. This class explores the idea of how machine learning algorithms can be used on microcontrollers along with sensor data to build Physical Computing projects. In this class, we will learn about TensorFlow Lite, a library that allows you to run machine learning algorithms on microcontrollers. We will talk about common machine learning algorithms and techniques and apply them to build hands-on interactive projects that enrich our daily lives. Students will learn to use pre-trained models, and re-train the models with sensor data. We are going to talk about Image Classification, Transfer Learning, Gesture and Speech Detection. For each topic, we will first discuss its history, theory, datasets, and applications, and then build simple experiments based on the topic. Prospective students are expected to have taken Introduction to Physical Computing and Introduction to Computational Media course, or have equivalent programming experience with Arduino and JavaScript.
Language is more than just words and meanings: it’s paper and ink, pixels and screens, fingertips on keyboards, voices speaking out loud. Language is, in a word, material. In this course, students will gain an understanding of how the material of language is represented digitally, and learn computational techniques for manipulating this material in order to create speculative technologies that challenge conventional reading and writing practices. Topics include asemic writing, concrete poetry, markup languages, keyboard layouts, interactive and generative typography, printing technologies and bots (alongside other forms of radical publishing). Students will complete a series of weekly readings and production-oriented assignments leading up to a final project. In addition to critique, sessions will feature lectures, class discussions and technical tutorials. Prerequisites: Introduction to Computational Media or equivalent programming experience.
Art, design and experimental electronics can be great tools for inciting discussions of complex issues such as privacy, sexism, racism, economic inequality and climate change. This course aims to provoke thoughtful discussions of pressing issues through the combination of Art, Industrial Design and Embedded Electronics (sensors, actuators, wifi enabled microcontrollers – ESP32, raspberry pis). Topics will include technological disobedience, adversarial design and critical engineering. In this 14 week class, students will combine technology, design, and critical theory to build Art Objects / Interactive Sculptures that are aesthetically intriguing while socially relevant. This is a production heavy four-credit course, where students will learn about new-media critical theory, design and electronics. Prerequisites include an open mind, the drive to make, and physical computing.
Is augmented reality technology about to enter the mainstream? AR platforms have finally become widely accessible to artists, designers, and technologists thanks to recent advances in mobile performance and a new collection of powerful computer vision techniques. As such, the medium offers rich possibilities for experimentation and a chance to rethink how we experience the intersection of the physical and digital. In this course, students will acquire an understanding of basic concepts and techniques necessary to prototype and build simple AR experiences – with a consideration of not just visual but also aural AR. We’ll supplement practical exercises with an overview of the history of AR, and discuss the ethical, legal, and societal considerations cropping up around this topic. Our tool of choice will be Unity, but we will go over prototyping techniques outside of the platform to speed up the design process. If there is interest, we will cover how to get started building projects in openFrameworks, mobile, or web AR – and discuss why or when you might want to work within other platforms. Even though code samples will be provided, students are highly encouraged to have a basic understanding of Unity or at least have taken an introductory programming course. A working knowledge of Unity can be gained through Unity tutorials (https://unity3d.com/learn/tutorials) or Lynda (https://www.nyu.edu/lynda).
Microinteractions are everywhere, you interact with them on a regular basis. Animated emojis, heart buttons that burst with love when you tap them or password fields that shake when you type in the wrong password – these are the tiny animations that produce delightful moments while providing users with valuable feedback. They can intuitively guide your users without having to explicitly write a set of descriptive rules. They are the soul and character of your interface, and if crafted well they can turn every interaction to a joyful moment while improving the user experience. Using Adobe After Effects and Lottie as our primary tool, we’ll learn how to design, animate and export playful SVG animations as interactive components. We’ll examine the basic principles of UI motion, cover how to create loopable animated states with fluid transitions between them.
Introduction to Critical Mapping and Open Source Geospatial Web Analysis and Visualization is an introduction to critical perspectives in cartography and geospatial information systems and web technologies. This course will introduce students to the foundations of geographic data analysis and visualization, grounding practical studio based exercises and projects with critical readings and theory. Students taking this course will gain an appreciation for geographic thinking, learn to ask geographic questions, and apply basic methodologies to “make sense” of geographic data. The course will be conducted with open source geographic information systems and web technologies. Students are not expected to enter the class with knowledge of these tools, but will be expected to learn and apply them through studio exercises and project briefings.
This class is a project development studio for interactive music projects —that is, pieces of music that are not linear, but rather offer multiple dimensions for listeners to explore (on their phones in a crowded subway, at an abandoned factory in Palermo, back on their couches after a long day, at a classical concert hall). Students will take a project from concept to execution over several iterations, applying Interaction Design principles and techniques. During the first half of the semester, they will gather aural and visual references, compose graphic notations, and create interactive studies to explore specific elements of their composition. This work will lead to the implementation of the midterm project: a functional, high-fidelity prototype. For their final projects, students will evaluate their midterm pieces from the perspectives of music, visual design and interaction design, and refine them to produce an expressive piece of interactive music. ICM or equivalent experience is required. Some experience in making or producing music will be useful, but is not required.
Autonomous Artificial Artists (AAA) is a class to explore ways of making artworks “autonomous.” In this context, “autonomy” brings together three independent but related criteria: 1) artificial intelligence being a primary determinant in an artwork’s aesthetics 2) autonomous software principles culled from peer-to-peer network design, blockchain and decentralization technology, serverless and federated machine learning, cryptoeconomics, and agent-based multiplayer simulation. 3) crowd-sourced art where mass, unbounded cooperation of many participants creates novel artworks which represent the “hive mind” or collective input. The goal of this class is to learn a little bit about each of these seemingly disparate fields, and see how they may interact in interesting new ways. The idea of autonomous artworks is very new, and is being actively discussed by a small group of interdisciplinary researchers and artists since 2016/2017. Although the topic is highly experimental, it is nevertheless based on concrete technologies, making simultaneous use of several techniques which are under active development and have potentially far-reaching ramifications well outside the domain of art. The time is ripe for people within more design-oriented fields to begin thinking about how they might be used in a broader context. The class has both a theoretical component (learning about each of the individual technologies and their interplay) as well as a practical component: training and deploying generative models on computational environments that are as close to decentralized or autonomous as possible. In addition, we will explore prior notions of crowd-sourced or mass-collaborative art, touching on older principles and strategies such as Oulipo, exquisite corpse, and crowd-sourced computational artworks like Electric Sheep, Exhausting a Crowd, and others.
Over 7 weeks students in this course will explore different game mechanics, puzzle mechanics, group dynamics, and narrative structures and work in groups to design and build a room sized escape game. We will explore how to design immersive and participatory experiences through play and problem solving. Students will construct weekly puzzles and narratives and in the final week build and operate an “escape room” experience. Prerequisites: Physical Computing and ICM. Comfort with fabrication strongly encouraged.
Light Emitting Diodes or LEDs are used creatively all around us. They have the ability to emit light at different colors and intensities instantly and from very tiny points. How can we make creative visual works out of these amazing devices? What construction methods can we use to make those works reliable? Big LEDs will cover the process of designing large LED systems. We will cover LED array hardware and how to map pixels from computer generated media onto them. We will go through every major part of the hardware – different styles of LED arrays, drivers and gateways, cables, data protocols, and how to safely power all of them. We will learn to use the pixel mapping softwares Enttec ELM and Madmapper. We will also cover the paperwork needed to furnish a professional LED installation, including drafting riser diagrams, plan, section, and elevation views, creating a bill of materials, and writing instructions for users and installers. This year’s final project will be a site-specific LED sculpture installed in a public space at 375 Jay St. The installations will be able to display student chosen media that can be viewed for one minute. Students will work either in groups or alone and can choose from one of four installation options to present on: – A prepared square section of 2.0mm pitch LED video tiles (approx 256px x 256px, 2’-6” x 2’-6”) – A prepared low-resolution sculpture with diffused linear elements (approx 500px, 2’-6” x 5’-0” overall) – A student conceptualized LED video tile project – A student conceptualized low-resolution project Because of this year’s pandemic, unprecedented changes have come to the professional world of LED installations. As a result, we will be using remote tools such as networked-based cameras, remote desktop applications, and virtual private network connections to watch and operate the final projects. We will spend class time setting these tools up together. The two prepared options for the final project will be installed and maintained by the instructor.
This class will apply a product and service design lens to the rapidly evolving role of technology in politics, government services, and human rights, with a dual focus on the use of technology to advance the public good, and the threats that technology can pose to various aspects of civil society. On the one hand, there has been an explosion of technology tools that aim to promote healthy and peaceful democracies, provide more efficient government services, and promote human rights. This course will survey those efforts and the product design methodologies that guide them. On the other hand, 2018 has been a reckoning year for technology all over the world. The post-mortem of the 2016 US Presidential election shined a light on technology’s role in a promulgating a deeply polarized electorate, enabling election-meddling from foreign actors, and profiligating fake news, while also raising deep concerns about data privacy and security for everyday citizens. Meanwhile, new technologies like AI and Blockchain are poised to have deeply transformative effects on multiple aspects of society – from policing to education to financial services. This course will also explore the risks various technologies can pose to privacy, safety, liberty, and well-being. The course will feature guest speakers from leading practitioners in the space. Potentially including the ACLU, Higher Ground Labs, Elucd (YC17), NYU Better Policing Initiative, Microsoft, and more.
Stereo (2-speaker) sound is the default way we produce and distribute most audio. This class challenges the stereophonic-centricity of digital sound and instead focuses on the context of listening, interfacing and interacting with audio beyond 2 speakers. We will take a novel approach to spatialization by interfacing web technologies (Javascript, Web Audio, WebRTC) with multichannel audio to create room-scale interactive music and sonic spaces, and then make our findings publicly available through musical artifacts, open source tools, and documentation. We will explore conventional and unconventional loudspeaker arrangements ranging from 3 to 40 channels and how distribution and context affects music. Together, we will participate in a semester-long project examining the affordances of spatial and multichannel sound, designing and build open source tools to interface Tone.js, Higher-Order Ambisonics (HOA) and other multichannel techniques. Students will perform/install their final on the 40-channel speaker array at Dave&Gabe’s studio in Bushwick. Topics include 3D sound, open source, space and listening. Prerequisites: willingness to listen critically, some programming experience. No formal music training required.
In this course, students will learn the process of developing products that address user needs. Students will go through the process of identifying a user need, developing a product prototype, evaluating the product with the target user, and outlining the next development steps. Topics will include such elements as need finding, archetype development, user journey maps, ideation, prototyping, user evaluation and validation.
Forget the screen. People want to be part of the action. They don’t want to watch detectives and control superhero avatars. They want to solve the mystery and be the hero. They want to experience it. We see this craving for playful experience in everything from immersive theater to escape rooms to the Tough Mudder to gamified vacation packages. Designing live experiences for large audiences that demand agency offers a distinct set of challenges, from how much choice you give each participant to how many people you can through the experience. We’ll look at examples from pervasive games to amusement parks to immersive theater, examining both the design choices and technology that make the experiences possible. Along the way we’ll create large, playful experiences that put the participant at the center of the action.
he course title, “Veillance” is a reference to the root of “surveillance” and “sousveillance”, watching from above and watching from below respectively. As digital media becomes a greater part of our everyday lives, it is important to understand the new forms of surveillance that it enables as well as to harness these capabilities and perhaps to create systems of sousveillance. Through the course, we’ll critically examine technologies that have become integral part of our lives; the technologies that drive the internet, the capabilities of web browsers, mobile phones, and the emerging class of networked devices such as IP cameras and Amazon’s Alexa and Google Home. Through the course of this examination, we’ll look at how this technology works, the policies that govern their use, what their benefits are, and finally look at what we are giving up by embracing them. This will be a hands-on endeavor; we’ll develop software to illustrate their use and misuse as well as looking for ways that we can harness their “veillance” capabilities for creative, educational, and possibly subversive purposes. Of course, in this process, we’ll pay particular attention to ethical and moral concerns. The course will have weekly reading and technical assignments, encompasses group work, and will culminate final projects.
How do you process data from connected devices? This class examines how to build systems to collect, process, store, and visualize data from connected devices. The class will review and discuss real world IoT systems using case studies and actual projects. We will build system using Arduino hardware and open source software. We will discuss how to IoT systems are built on commercial cloud infrastructure. Students will learn about IoT devices and the data pipelines for processing data. They will build an Arduino based device to send and receive data over WiFi via MQTT. Students will write code to move data from MQTT into a database. Students will learn how to query the database and present data as tabular data and graphs. To gain an understanding of an entire IoT system from device to application, we will start at a high level and then drill into each of the pieces — we will: * Discuss sensor hardware and wireless options (WiFi, Cellular, LoRaWAN, LTE-M, etc) for moving data to the server * Discuss transport options MQTT, CoAP, AMQP, HTTPS, etc. * Examine SQL, NoSQL, and Time Series Database * Look at tools and techniques for querying and visualizing data. Prerequisite: * Introduction to Physical Computing * Introduction to Computational Media (suggested) The class will be a mix of lecture, discussion, and building IoT systems. Real world examples and case studies will be used to demonstrate how IoT can be built.
Across the City’s universities, the Technology, Media and Democracy program will bring together journalism, design, and technical disciplines to understand the various threats to journalism and media, and attempt to address these challenges using technical and computational methods and techniques. The free press, journalism and the media are some of the most critical elements of our democracy, but have been increasingly under attack by political and market forces. These challenges include: dwindling resources and support for deep investigative journalism; smear, law and technical and even physical assaults of media organizations and journalists; challenges to credibility and reliability including fake news and discrediting campaigns; and shifting business models and income sources that threaten both local and national news organizations and coverage. This course will include various elements that will help frame the problem and build/prototype solutions.
The class will focus on the many overlooked aspects of paper, and how it can be used as a three-dimensional material. We will learn the disciplines of making Pop-Ups, Origami, Paper Crafting, and Visual Design. Using these methods as a starting point, students will build prototypes to explore new ways to tell stories, inform, interact, play with, engage, and challenge a younger audience. Most classes are hands – on. The rest, dedicated to criticism (including from children), analysis, and refinement, technical and conceptual. We will discuss how they could be mass produced and distributed. Students will build three prototypes, during the semester. From these, each student will select a favorite to fully develop as the final.
What do WhatsApp and Nelson Mandela have in common? How about Mr. Robot and the UN Council for Human Rights? When most people think “digital security”, they rarely think of these connections; but the connections are there. Digital security is much more than an industry buzzword— it encompasses techno-social idealism, open source development, and symbiotic coordination between sectors in tech, the humanities, and civic society. Certainly, we’re going to talk about Signal, Tor, VPNs, and OTR. But let’s dig even deeper. In this course, students will learn the principals of digital security; from end-to-end encryption, to circumvention technology, resilient communications, and beyond. Part lab exploration, part oral history, and part prototyping workshop, students will come away with the tools they need to undertake development projects with end-user security in mind; and foster an appreciation for digital security’s integral, timely, and often life-saving role in human rights struggles across the globe.
With emerging research and development with soft circuit technologies and its integration into textile and clothing design, the garment as a reactive interface opens up new possibilities in engendering self-expressions, sensory experiences and more. This 14-week class is to introduce students to this realm by creating connections between hardware engineering and textile crafting. The class is for students with basic physical computing knowledge to explore the possibility of wearables, and arouse discussion about the potential in re-imagining our relationship with personal devices, textiles and garment design as an interactive media.
This course re-conceives interactive media as a form of choreographic intervention. Instead of asking how moving bodies can control media, we will ask how interactive systems can influence movement. How do you make someone feel soft inside? How do you shake an entire room? How do you orchestrate duets between strangers? To accomplish this, the class facilitates a semester-long collaboration between ITP students and dancers from the Barnard/Columbia Dance Department. Choreographers will learn to apply computational thinking to choreography and creative coders will learn to apply choreographic thinking to computation. To whatever extent possible, we will attempt to embody code. Using computer vision and visual media, we will look at directing both how people move (quality of movement) as well as where they move (pathways and spatial relationships). We will evaluate the strengths and weaknesses of the various sensing technologies available to us today. How wide is the gulf between what we can see and feel (strength, hardness, contortion) and what a computer can see and interpret (locations, contours, velocity, acceleration)? Class time will be split between movement exercises, playing with examples and deconstructing code. The class will culminate in a final showing of student work. All classes will take place at NYU with a separate weekly technical lab for ITP students.
Rules of play shape competitive games from checkers to football. But how do rules of interaction shape everyday life? And what happens when there are no established conventions and the rules are being made up as we go along as they have been for the past 6 months of living almost exclusively online? In this course, we will explore, code and test design strategies for playful, serious and bizarre group interactions while at the same time interrogating both what it means to play and how individual identities and group behaviors emerge. (The interactions we create in this class will be designed specifically for synchronous, in-person, embodied experiences.) Some of the questions we will ask and attempt to answer: What motivates participation? What hinders it? When does participation become oppressive? What’s the difference between self-consciousness and self-awareness? Who has power? Who doesn’t? Are leaders necessary? What’s the difference between taking turns and engaging in conversation? What happens when the slowest person sets the pace? And most importantly, what happens when there are no rules? Interaction inputs we will play with will include: mouse, keyboard, mobile device sensors, and microphone. Outputs can include visuals, text and sound. We will use p5, websockets and node.js for real-time interaction. Class time will be split between group improvisation exercises, playing with and critiquing examples and translating design strategies into code and logic.
For better or worse humanity is heading down the virtual rabbit hole. We’re trading an increasingly hostile natural environment for a socially networked and commercially driven artificial one. Whether it’s the bedrooms of YouTube streaming stars, the augmented Pokestops of Pokemon Go, the breakout rooms of a Zoom meeting, or even the “airspace” of Airbnb; we are witnessing a dramatic transformation of what occupying space means. The socially distanced measures as a result of the COVID-19 pandemic have only accelerated this societal embrace of the virtual. So where are these dramatic spatial paradigm shifts occurring? Who owns and occupies these spaces? Who are the architects and what historical and ethical foundations are they working from? What world do they want to build for humanity and where does the creative individual fit into it? Will it be a walled garden, a role-playing adventure or a tool for creating more worlds? The course will ask students to embrace the role of virtual architect, not in the traditional brick-and-mortar sense of constructing shelter, but in terms of the engagement with the raw concept of space. However this virtual space must be considered and evaluated as a “site,” that is activated and occupied by real people and all the limitations of physical space that they bring with them from the real world. This is the foundation of synthetic architecture; simulated space met with biological perception. This conceptual architecture is free from the confines of physics but host to a whole new set of questions: How do we embrace the human factors of a dimensionless environment? How do we make or encourage meaningful interactions within the limits of current technology? New models of interaction must inform and shape the architecture of virtual space – what does that look like? How can architecture and aesthetics inform the creation of virtual environments and immersive narratives? How do we acutely consider the psychological and social impacts of the worlds we design and what is the metaphorical ground plane to make sense of this virtual world, unbound by physics? About Jonathan Turner: http://www.jonathanwilliamturner.com/about/
One of the most transformative consumer products in history, the iPhone remains the standard bearer for great design and user experience. With the latest version of iOS and the introduction of the iPhone X, Apple puts depth sensing and augmented reality in our pockets. How do we take advantage of this incredible platform to produce our own compelling experiences? This course will be a hands-on workshop where we explore the world beyond generic apps and push the boundaries of what’s possible on iOS hardware. We will cover both the design and technical elements that pertain to end-to-end mobile app development. Topics will include augmented reality, the Internet of Things, new interfaces for musical expression, voice interaction, wearables, and others… While the class will involve iOS programming instruction, the instructors will help facilitate coding using an established code base to ensure technical skills are not a bottleneck to implementation. Students should expect to spend additional time outside of class learning Swift and other related programming concepts. Full-time access to an iOS device and a Mac laptop running the latest operating systems are required. As part of the design process, we’ll host workshops and guest critiques with designers from top studios around New York City. At the end of the class, students will have a working app to add to their portfolios and a strong basis for future mobile application work.
Magic windows that allow us to peek into different realities without leaving our physical space, lenses that reveal hidden layers of objects or navigating new universes within the same room. More than ever, mobile devices are getting a human-scale understanding of space and motion allowing us to create more intimate interactions with our surrounding spaces, leveraging them as a canvas to experience other realities. We now have the potential to give life to inanimate objects, tell stories through space, customizing private views of public spaces and recognize places we’ve never been. We’ll question what it means and how can we blend reality exploring themes such as: augmented space and new paradigms in social interaction, public space and privacy; storytelling and navigating the physical space like turning pages in a book; tangible interfaces, mixed objects and animism; Magic windows, x-ray vision, time-machines and impossible universes; Far away so close: telepresence and remote collaboration. The course will survey the past, current and up and coming technologies and experiences in Mixed Reality including environmental augmented reality and interactive projection mapping, handheld devices while fostering a strong user experience perspective on the affordances and constraints of each. We’ll research and discuss the design principles and guidelines for creating mixed reality experiences focusing on the links between real and virtual objects, interaction space and asymmetries between physical and digital worlds, environmental semantics and multimodal and tangible interaction. Technologies explored will be focusing on mobile platforms (phones, tablets) including Vuforia, SLAM, image and object recognition, depth sensing, projection mapping. Unity3D will be the development platform: students must have previous working knowledge of Unity3D and feel comfortable with independently developing using this platform. A working knowledge of Unity3D may be gained by going through the Unity 5 3D Essential Training Lynda Course prior to the course (log in to Lynda for free via https://www.nyu.edu/lynda).
Because the full potential of the emerging field of soft systems is unrealized, there are countless opportunities for curious innovators to discover or develop novel soft systems. Soft robotic skills and techniques also open up a world of possibilities for large scale or surprising artwork. This course teaches hands-on fabrication techniques for constructing simple pneumatic actuators from cast silicone and heat-sealed mylar, and challenges participants to design and build their own. Lectures and discussion center on concepts from soft innovation history, the current state-of-the-art, and sister disciplines of bio-inspired and hybrid (soft/hard) robotics. Consideration of both brand new soft materials, from a class visit to Material ConneXion library, and everyday overlooked soft mechanisms, found in average retail stores, will require participants to look at softness through a new lens. Final projects will be the development of an original soft/flexible/hybrid research or artistic concept presented with context, material swatches with justifications for choices, and physical or modeled proof-of-concept. About Kari Love: http://www.karimakes.com
We’ve been tinkering with the living systems that generate our foodstuffs for millennia. But climate change is radically and rapidly shifting these food landscapes, and the impacts include the extinction of many of the foods we love: chocolate, wine, beer, coffee and more importantly starvation for those in the world who are already food insecure. In this class, we’ll explore biotechnologies and bioengineering along with microbes and mushrooms to design and create pathways for the restoration of some of the damage we’ve wrought on our food system. We’ll also use art and design and systems thinking to build speculative and actionable projects that will focus not just on the future of food but the future of our planet and all of its inhabitants. This class is part of the Biodesign Challenge.
We use light in all aspects of our lives, yet we seldom notice it. Most of the time, that’s no accident. Lighting in everyday life, well-designed, doesn’t call attention to itself. Instead it draws focus to the subjects and activities which it supports. In this class, you’ll learn how lighting is used for utilitarian, expressive, and informational purposes. We’ll consider the intersection of lighting design and interaction design, paying attention to how people interact with light. We’ll practice both analyzing lighting and describing its effects, in order to use it more effectively. On the technical side, you’ll learn the basics of the physics of light, its transmission and perception. We’ll talk about sources of light, both current and historical. We’ll work with computerized control systems for lighting and modern light sources, and we’ll create a number of lighting designs for different purposes. You’ll get practice building AC and DC electronic circuits, programming microcontrollers for physical interaction, and learning digital communications protocols such as DMX512 and HTTP and REST. Projects in this class will range from indicator lighting on devices to task and wayfinding lighting in everyday environments to stage and environmental lighting. We won’t spend time on projection or light used for purely expressive purposes, but will look at how to put light to work instead. We’ll focus our attention on lighting the subject at hand, whether that subject is a person, a living environment, or a workspace. This class will be production-intensive throughout the course of the spring semester. Second-year students will not be able to combine the assignments in this class with their thesis projects, though some of the skills may be complementary.
Web browsers were originally used only for displaying simple HTML pages, but over the years they have become supercharged all-powerful web execution machines. In this class we’ll explore experimental new features and HTML5 APIs that allow browsers to communicate with the OS and their environment. APIs that will be covered may include: Battery Status, Geolocation, notifications, accelerometer usage, video access, speech recognition, and text-to-speech. We’ll cover the mechanics of bookmarklets and Chrome extensions, with a sustained multi-week focus on building extensions and exploring Chrome’s extensions APIs. Class workshops will include projects such as building an ad blocker, programmatically replacing text and images on a website, and making sites that respond to external events. Students will give weekly in-class presentations on web capabilities, complete small weekly assignments, and present a final project. This class leans heavily on web technologies, and experience with HTML, CSS and modern JavaScript (ICM with p5.js or Commlab Web/Networked Media) is required.
The medium of motion pictures will be will be transformed by virtual reality technologies. But the emerging hybrid form will likely have less to do with the iconic VR headset and immersion, than in the newly possible flow of expression in the other direction, out of the participant. This class looks at the true potential of virtual reality as its mutability, to put ordinary users in the role of director of visual media as they already are in their dreams and fantasies. Democratizing media by breaking it down into discrete more easily remixable parts has historically, from DNA to alphabets to movable type led to an explosion of expression and knowledge creation. Motion pictures, perhaps our most convincing medium, is now undergoing such a transformation thanks to virtual reality technologies. Specifically, we will look at how tools like depth cameras, motion capture, and machine learning can treat a scene as a collection of elements instead of a collection of pixels. We will work with the real-time 3D rendering capabilities available, even in your phone, for the instant contrivance of visual reality using compositing, the transformation of images and models as well as virtual camera moves. The class will also consider how the more conceptual dissection of film by cinema scholars and psychologist into things like plots and character types might be templated into reusable formulas for non-experts to create an emotionally satisfying dramatic arcs.
According to anthropologists Filip de Boeck and René Devisch, divination “constitutes a space in which cognitive structures are transformed and new relations are generated in and between the human body, the social body and the cosmos.” In this class, students will learn the history of divination, engage in the practice of divination, and speculate on what forms divination might take in a world where the human body, the social body, and even the cosmos(!) are digitally mediated. Starting with an understanding of ritual and folk culture, we will track the history of fortune-telling from the casting of lots to computer-generated randomness to the contemporary revival of Tarot; from reading entrails to astrology to data science; from glossolalia to surrealist writing practices to the “ghost in the machine” of artificial intelligence. Weekly readings and assignments culminate in a final project.
Subtractive fabrication is a common manufacturing process that produces durable and functional objects. This class will cover multiple techniques on machining and milling raw material into custom parts. We will focus on both traditional and digital fabrication tools: lathe, CNC router, 4 axis mill, etc. We will cover CAD, CAM, and machine setups as well as research affordable desktop milling solutions for personal shops. The class will be hands on and fabrication heavy, paying close attention to precision, accuracy, and craftsmanship. There will be weekly fabrication exercises, a midterm, and a final project. It’s mill-er time.
Hardware is not hard, and rapidly prototyping circuit boards is easier than ever with new tools available at ITP. Students will learn how to grow from a breadboard to a custom surface mount board, all without leaving the floor. This class is about artists and designers taking control of their hardware, and exploring the potential of embedding their projects into the world around them. Students will learn the multitude of tools and processes required to make a DIY circuit board. These include Eagle CAD, micro-milling machines, drawing schematics, ordering parts, surface-mount components, acid etching, solder paste and stenciling, reflow, pick-and-place, and others. In-class demonstrations will be done for each of the above, and students will complete assignments using online reference notes and videos. Two smaller projects and one final project will be assigned (3 total), each a circuit of the student’s’ choosing. These three assignments will be designed to work off the most recently taught subjects, and to get the students to fail early. It’s a lot of new material to be learning across multiple domains, so the students will need the entire semester to iterate.
Iteration and its impact on your creative process is the theme of this class. The format of the course turns its head on the traditional class structure and instead of focusing on syllabus that builds to a final project, the course is focused on a daily, iterative practice. Students will identify a theme, idea or topic they would like to explore over the course of 100 days and must commit to making or producing a variation on that idea and posting social evidence of their work every day for 100 days. Projects can focus on building, writing, drawing, programming, photographing, designing, composing or any creative expression. In parallel to the making, in-class lectures will examine the work of artists whose work has been defined by iteration and discuss the role of discipline and routine in the creative process.
Exhibition design is the art of marrying experience and information. The best do so seamlessly; the very best surprise and delight you along the way. In this class you will explore the craft of interactive exhibition design through practice. Working in small groups, you will select an NYU researcher whose work is of interest to you and create an interactive experience that presents this research to a broader, public audience. In the process, you will learn to interrogate content and form, audience and environment, medium and message to create a meaningful and playful exhibit experience.
You live with illusions. The nature of these illusions has long been described in mystical practices but is now increasing corroborated by modern research such as neuroscience, behavioral economics, social psychology, embodied cognition, and evolutionary psychology. What does this have to do with computational media? With technology, we have the ability to revisit some of these vestigial illusions that made sense in ancient environments but that might limit our personal happiness or the overall functioning of modern society. Will the computer’s ability to run more objective statistical analysis on data gathered tirelessly over time, across individuals and locations allow us to more accurately see ourselves and the world as it is. Can we build computer interfaces that give a fuller expression of our experience when we are not limited by an illusory view of ourselves? The insights into how into how to reach people more fully comes with a responsibility to then ask what should say to them. As the computers are able to understand us better than we understand ourselves will we relinquish control to them? At a practical level, the class looks at interfaces for digitizing signals from the less consciously controlled parts of your body using things like biosensors and cameras. It then moves on to opportunities for finding insights in from patterns in the mounds of already digitized expression you have produced every day for years, for instance in your email. Then we look at the possibility of bypassing consciousness with techniques like subliminal priming to affect behavior. Finally, we will look at how we can use things like browser extensions to manipulate shared media in an attempt to counter some filter bubble effects that emerge at a group level based on the illusions discussed in this class. This class will use skills from Physical Computing and ICM.
This 7-week, 2-point course will provide a framework for learning how to develop and program web applications. It will focus on server side development using JavaScript, Node.js with the Express framework, and persistent databases on cloud based infrastructure. Additional topics will include login and session management, web services and APIs, and will lightly touch on front-end web development. The course will be a mixture of lecture and in-class collaborative coding, with weekly programming and reading homework.
The World Wide Web no longer stops at the edge of your screen. When it comes to products, if it powers up, it talks to another device. This class provides an overview of methods for connecting the physical world to web-based applications. We’ll consider what the emerging interaction patterns are, if any, and we’ll develop some of our own as needed. This class can be seen as a narrower and more interaction design-based complement to Understanding Networks. The latter class provides a broader overview of the dynamics of communications networks, while this class focuses specifically on the challenges of connecting embedded devices to web-based services. Neither class is a prerequisite for the other, however. This class will introduce network connection techniques for devices using microcontrollers like the Nano 33 IoT and MKR series or ESP8266 and processors running an embedded operating system like the Raspberry Pi. Prerequisites: Intro to Physical Computing and Intro to Computational Media, or equivalent experience with the topics covered in those classes. Learning Objectives: Students will gain an understanding of the basics of network programming for devices with limited computing power. They will learn about current protocols for communication between devices and networked servers, and about the rudiments of security for that communication. Reading: There will be an article or two to read each week, to foster discussion about the design of connected things. Assignments: There will be several one-week software and hardware assignments to get familiar with different technologies and communications protocols, and one hardware and software final application project.
Can we capture the unpredictable evolutionary and emergent properties of nature in software? Can understanding the mathematical principles behind our physical world world help us to create digital worlds? This class focuses on the programming strategies and techniques behind computer simulations of natural systems. We explore topics ranging from basic mathematics and physics concepts to more advanced simulations of complex systems. Subjects covered include physics simulation, trigonometry, self-organization, genetic algorithms, and neural networks. Examples are demonstrated in JavaScript using p5.js (https://p5js.org). Much of the class time will be dedicated to in-class exercises and self-study as the course is available online through a video series (https://www.youtube.com/user/shiffman/playlists) and textbook (http://natureofcode.com/book).
This is an environment for students to work on their existing project ideas that may fall outside the topic areas of existing classes. It is basically like an independent study with more structure and the opportunity for peer learning. This particular studio is appropriate for projects in the area of interactive art, programing and physical computing. There are required weekly meetings to share project development and obtain critique. Students must devise and then complete their own weekly assignments updating the class wiki regularly. They also must present to the class every few weeks. When topics of general interest emerge, a member of the class or the instructor takes class time to cover them in depth. The rest of the meeting time is spent in breakout sessions with students working individually or in groups of students working on related projects.
As a response to developing technologies, artists working in areas of new/digital media are continually inventing new concepts for self-expression – interactivity, the passage of time and resolution, just to name a few. Yet these concepts are new only in the sense that they are being adapted to new media. For example, the notion of interactivity, frequently observed as original and specific to the user-interaction component of computer-mediated works, was equally, if differently, specific to Gianlorenzo Bernini’s 17th-century Baroque sculpture and architecture. Indeed the very concept of new media, and the concomitant implication of critically significant artistic development, applies throughout history. Oil revolutionized painting in the Renaissance, as did house-paint (on canvas) in the 1950s; in the 1910s, the found object indelibly altered definitions of art, the importance of the object being subsumed by that of the concept in the 1960s. This course examines how artists working before the boom of digital technology utilized other media, techniques and approaches to effect formal, conceptual and experiential dynamics comparable to those being investigated by new media artists today. The objective of the course is to provide students with not only knowledge of the immensely rich history of artistic creativity, but also a platform through which that knowledge might be utilized to reconsider new media strategies of artistic expression. It is the goal that through observation, discussion, reading and projects (both written and hands-on), students acquire mental tools to approach their own work with an expanded understanding of artistic possibility. Organized thematically, each class focuses on a different concept derived from the field of new media production and examined with regard to artistic precedents. The course focus primarily, though not exclusively, is on 20th/21st-century art. It is conducted as a combination lecture/discussion class. Critical theory is incorporated into the readings and discussions, but this is not strictly a theory course. The course has been conceptualized and designed to enhance understanding through a variety of means, from basic observation, to exploratory conversations, to more rigorous thinking informed by lectures, readings and focused discussions.
Code without content gets boring fast. This seven week course will show you how to create stories around which you can weave the technology learned in other classes. When content comes first, interesting problems arise to solve. Participants will get solid grounding in how to tell a visual story using words and images in a traditional format, so then they can take that format and reimagine it in entirely new and unique ways. The first few classes are devoted to getting basic comic skills. The remaining classes will hone and expand these abilities while posing the question: what can be done differently, and how can technology add to what we have created? At the end of the semester you will have a something that sets you apart; – original content AND technological know how. Students will combine words and images, look at each other’s work, look at examples of published works. Reimagine how these stories can be told in new and unique ways. This a demanding course. There is a lot of work involved, they will end up with a lot of original content. During the first half we look at and make traditional comics. Second half we experiment with comic format WHILE honing storytelling skills. Relevant speakers will come in to discuss what they do and how they work etc.
This class focuses on the art of computer graphics and image processing. We explore the concepts of pixilation, image representation and granularity and the tension between reality and image. Students are introduced to the tools and techniques of creating dynamic and interactive computer images from scratch, manipulating and processing existing images and videos, compositing and transitioning multiple images, tracking and masking live video, compositing and manipulating live video as well as manipulating depth information from Kinect. The class uses Processing.
This course teaches the ins and outs of using image processing software with an aim towards some type of real-time use (e.g. a performance or installation). The class looks at ways to manipulate different visual media (time-based, still, vector, and rendered) in real-time to allow students to develop interesting real-time performance systems. While the focus of this class is on using Max for visual work (through a software package called Jitter), it also looks at how to integrate interactive elements (sound, physical interfaces, etc.) into the work. Class time is spent on interface design and software development issues as well. The class explores some interesting capabilities of the software in terms of real-time camera input and tracking, generative graphics systems, and media transcoding. Throughout the class students develop and share ideas on live performance as a medium for visual expression, and learn the software tools necessary to put these ideas into practice in the form of idiosyncratic performance systems. A final presentation in the form of a group performance will be arranged. Students should have some working knowledge of Max/MSP before taking this class.
From the most ephemeral thought to the rise and fall of civilizations, every aspect of your life, and indeed the universe, involves energy. Energy has been called the “universal currency”by prolific science author Vaclav Smil, but also “a very subtle concept… very, very difficult to get right” by Noble physicist Richard Feynman. It is precisely this combination of importance and subtlety that motivates the Energy class at ITP. Maybe you fear the existential threat of anthropogenic climate change, or maybe you just want your pcomp projects to work better. Either way, the class will help you understand energy quantitatively and intuitively, and incorporate that knowledge in your projects (and perhaps your life). How? Building on skills introduced in Physical Computing, we will generate and measure electricity in order to see and feel energy in its various forms. We will turn kinetic and solar energy into electrical energy, store that in batteries and capacitors, and use it to power projects. We will develop knowledge useful in a variety of areas, from citizen-science to art installations, and address topics such as climate change and infrastructure access through the lens of energy. Students will build a final project using skills learned in the class. To accommodate pandemic restrictions, students will have the option to do more or less hands-on work or research as their situation allows, and support material such as an annotated supply list will help students tailor material expenses to their interests. Prior Physical Computing or equivalent experience required.
If you were inventing a museum today, what would it look like? Who would be there? What would its main purpose be? What would the audience experience? The first museums were called Cabinets of Wonder. Usually, a viewer with a guide, often the collector, would open doors and drawers to see what was inside–amazing things from different parts of the world, different times. They were windows on the world to places the visitors would probably never be able to go; to see things they would never otherwise be able to see. And now there’s television, movies, the internet, and travel. Why do people go to museums now? Will they in the future? Today, most museums seek to educate and to include more and more diverse visitors than they used to. How do people learn in public spaces? How do we know that they do? How can they make use of the new interactive technologies to support the experience and not lose what’s special about them? The class is an exploration, observation, theory, and design class for you to imagine the future of museums and exhibits. Museum and exhibit visits are your primary assignments for the first half of the course—usually accompanied by a reading. You will also make some record of your visit (including a sketchbook, a diorama, reviews). There will be guest speakers from Museums and exhibit design firms, and several field trips. In the second half of the course, you begin to imagine how you might reinvent a museum and develop a full-scale presentation of your own Cabinet of Wonder. About Emily Conrad: https://www.linkedin.com/in/emily/
Assignments, critiques, & demonstrations expand skills & knowledge in the use of the video camera as an art medium. This class stresses technical & conceptual skills & the exploration of the experimental possibilities of the medium.
This course explores the elements of music through the lenses of computation and interactive design. Each of the five course units focuses on one element of music (rhythm, melody, timbre, harmony, and structure), approaching it from the perspective of music theory, computation, and design. For each element, students listen to examples from different periods and styles, represent and manipulate the element in code, and create an interactive study around it. As students work toward their final projects, the class takes a more self-directed approach. Final projects can take the form of digital applications, spatial installations, or physical devices. In-class coding and assignments will be done in P5.js, but students will be free to use other languages and frameworks for their final projects. Creative Computing or equivalent programming experience is required.
In this foundation course students will be asked to think beyond the conventional forms of human computer interaction (i.e. the keyboard and mouse) to develop interfaces that consider the entire human body, the body’s capacity for gesture, as well as the relationship between the body and its environment. Students will learn the fundamentals of electronics and programming as they build projects using the Arduino microcontroller platform. Arduino is a small computer based on open source hardware and software. When used in conjunction with various sensors and actuators, Arduino is capable of gathering information about and acting upon the physical world. In addition to these physical computing techniques, students will also learn to harness the methods of traditional computation. The fundamentals of programming will be explored using the Processing programming language. Processing has a simplified syntax and an approachable computer graphics programming model, making it an ideal platform for first-time programmers. Students will gain a deeper appreciation of the expressive possibilities of computation as they learn to author their own software and systems and not simply use off-the-shelf solutions. Additional topics will include algorithmic drawing and animation techniques, digital modeling and fabrication, data exchange, manipulation, and presentation, as well as control of images, audio and video, including computer vision techniques. Structured weekly exercises are aimed at building specific skills, however students are free to pursue their own diverse interests in their midterm and final projects. Prerequisite: None. Fulfillment: CORE AT; IMA Major Other Foundation; IMB Major Emerging Media Foundation.
This course will combine a history of video art and experimental film with practical training in the use of live video performance art technology. Students will explore new ways to create and edit films and videos using VJ software, projections, and multi-channel video surfaces. Workshops will demonstrate concepts and software that can be integrated into the creative process of video performance art and video art installations. COURSE OBJECTIVES At the completion of this course, the student will be able to: Draw inspiration from the recent history of incredible video and multi-media artists. Develop an understanding of audio and visual hardware used by VJ’s. Use live VJ software to manipulate digital media in real time to create Video Performance Art. Use Projection Mapping techniques to project video art onto 3D surfaces. Create original video performance art, video installations, and other performance pieces. Utilize skills to make video art in the professional market.
Whether it’s through photo realistic scans found in current-gen video games or the cartoonish and low-fi aesthetic of Bitmoji there is no limit to ways in which the body and the self are represented in digital spaces. This 2-credit class will look at how avatars have been historically used in the realm of art, commerce, and entertainment and utilize existing avatar creation tools to develop projects that examine identity, body politics, and contemporary performance. In class, we will cover the basics of Unreal Engine, photogrammetry, 3D scanning, and model rigging although students will be encouraged to use existing skill sets and creative thinking to complete some of the smaller week-by-week assignments. The class will culminate with a short performance, small installation or single/multi-channel video piece using one or more of the techniques covered in class. This can be a solo project or a group project. In this class students will: – Explore how avatars can be utilized in your creative practice – Gain an introductory understanding of Unreal Engine, photogrammetry, model rigging, and 3D scanning. – Learn how to recontextualize digital spaces for the purposes of art, installation, and performance. – Broaden your thinking of what performance can be, both in a physical setting and digital setting. – Think critically about how physical bodies inhabit digital spaces and how the hardware and software we use reinforces the acceptance and value of certain kinds of bodies.
Data is ubiquitous. Yet, it’s often invisible. In this course, we will explore ways to create physical data visualizations using contemporary design and digital fabrication tools. Students will learn how to collect data, find interesting patterns, design creative digital models and build tangible pieces using laser cutters, 3D printers and woodworking tools. We will visualize everything from street performers in Washington Square to Instagram influencer trends. Topics related to creative coding, Arduino, artificial intelligence, projection mapping and traditional art-making techniques will also be discussed.
This course will explore the basic tools of digital imaging. We will cover the three main Adobe products for creative imaging – Illustrator, Photoshop, and InDesign. Through a series of short assignments we will look at various graphic design and layout ideas using Illustrator and InDesign and will touch on the wealth of image enhancement techniques afforded by Photoshop. The short assignments introduce the basics of design, typography and compositing images. Students have the opportunity to complete a small project of their own for the end of the term. Class time will be divided between lectures, critiques, and work in class sessions. This course is not intended to completely cover the software listed, but will give students a fundamental understanding of the possibilities of digital imaging. While the majority of the class focuses on print media (images, books and magazines), we discuss the growing importance of screen output. We do not have time to cover specific web or media projects, but will address transferable skills and understanding. We will incorporate some Adobe apps to augment the desktop applications. Additional reading materials will be distributed during the semester. Students should have access to the Adobe Creative Suite through the NYU license.
Hollywood in your palm. That is what this combination of lectures, screenings, demonstrations and practical production workshop will offer to the students in this course. There will be several professional guests making presentations and Q&A sessions from the mobile phone filmmaking industry. In addition to the historical and critical overview of the emergence and exponential growth of global cell phone cinema, students will shoot all footage on cell phones and download them for computerized editing. The final project will be under three minute shorts. Projects will include all genres of film and television: news, mini-documentaries, animation, music videos and narrative shorts. Completed student projects will be suitable to be posted on the Internet and entered into domestic and international mobile phone film festivals. For example, two minute long improvisations of Bollywood Style Music Videos shot on Cell Phones by the students have been projected at the Tribeca Cinemas as part of the New York Indian Film Festival. It is suggested but not compulsory that students bring to the class a cell phone capable of recording video.
Making Webisodes is an intensive 14 week course which combines lectures and workshops in which students create unique and compelling content for the web and then learn how to post that content on the web. Students will explore the basics of film production and online webisode distribution, working with – concept creation – writing – directing – acting – production design – camerawork – sound – editing – online tracking tools and social media – web monetization and advertising. The webisode is an exploding new art form. Web series, embedded ads, 5 second hooks, snapchats, vines and viral videos all present a variety of new media approaches within the entertainment industry, business, lifestyle, and politics. Webisodes are short visual presentations that either entertain us, directly sell us product, indirectly sell us product, or shock and engage our perspective, as in political propaganda videos. Lectures provide students with an overview of the emerging web series industry, concentrating on how the webisode is used to hook the audience, generate hits, and drive customers to websites and/or online advertising. Workshops then employ practical exercises to help the students conceive and create their own unique webisode, which can be narrative or non-narrative, fiction or non-fiction, experimental or satire, personal or political. The goal is to use the resources at hand and create instant media – webisodes. As the students produce their webisodes, they will learn by doing and they will be provided with practical knowledge of the art, craft, and commerce of webisodes.
A site to help IMA NY students find equivalent courses
For students joining IMA in Fall 2022 and beyond, our new program structure affects the categorization of courses on this site.
Classes listed in the “IMA Major Electives” categories refer to the old IMA program structure. If you’re under the new IMA program structure, these courses count as general IMA Electives for you. Your program structure is noted on your academic advising spreadsheet.
Students on the new program structure can search the Interchange for courses. If you’re looking for “IMA Major Distribution” courses, you'll find them listed here: