Tangible heritage (site, object, and structure) and intangible heritage (motif, icon, character, textile, wardrobe, music, performance, language and ritual) are unseparated parts of the cultural heritage. The narrative and messaging of cultural heritage can be preserved by moving sequences, motion design and animation. The richness of heritage contents can be further disseminated and known by the dynamic media. This course aims to utilize animation and motion media to depict and preserve the richness of cultural heritage contents. 3D animation and motion graphics techniques will be addressed and applied to the storytelling. Students will be guided to research the Asian cultural heritage contents including the tangible and intangible heritage. They will further explore the visual design and production pipeline of animation. Visiting expert of interactive media design and intangible heritage performance will get involved to share the insights to the students. Prerequisite: None. Fulfillment: IMA/IMB elective.
In this course students will learn the fundamentals of computation, software design, and web technologies, through a series of creative projects. The course is intended to equip students with the skills to develop artistic and business projects that include a significant computational component. Topics such as variables, functions, components, and functional and reactive programming will be brought together to create interactive applications, generative art, data visualization, and other domains. Within the framework of these creative projects students will develop a greater understanding of how computer programs operate, be exposed to various concepts used to create experiences and interactions, and become more familiar with some of the technologies that constitute the internet. This course is intended for students with no prior programming background. Prerequisites: None
Ours is a time of unceasing image production. CCTV cameras wrap around the planet, machines make visual learning sets for other machines, hundreds of billions of hours of video material is livestreamed online every year, artists speculate about the possibility of making virtual reality for animals, and seemingly natural phenomena such as climate change can only be apprehended through risk simulations and data visualisations. Simultaneously, from deep fakes to computergenerated influencers and webcam models, digital images without real-life referents are set to become a part of social life, posing questions about the agency of media makers and consumers in an increasingly simulated world. Contemporary visual culture is not made by humans alone and sometimes not even meant for human eyes. What are we to make of aesthetics when they become automated? How can human collectives be thought from the perspective, or collaborate with, the semi-autonomous technological systems around us? What kind of conceptual capacities do we need to be able to think about the future of such media globally, and in specific geographical locations? In this class, we will explore the shi< that media theory and philosophy of technology have made towards the inhuman. From biometrics, insect media, and eco-media to so<ware art, augmented reality, and satellite imagery, we are witnessing a paradigm change in how we think about the relationship between human, animal, and machine agency in visual culture. Looking at a variety of contemporary media objects, we will read state-of-the-art theory, write a research paper, and collaborate on a post-human media studies syllabus spanning texts and objects from across the globe.
Utilizing technological and scientific research / case studies / artifacts, this class introduces students to the topic of enhanced / extended perception and how technological augmentation allow us to sense and perceive alternative layers of our surrounding world, reconfiguring our understanding of what reality really is. Students will be asked to develop their own prototypes that demonstrate a conceptual or functional outcome on how perception can be extended, enhanced, or even hacked.
This class focuses on the curiosity behind the greatest discovery of electromagnetism. By replicating experiments both with magnetic and electrical fields, we will explore the major breakthroughs that enabled us to power up devices, connect people, and store information. During the course we will have seminar discussions analyzing texts that contextualize the lab experiments and we will work toward conclusions on the implications of these discoveries. We will analyze different perspectives that led to the development of theories about the electromagnetic field, radio waves transmissions, and the quantum properties of electrons. Students will propose their own creative experiments, linking their personal interests with how electrons behave. As part of their final project report, they will submit an essay describing the technical methodology, critical framework, and the results of their experiment. Throughout the course they will acquire a working knowledge of components like capacitors, lasers, antennae, and circuit prototyping tools. Prerequisites: None Fulfillment: CORE ED; IMA/IMB elective.
As no two cultures define “artificial” the same way, and no two define “intelligence” the same way, so too they will not define and imagine “artificial intelligence” in the same way. As China and the West engage in what is sometimes called a new scientific and technological race, the fundamental terms of a shared conversation across cultures may be missing or contested. As planetary-scale economies shift toward increasing automation, AI moves out of the laboratory and into the fabric of supply-chains, urban infrastructures, and everyday life. This research seminar will allow students to explore different ways that different cultural connotations of “face”, “city”, and “governance”, for example, imply different paths for the development of this fundamental technology. NYU Shanghai will host an international conference in the Spring 2020 that examine these same topics. Prerequisites: Interaction Lab / Application Lab / Communication Lab / What’s New Media
An attempt to better understand and participate in the communications revolution we are undergoing through an investigation of the nature and consequences of previous communications revolutions. Using readings ranging from Plato to Sontag to Kundera, the course will look closely at the history of spoken language, images, writing, printing, photography, film, radio and television. How were they understood? How were they initially used or misused? What were their effects upon social patterns, politics and thought? How did innovations occur? What can that tell us about the potential and potential influence of digital communication? Students will be asked to undertake innovative experiments of their own in forms of new media. Prerequisites: None
People use their bodies in the workplace whether they are dancers or athletes, managers or engineers. Physical wellbeing, social teamwork, and cognition may be affected by our movement practices. How do people use physicality and motion to think? What is the interaction between body, motion, place, and goals? We will explore these questions by building physical-computing-based systems that encourage us to bring movement into new times and places in daily life, that coach users and develop learning environments for movement practices, and that test our understanding of ways that we “think with the body”. In this course we will bring practices such as fitness, dance, sports, and martial arts into a series of interactive installations, movement learning projects, and workspace modifications built on computing, sensing and actuator technologies. In this course we will also explore these questions through review of existing creative projects in this area, readings, presentations, and knowledge-sharing sessions. Prerequisites: Creative Coding Lab, Interaction Lab or equivalent programming experience Fulfillment: IMA/IMB elective.
Data is at the heart of the increasing role technology has in our lives. Data collection and algorithmic processing are not only central to recent technical breakthroughs such as in AI and automation but have created new economic paradigms where data equals value and shape political approaches to power and control. Decisions based on algorithms affect society at large whether it’s changing the way we transport and distribute goods, or influencing the things we buy, the news we read or even the people we date. The world that algorithms see is data. For the average person, however, data is seldom more than an abstract idea. So what exactly is data? How is value extracted from it? And why should we care? How can we ethically balance the positive uses of data-driven systems with the threats they pose to discriminate and infringe basic human rights? This class seeks to untangle some of these issues practically and theoretically. Prerequisite: Creative Coding Lab or equivalent programming experience. Fulfillment: CORE AT; IMA/IMB elective.
Exhibition: Next class is an exploration and observation of the fields of exhibition design and museum studies. This class will explore how emerging and interactive technologies can be applied to museum and exhibition design to enhance visitors’ experiences. What is an exhibition in a museum of today and how should it be experienced? What is the role of a museum in contemporary society? How does it engage the audiences of tomorrow? The class discusses curatorial practices, various exhibition concepts and forms, museum visitor experience, and exhibitions’ social values. Students will visit and immerse themselves in many museums and exhibitions as a professional observer who will be asked to write reflections of their observations as an essay for each museum visit. Students will choose a research topic at the beginning of the class and they will start collecting materials, building objects, designing experiences, and writing a statement for their final exhibition based on this topic. Students’ design work will be frequently reviewed and given feedback by the instructor, classmates, and guest speakers/critics. After the midterm, the instructor will initiate a collaboration with a local museum or art space. Based on the specific circumstances, students will face a design challenge to propose an exhibition proposal or provide a creative solution to the partner organization. By the end of the course, students will install and present their work as a group art show in the student art gallery. Prerequisites: Interaction Lab or Creative Coding Lab Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
Application Lab is an intensive project-driven course where students explore current challenges and opportunities at the intersections of emerging media and innovation through the lenses of design, prototyping and innovation. The course seeks to help students understand how these high-level concepts intersect with skills to form the basis for new applications of technology and human industrial art. At the end of this course, students will be able to think critically and holistically about not only what makes innovations possible but will also how to utilize emerging media technologies and ideas to bring innovations into the world that respect and acknowledge the values of design, iteration and innovation. Prerequisite: None. Fulfillment: IMA Major Other Foundation/Electives; IMB Major Emerging Media Foundation/ Interactive Media Elective.
User experience design (UXD, UED, or XD) is the process of enhancing user satisfaction with a product by improving its usability, accessibility, and desirability provided throughout the user’s interaction with a product. The class is designed for those who are passionate about creating user-centered experiences with interactive media. Students are encouraged to empathize with users, engaging them to make informed design choices from prototype right through to project completion. Prerequisites: None Fulfillment: IMA/IMB elective.
In this foundation course students will be asked to think beyond the conventional forms of human computer interaction (i.e. the keyboard and mouse) to develop interfaces that consider the entire human body, the body’s capacity for gesture, as well as the relationship between the body and its environment. Students will learn the fundamentals of electronics and programming as they build projects using the Arduino microcontroller platform. Arduino is a small computer based on open source hardware and software. When used in conjunction with various sensors and actuators, Arduino is capable of gathering information about and acting upon the physical world. In addition to these physical computing techniques, students will also learn to harness the methods of traditional computation. The fundamentals of programming will be explored using the Processing programming language. Processing has a simplified syntax and an approachable computer graphics programming model, making it an ideal platform for first-time programmers. Students will gain a deeper appreciation of the expressive possibilities of computation as they learn to author their own software and systems and not simply use off-the-shelf solutions. Additional topics will include algorithmic drawing and animation techniques, digital modeling and fabrication, data exchange, manipulation, and presentation, as well as control of images, audio and video, including computer vision techniques. Structured weekly exercises are aimed at building specific skills, however students are free to pursue their own diverse interests in their midterm and final projects. Prerequisite: None. Fulfillment: CORE AT; IMA Major Other Foundation; IMB Major Emerging Media Foundation.
In this foundation course students will explore the possibilities of emerging media by successively producing projects that make use of digital images, graphics, audio, and video. The course is designed to provide students with a framework to effectively communicate and tell stories through digital means. Students learn through hands-on experimentation in a laboratory context and the principles of interpersonal communication, media theory, and human factors will be introduced in readings and investigated through discussion. Adobe Creative Cloud and other relevant software applications will be examined to establish a diverse digital toolkit. Both traditional and experimental outputs will be explored. Weekly assignments, group and independent projects, as well as documentation of projects will be assigned in each of the core areas of study. Prerequisite: None. Fulfillment: IMA Major Other Foundation; IMB Major Emerging Media Foundation.
This course explores the scientific foundations of current environmental issues and their implications for public policy. The syllabus is divided into sections that each examines a current environmental theme in depth. The first sections investigate the composition of the atmosphere and the chemical processes that cause air pollution, ozone depletion, and global warming. Moving to the study of water, the course explores the properties of this unique solvent and the effect of various aqueous pollutants. The course also includes an investigation of energy from chemical reactions, our continuing reliance on fossil fuels, and the potential of alternative energy sources. The laboratory experiments are closely integrated with the lecture topics and provide hands-on explorations of central course themes. Throughout the course we also will examine how scientific studies of the environment are intimately connected with political, economic and policy concerns.
Re-make: make (something) again or differently. In this class students will investigate why China became the world’s largest importer of waste. They will study local communities in China, how they manage their waste, and explore innovative ways to transform discarded materials or products around us into something new and precious in areas such as art, graphic and industrial design, architecture, fashion, textiles, etc,. Through research and development, students will learn how traditional techniques and new technologies among the sustainable design philosophy can be utilized as powerful tools for addressing social and environmental problems.
This course will explore the fundamentals of new media scholarship. Together, we will review and engage with different theories of emerging media in its social, cultural, political, and historical contexts. Students will be able to research, think and write critically about some of the central debates in media studies, including new media forms and aesthetics, issues of gender, race, and labor, platforms, infrastructure and various emerging paradigms. Classes consist of theoretical readings, media example discussion, and writing workshops. Prerequisite: WAI (or co-requisite). Fulfillment: IMA Major Foundations/Elective; IMB Major Emerging Media Foundation/Elective.
Artificial Intelligence Arts is an intermediate class that broadly explores issues in the applications of AI to arts and creativity. This class looks at generative Machine Learning algorithms for creation of new media, arts and design. In addition to covering the technical advances, the class also addresses the ethical concerns ranging from the use of data set, the necessarily of AI generative capacity to our proper attitudes towards AI aesthetics and creativity. Students will apply a practical and conceptual understanding of AI both as technology and artistic medium to their creative practices.
Data is at the heart of the increasing role technology has in our lives. Data collection and algorithmic processing are not only central to recent technical breakthroughs such as in AI and automation but have created new economic paradigms where data equals value and shape political approaches to power and control. Decisions based on algorithms affect society at large whether it’s changing the way we transport and distribute goods, or influencing the things we buy, the news we read or even the people we date. The *world* that algorithms *see* is data. For the average person, however, data is seldom more than an abstract idea. So what exactly is data? How is value extracted from it? And why should we care? How can we ethically balance the positive uses of data-driven systems with the threats they pose to discriminate and infringe basic human rights? This class seeks to untangle some of these issues practically and theoretically. Each week will include a lecture introducing contemporary theorists, artists, groups, and in-class discussions or exercises. Potentially there will be a guest speaker, too. Topic sections may include surveillance and privacy, data journalism and activism or automation and machine bias. What we cover will be complemented by reading and research assignments. The other half of the week is a programming lab in which you will learn the fundamentals of web-based data visualization using JavaScript. Programming assignments will allow you to further practice what we learn. Throughout the semester, you will work on three main visualization projects that are inspired by the theoretical subjects that we cover. The form of these projects will usually be a website. Successful projects feature data visualizations that are both playful as well as effective in conveying information and a reflection that links the practical work to the theoretical learnings. Prerequisite: Interaction Lab, Communications Lab or Application Lab
Machine Learning for New Interfaces is an introductory course with the goal of teaching machine learning concepts in an approachable way to students with no prior knowledge. We will explore diverse and experimental methods in Machine Learning such as classification, recognition, movement prediction and image style translation. By the end of the course, students will be able to create their own interfaces or applications for the web. They will be able to apply fundamental concepts of Machine Learning, recognize Machine Learning models in the world and make Machine Learning projects applicable to everyday life. Prerequisite: Creative Coding Lab or equivalent programming experience Fulfillment: IMA/IMB elective.