From the history of visual music and abstract film to the contemporary notion of live cinema, this course will be an exploration of the synesthetic relationship between sound and visuals in a real-time performance setting. Dating back as far as the 18th century, systems have been invented to produce images alongside music linking the two through formalized arrangements. Current media technologies make developing such systems both more approachable and more expansive in their scope. Through readings, viewings, and case studies students will gain an understanding of the history and theory of live audiovisuals. During the course students will team up to develop and master a real-time audiovisual system of their own invention. The class will culminate in a show in which they will present their work through a live performance.
With the rise of mobile computing platforms such as smart phones and tablets, location has suddenly become a key element in the production and consumption of media. In this online course, designed for NYU Shanghai Interactive Media Arts majors studying abroad, students will be encouraged to simultaneously explore their unique study away site, as well as to consume, research, critique, and create location-based media for mobile devices. Students will be introduced to GPS (Global Positioning System) technologies through activities such as geocaching and GPS drawing. We will next investigate geocoding, geotagging, and geofencing through the application of JavaScript mapping platforms CartoDB and Google Maps. Students will then explore an emerging technology known as Bluetooth Beacons, which can be used to create custom positioning systems and to facilitate location awareness in mobile devices. Students will be asked to then produce, as a final project, a game that engages participants in a location or locations, as well as in locative media in any number of forms. Note: This is an online course featuring both synchronous and asynchronous learning opportunities. Registration is limited to IMA Majors studying at NYU’s global sites other than New York or Abu Dhabi.
This course will examine the relationship between planetary-scale computation and the development of planetarity. We take as starting points that (1) the very notion of climate change is an epistemological accomplishment of planetary-scale sensing, modeling and computation systems and (2) the ecological costs of computation are on an unsustainable trajectory. The seminar will ask: what are alternative futures for computation as human and ecological infrastructure? The primary subject of research is the transition from computation as a digital media object to computation as continental scale infrastructure. The scope and significance of this shift are fundamental for the development of interactive art and design that seeks to explore critical alternatives to extant models for this. What we call planetary-scale computation takes different forms at different scales—from energy and mineral sourcing and subterranean cloud infrastructure to urban software and massive universal addressing systems; from interfaces drawn by the augmentation of the hand and eye to users identified by self—quantification and the arrival of legions of sensors, algorithms, and robots. Each of these may represent a direct harm upon effected ecosystems and/or a means for and informed viable administration of those same systems. The course is primarily geared to advanced IMA students but is open to students from any major who are interested in engaging with contemporary issues of computation, society and ecology. Final projects will combine original written work and speculative design that can draw on diverse student core skill sets. Prerequisite: Sophomore Standing. Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
Many of us have played and enjoyed games. Have you ever wondered how people actually design and develop them? Can a games as a profession and practice be described? What are the basic theories, structures and skills involved in game development? How do game designers create compelling interactive experiences for the player? How do they respond to feedback, prototype and improve these experiences? This course explores these questions and others through playing, analyzing and making games over 14 weeks. Students will understand games not only as entertainment, production and business models, but as a form of mass interactive media and culture. Students will be introduced to game design concepts, emphasizing all stages of game development: paper and digital prototyping, iteration, interactive narrative design, object-oriented game programming, 3D/2D game art creation, sound effects composition and user testing. For the course project, students will work in teams and create games in multiple projects, from simple board games to a digital game with original game art, mechanics and other design elements. This course leverages multiple tools for game prototyping and design, but will focus on Unity, a game engine that uses C# based programming language, for game build-up.
Welcome to the ABC Browser Circus (ABC), where acrobats juggle with hyperlinks, dance across scrolling grids and jump through open server ports. This course introduces the students to the history of the internet, the World Wide Web, and specifically to the browser as a cultural object and its role in (net)art; in parallel, students are guided to creative uses of the web. In three consecutive modules, the browser is interpreted as a blank canvas, a susceptible agent and as a window to other realities respectively. Technologies used in the ABC Browser Circus are advanced HTML, CSS and JavaScript as well as Node for server-side programming. Participants must have completed either Communications Lab or Creative Coding Lab (IMA Foundation Classes). Students are expected to comfortably apply fundamental programming concepts to solve problems.
We will explore a range of programming languages, systems, and activities designed to help learners acquire computational skills and become creative problem solvers and project designers, including arts and interactive projects. We will create projects in turtle geometry, animation, and programmable embroidery (Snap!, Turtle Geometry, TurtleArt, and TurtleStitch), and in simulation systems which model complex systems in the life and social sciences in order to acquire a deeper understanding of their underlying phenomena (NetLogo). The course is fundamentally about ideas, and how some powerful ideas from computation can empower a learner to be a better creator and problem solver, acquire a deeper understanding of social and scientific phenomena, and become a self-directed learner. We will identify these ideas and actively engage with the pedagogical theories that underlie embodying them by creating with systems designed for children, beginners, or people coming from disciplines which traditionally had less emphasis on computing-based tools. We will emphasize reflection on our own learning within the course.”
In this foundation course students will learn the fundamentals of computation, software design, and web technologies, through a series of creative projects. The course is intended to equip students with the skills to develop artistic and business projects that include a significant computational component. Topics such as variables, functions, components, and functional and reactive programming will be brought together to create interactive applications, generative art, data visualization, and other domains. Within the framework of these creative projects students will develop a greater understanding of how computer programs operate, be exposed to various concepts used to create experiences and interactions, and become more familiar with some of the technologies that constitute the internet. This course is intended for students with no prior programming background. Prerequisite: None. Fulfillment: CORE AT; IMA Major Other Foundation; IMB Major Emerging Media Foundation.
“The practice of using light and motion as artistic media traces its roots back to the architectural design of spiritual structures in ancient cultures and the use of fire and shadow in religious ceremonies. However, not until the invention of electricity, the incandescent bulb, and electric motors did light and motion really become artistic media themselves. The current availability of cheap and abundant sources of motion and light have opened up new possibilities for the creation of sculptural objects which compose structures in light and movement. Drawing upon the combined histories of lumia, kinetic sculpture, and op art, we will be investigating the historical and current developments of kinetic art and light art. Students will create kinetic light sculptures of their own design, building upon and expanding their knowledge of digital fabrication, physical computing, and generative software systems. They will learn how to compose in color, light, rhythm, movement, and space and how to install and present their work in a public setting.”
What is the place of human creativity, agency and intelligence in complex technical networks? This class aims to build a foundation for studying how automation, artificial intelligence, robotics, digital image production, predictive software, and eco-technologies signal the ascent of a posthuman society. It provides a selection of texts and case studies that introduce basic philosophical and sociological questions about posthuman technologies and support creators, writers and thinkers in conceptualizing the posthuman nature of new media. The class is a combination of lectures and writing workshops. Prerequisite: None. Fulfillment: IMA/IMB elective.
Architecture has always been considered as an immediate extension of the human civilization, and its connection with state-of-the-art technologies has always been essential. In our current highly mediated and augmented environments, architecture shifts from static, solid, and predefined, to a fluid, interactive, and ever-changing. Computational, interactive, and media technologies challenge our understanding of what architecture is, redefining our engagement with exterior and interior spaces. The course investigates the area of media architecture from a contextual and critical perspective, examining and implementing in theoretical and practical scenarios current emerging trends. Students are expected to develop a comprehensive understanding of media architecture, to thoroughly investigate the media cityscape (including motivations, social implications, technological requirements), and to develop installation work that utilizes contemporary media development practices and demonstrates artistic, technological, and scientific rigor. Prerequisite: None
This course emphasizes on the 3D animation through digital modeling / sculpting techniques, keyframe and blend-shape animation . The course breaks down into 4 stages : 1. basic topology of head model, 2. high-poly sculpting and projection texturing, 3. Keyframe and blend-shapes animation, 4. 3D animation final project. In the final project, students get to choose either lip-sync animation or conceptual piece utilizing the created head models. An overview of digital editing / compositing and sound design will also be introduced to assist with students’ final project at the end of the semester. Prerequisite: None. Fulfillment: IMA/IMB elective.
Sound is all around us. The way we perceive or experience these sounds are largely dependent upon their environments, whether artificially constructed or naturally present. In this studio-based course, students will learn about the development of sound art through readings and listenings by artists, musicians and designers who investigate our sonic environment through sound sculptures, multi-channel immersive installations, soundscapes, audio tours, podcasts and field recordings. The course will begin with an introduction into the physics of sound with time for deep listening exercises. We will read selected texts and listen to pieces by those working in the field of Acoustic Ecology, an interdisciplinary field that employs ethnographic practices to create sound studies or art. We will look at artists who employ narrative techniques to engage the audience. We will study musicians such as Alvin Lucier and John Cage and the history of experimental music that takes into consideration the physical space its recorded or played in. There will be weekly exercises that will help develop the student’s spatial awareness of sound and music. We will take listening and recording trips into the field to understand the acoustic urban environment. We will use different types of microphones such as hydrophones and binaural mics. Students will learn how to build their own contact microphones. Students will have the opportunity to create works for multi-channel speakers. The final project can take on any form within the realm of sound art–multimedia, narrative, non-narrative, music, installation.
“How would you like to pay?” A simple question may provoke diversified answers in the digital age. The financial applications of digital technologies, or so-called fintechs have engendered many alternative forms such as QR codes, mobile apps, and Bitcoin for financial activities including payment, loans, and investment. What technologies make these innovations possible? What are the aesthetic norms embedded in fin-tech app designs? How do the fin-tech companies interact with banks, policy-makers, and regulators? While Ant Financial and Tencent Finance make China the leader of fin-tech innovation, how does the global map of fin-tech innovation look like? After all, how have fin-techs re-shaped people’s everyday life, and perhaps will reform human being? Through a weekly three-hour meeting, this course is to make sense of fin-techs from a wide variety of perspectives. Integrating lectures with workshops and company visits, this course will equip students with critical thinking and practical skills that allow them to dialogue with various actors, such as computer programmers, project managers, investors, as well as academic intellectuals. Prerequisite: None. Fulfillment: IMA Major Electives; IMB Major Business Elective/Interactive Media Elective; Business and Finance Major Non-Finance Electives; Business and Marketing Major Non-Marketing Electives.
Design Thinking is a theoretical, methodological and practical framework that has the potential of bringing about socially responsible innovation. This course will introduce the core concepts and toolkits of design thinking as the foundation of innovative thinking and practices. It requires you to step out of your comfort zone and to examine and challenge your own assumptions. Critical thinking, teamwork, and empathy are the three pillars of this course. Prerequisite: None
This course is about designing your life. What if you used the same innovation principles that startups use and applied them to your own lives? Students are introduced to design thinking as a framework to process their college experience and explore life after graduation. This course will use rapid prototyping methods to test out career interests, engage in behavior design, and ideate on multiple futures. The course will be delivered in a studio setup with in-class design workshops, group discussions, personal reflection, individual coaching and field trips. Prerequisite: None. Fulfillment: IMA Major Electives; IMB Major Business Elective/Interactive Media Elective; Business and Finance Major Non-Finance Electives; Business and Marketing Major Non-Marketing Electives.
This course is about designing your global experiences. Students are introduced to design thinking as a practical tool to make the most out of their NYUSH experience and prototype opportunities offered by NYU’s Global Network. This course will use rapid prototyping methods to test out academic and career interests, visit global organizations in Shanghai, and meet with leaders with multinational experience. The course will be delivered in a studio setup with in-class design workshops that explore topics such as the purpose of college, educational wayfinding, global perspectives, and innovating on career paradigms.
We live in an era of information where the information can be written, accessed, shared, and also eliminated with a single stroke. As a result, the objective “truth” is brought to a question. In the last decade, artists have been experimenting with the fakeness of the truth and the truthfulness of the fake by creating fake documents, staged marriages, an arguably authentic artifact, imaginary advertisements both historical and contemporary. What does it mean to tell the truth in the context of art? How does art cross the boundaries between the real and the fake, truthfulness and misrepresentation? This course will examine social engagement of art and how “truth” is treated, interpreted, and presented. The class will take a field trip to a propaganda museum, have readings and discussions, and analyze artists working with fiction as a medium in art making. Students will work on projects to construct believable reality through object making (3D fabrication) and narrative construction (audiovisual material). Prerequisites: Interaction Lab or Communication Lab or Application Lab
The Nature of Code is an intermediate course based on Daniel Shiffman’s The Nature of Code course at NYU ITP and was adjusted for undergraduate students. This course explores the fundamentals of programming, such as Object-Oriented Programming, and the application of simple principles of mathematics and physics in order to recreate natural behaviors in a digital environment. Prerequisites: This class uses p5(p5js.org) and requires Interaction Lab, Communication Lab, Application Lab, or similar programming background. Knowledge of other languages, such as Processing, three.js and OpenFrameworks, is also encouraged.