The medium of motion pictures will be will be transformed by virtual reality technologies. But the emerging hybrid form will likely have less to do with the iconic VR headset and immersion, than in the newly possible flow of expression in the other direction, out of the participant. This class looks at the true potential of virtual reality as its mutability, to put ordinary users in the role of director of visual media as they already are in their dreams and fantasies. Democratizing media by breaking it down into discrete more easily remixable parts has historically, from DNA to alphabets to movable type led to an explosion of expression and knowledge creation. Motion pictures, perhaps our most convincing medium, is now undergoing such a transformation thanks to virtual reality technologies. Specifically, we will look at how tools like depth cameras, motion capture, and machine learning can treat a scene as a collection of elements instead of a collection of pixels. We will work with the real-time 3D rendering capabilities available, even in your phone, for the instant contrivance of visual reality using compositing, the transformation of images and models as well as virtual camera moves. The class will also consider how the more conceptual dissection of film by cinema scholars and psychologist into things like plots and character types might be templated into reusable formulas for non-experts to create an emotionally satisfying dramatic arcs.
Code without content gets boring fast. This seven week course will show you how to create stories around which you can weave the technology learned in other classes. When content comes first, interesting problems arise to solve. Participants will get solid grounding in how to tell a visual story using words and images in a traditional format, so then they can take that format and reimagine it in entirely new and unique ways. The first few classes are devoted to getting basic comic skills. The remaining classes will hone and expand these abilities while posing the question: what can be done differently, and how can technology add to what we have created? At the end of the semester you will have a something that sets you apart; – original content AND technological know how. Students will combine words and images, look at each other’s work, look at examples of published works. Reimagine how these stories can be told in new and unique ways. This a demanding course. There is a lot of work involved, they will end up with a lot of original content. During the first half we look at and make traditional comics. Second half we experiment with comic format WHILE honing storytelling skills. Relevant speakers will come in to discuss what they do and how they work etc.
This course teaches the ins and outs of using image processing software with an aim towards some type of real-time use (e.g. a performance or installation). The class looks at ways to manipulate different visual media (time-based, still, vector, and rendered) in real-time to allow students to develop interesting real-time performance systems. While the focus of this class is on using Max for visual work (through a software package called Jitter), it also looks at how to integrate interactive elements (sound, physical interfaces, etc.) into the work. Class time is spent on interface design and software development issues as well. The class explores some interesting capabilities of the software in terms of real-time camera input and tracking, generative graphics systems, and media transcoding. Throughout the class students develop and share ideas on live performance as a medium for visual expression, and learn the software tools necessary to put these ideas into practice in the form of idiosyncratic performance systems. A final presentation in the form of a group performance will be arranged. Students should have some working knowledge of Max/MSP before taking this class.
This course is designed to provide students with hands-on experience working with interactive and emerging applications for creating immersive experiences, with a focus on designing for virtual reality headsets. The class will also touch on related technologies, methods, and fields including experience design, virtual painting, augmented reality, interactive installation, and 360 video/audio. The course materials will also include readings and discussions on prior art/relevant critical texts.
Wall labels, audio guides and informative maps are just some of the ways galleries and museums convey additional information about an art collection. How can we utilize new interactive mixed reality tools to design and deliver immersive experiences that breathe new life into an exhibit. Augmented and virtual reality are powerful tools for new media production and storytelling, but how can these tools serve to enhance our Wall labels, audio guides and informative maps are just some of the ways galleries and museums convey additional information about an art collection. How can we utilize new interactive mixed reality tools to design and deliver immersive experiences that breathe new life into an exhibit. Augmented and virtual reality are powerful tools for new media production and storytelling, but how can these tools serve to enhance our gallery experience without distracting from the power and importance of a pre-existing collection? This production course seeks to experiment with new ways to experience a museum collection through mixed reality. Topics covered include exhibition installation and curation, mixed reality production in Unity, mobile development for Augmented Reality.
This course will introduce students to the design and development of Virtual Reality experiences. We will examine these increasingly popular means of delivering content and social interactions and identify their unique affordances over existing platforms. Students will be challenged to harness the specific advantages of VR from conception through functional prototype. The class will also cover case studies of effective use of VR in information delivery, as well as social and artistic experiences.
Tangible heritage (site, object, and structure) and intangible heritage (motif, icon, character, textile, wardrobe, music, performance, language and ritual) are unseparated parts of the cultural heritage. The narrative and messaging of cultural heritage can be preserved by moving sequences, motion design and animation. The richness of heritage contents can be further disseminated and known by the dynamic media. This course aims to utilize animation and motion media to depict and preserve the richness of cultural heritage contents. 3D animation and motion graphics techniques will be addressed and applied to the storytelling. Students will be guided to research the Asian cultural heritage contents including the tangible and intangible heritage. They will further explore the visual design and production pipeline of animation. Visiting expert of interactive media design and intangible heritage performance will get involved to share the insights to the students. Prerequisite: None. Fulfillment: IMA/IMB elective.
We live in an era of information where the information can be written, accessed, shared, and also eliminated with a single stroke. As a result, the objective “truth” is brought to a question. In the last decade, artists have been experimenting with the fakeness of the truth and the truthfulness of the fake by creating fake documents, staged marriages, an arguably authentic artifact, imaginary advertisements both historical and contemporary. What does it mean to tell the truth in the context of art? How does art cross the boundaries between the real and the fake, truthfulness and misrepresentation? This course will examine social engagement of art and how “truth” is treated, interpreted, and presented. The class will take a field trip to a propaganda museum, have readings and discussions, and analyze artists working with fiction as a medium in art making. Students will work on projects to construct believable reality through object making (3D fabrication) and narrative construction (audiovisual material). Prerequisites: Interaction Lab or Communication Lab or Application Lab
Virtual Reality and Augmented Reality represent, respectively, visions of “being” somewhere else or augmenting your present environment. These visions are not new, but new technologies have made it possible to produce experiences unlike anything before, particularly through the use of headsets, spatial audio, touch sensors, and custom location-based installations. These new technologies are becoming small, powerful, and inexpensive, and as a result we are witnessing the birth of a powerful new medium, new art form, and new industry – all very quickly. The speed of VR and AR growth has created both opportunity and confusion. “VR / AR Fundamentals” takes a long, deep perspective. We will overview such basic elements as audiovisual resolution and fidelity; spatiality and immersion; other senses such as touch, smell, taste (and even mind); input and interactivity; and live and social. We’ll look at distinctions such as cinema versus games, movies versus models, public versus personal, real world versus fantasy worlds, linear versus interactive, and narrative versus ambient. These elements and distinctions will be presented partially as technical but in an understandable way for general liberal arts students, and will rely heavily on experiencing content and keeping up with current events. That’s the first half-semester. The second half-semester we’ll concentrate on collectively producing a series of timely and relevant projects, all short, entertaining, and useful to others exploring the world of VR / AR. Prerequisites: None Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
This course is an introduction to 3D graphics for video games, starting with the foundations of 3D modeling and texturing in industry-standard tools. It focuses on building fluency with basic tools and techniques, as well as developing experience with aesthetic issues of look, style, and critical judgement in visual art.
Board game design is a one-semester course for students who want to dig deeper into table-top games, from design to history to manufacturing. The first half of the course looks at the world of mass market games, which focus heavily on commercials, trends, plastics, licenses, low prices, and casual rules. The second half focuses on hobby games, designed for the dedicated game player, and the different styles of games in that world. The course is hands-on with at least one published game played in every class. There are multiple assignments where students bring these concepts to life through their own designs. Throughout the course, there is a focus on understanding players and designing games for a target audience.
Introduction to Game Development is a practical course that introduces students to the methods, tools and principles used in developing digital games. Over the course of the semester, students will work alone to create a two digital prototypes or ‘sketches’, before building on them to produce a final polished game, using the lessons learned in the earlier prototypes. This is a hands-on, primarily lab-based course, and so the focus is on learning by doing rather than on reading and discussion.
Narrative Design is an advanced game design course where students learn a variety of strategies to bring together game design and storytelling, both in table-top and digital games. Every assignment covers a different challenge when it comes to integrating systems design with storytelling. Students also learn some of the basics of storytelling, such as character development, dramatic action, generating conflict, and world-building.
Intermediate Game Design builds on the foundation of Introduction to Game Design to help build students’ understanding of how game design works in a practical context. While Introduction to Game Design acquaints students with basic foundational concepts and ideas, Intermediate Game Design puts those ideas into action across four very different kinds of projects. These projects emphasize the professional context of digital game design.
This course reflects the various skills and disciplines that are brought together in modern game development: game design, programming, asset creation, and critical analysis. Classroom lectures and lab time will all be used to bring these different educational vectors together into a coherent whole; the workshop will be organized around a single, long-term, hands-on, game creation project. At the completion of this course, the student will be able to: 1) Describe typical work practice in game development. 2) Demonstrate competency through actual implementation of code and assets. 3) Work with a game engine, and understand the basics of how to build a game in the engine.
This course introduces students to critical video—the use of documentary, ethnographic, and research-based video to investigate and critique contemporary culture. Students gain a theoretical overview of documentary video, a set of conceptual tools to analyze video, and an introduction to the practice of video production for small and mobile screens. Students apply texts on video’s history, culture, and distribution, as well as the ethical challenges of video production, to their own, research-based video project. No prior experience required.
This course will combine a history of video art and experimental film with practical training in the use of live video performance art technology. Students will explore new ways to create and edit films and videos using VJ software, projections, and multi-channel video surfaces. Workshops will demonstrate concepts and software that can be integrated into the creative process of video performance art and video art installations. COURSE OBJECTIVES At the completion of this course, the student will be able to: Draw inspiration from the recent history of incredible video and multi-media artists. Develop an understanding of audio and visual hardware used by VJ’s. Use live VJ software to manipulate digital media in real time to create Video Performance Art. Use Projection Mapping techniques to project video art onto 3D surfaces. Create original video performance art, video installations, and other performance pieces. Utilize skills to make video art in the professional market.
Introduction to Game Development is a practical course that introduces students to the methods, tools and principles used in developing digital games. Over the course of the semester, students will work alone to create a two digital prototypes or ‘sketches’, before building on them to produce a final polished game, using the lessons learned in the earlier prototypes. This is a hands-on, primarily lab-based course, and so the focus is on learning by doing rather than on reading and discussion.
This class continues from DM-UY 2153, moving into advanced technological implementations of 2D games. Taking designs from DM-UY 2153 and working in teams, students create a complete game. Students, based on abilities and individual goals, are assigned individually to work in production areas ranging from sprite creation, mapping and level design to engine coding and interaction scripting. Students are responsible for completing their assignments as if they were members of a professional game-development team. | Prerequisite: DM-UY 2153