This course has three goals. First, the mastering of a modern object-oriented programming language, enough to allow students to tackle real-world problems of important significance. Second, gaining an appreciation of computational thinking, a process that provides the foundations for solving real-world problems. Finally, providing an overview of the very diverse and exciting field of computer science – a field which, arguably more than any other, impacts how we work, live, and play today. Prerequisite: Introduction to Computer Programming or placement exam. Equivalency: This course counts for CSCI-UA 101. Fulfillment: Core Curriculum Requirement Algorithmic Thinking; Computer Science Major Required Courses; Computer Systems Engineering Major Required Courses; Data Science Major Foundational Courses; Electrical and Systems Engineering Major Required Major Courses.
In this era of virtual production, time-based media faces new opportunities and challenges in terms of pipelines, workflows, and distribution. Decentralizing, hybridizing, and outsourcing among film studios, production houses, broadcast design, interactive studios, and the gaming industry have become major topics of discourse in academia and industry. This course focuses on the history/context, present practice, and the emerging trends of VFX studies and its applications. Through collaborative research with academia and industry, the course investigates the theory and practice of VFX studies and further examines the feasibility of emerging technologies through the spirit of entrepreneurship. Prerequisite: Interaction Lab / Creative Coding Lab / Communications Lab / Application Lab Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
This course offers students the opportunity to develop a self-initiated project with close mentorship from a faculty member. Projects undertaken can span the areas of conceptual research, business development, creative practice, and media production. The course includes structured weekly workshop and critique times with peers and special guests. It is expected that students will be invested in the work of their peers by providing feedback and carefully consider the feedback they receive during critiques. In addition to weekly meeting times, students are expected to also participate in regular one-on-one meetings with faculty, peers, and guests. A formal project proposal, weekly assignments and documentation, a final project presentation, and participation in the IMA End of Semester show are all required. Although students are encouraged to continue work they may have initiated in a prior class, they may not combine or in any way double count work from this class in another class taken in the same semester. Group work is allowed assuming all group members are enrolled in this class. Students may take this course in either the first or second 7 weeks for 2 credits or repeated across 14 weeks for 4 credits. Prerequisite: Sophomore standing. Fulfilment: IMA/IMB elective; IMA advanced elective.
“How do humans and other animals obtain knowledge about the world? It is easy to take perception for granted, but complex processes (only partly understood) underlie our ability to understand the world by seeing, hearing, feeling, tasting, and smelling it. This is not because the scientific study of perception is new. In fact, perception has fascinated philosophers, physicists, and physiologists for centuries. Currently, perception is a central topic in psychology, cognitive science, computer science, and neuroscience. How do scientists approach perception? We seek to discover lawful relations between perceptual experiences and the physical world and to develop models of the processes and mechanisms in the brain that produce these connections. In this course, in the lectures, we will discuss fundamental problems in perception (primarily vision), and in the lab sessions, you will learn about standard experimental methods and their use in the study of perceptual processes and to give you first-hand experience in conducting original research. As part of these activities you will learn to write experimental reports and to think critically about the relation between theory and experiment. You will also be exposed to the use of computers in perception research. Indeed, there will be considerable use of computers in the course, with part of the goal being to provide you with basic computer skills.” Prereq: None Fulfillment: CORE ED
Data Physicalization is an emerging research area. It explores new techniques to design and encode data into physical artifacts through geometry or material properties. Recent advances in Computational Design and Fabrication offer novel opportunities to complement traditional screen-based visualizations enhancing people’s ability to discover, understand, and communicate data. This course uses a data visualization approach to define new methods of computational design and digital fabrication. Students will create unique, data-driven, everyday objects and sculpt meaning into them. Through the use of platforms such as Rhinoceros: a 3D modeling software, and Grasshopper: a visual programming language, students will be introduced to fundamental computational methods for designing and fabricating, as well as the understanding of digital fabrication strategies for parametrically generated design. Prerequisite: Interaction Lab or Creative Coding Lab. Fulfillment: IMA/IMB Elective.
Industrial Design in Action is a course that will help you bridge the gap between your ideas and their physical form. From initial research to conception, you will practice and apply different design methodologies that lead to creative and innovative ideas; acquire a fundamental understanding of form, function and design language; and utilize sketching and visual storytelling to communicate a message and features of a compelling product. In addition, you will become familiar with various Computer Aided Design (CAD) softwares; explore different types of materials for different uses and applications; and experiment with a myriad of fabrication techniques, from basic hand tools to advanced digital fabrication, you will learn to use the right tool for the job. Altogether these skills will enable you to go from prototype to a finished product. In a nutshell, this course is about designing and fabricating things we love. Prerequisite: Interaction Lab or Communications Lab or Application Lab. Fulfillment: IMA/IMB Elective.
The current design methods and technologies in the field of digital entertainment, from design concepts to design tools, are still based on 2D screens, but the product is often 3D. This contradiction results in the designers not being able to see the final consequences of their work directly. Can existing VR technologies solve this contradiction? Immersive design is a new design method for digital creativities beyond the screen. It usually takes VR, AR, or MR devices as design interfaces to craft 3D models, textures, game environments, and other gaming experiences. Not only game assets creation but also game design concepts can be changed with these new technical inputs. In this course, students will answer the following questions: ○ Is immersive design more intuitive? ○ Is immersive design more efficient? ○ Do immersive design techniques have lower learning costs? ○ What traditional design lessons and concepts can be applied in an immersive design environment? In view of these questions, students from different disciplines will give answers through discussions, projects, collaboration, documentation, and VR games. Prerequisite: Communications Lab. Fulfillment: IMA/IMB Elective.
This course draws from net art, interface design, and post-digital / post- internet practices to explore interactions that bridge screen and physical. Students are led to conceptualize and develop bespoke “interfaces” (in the widest sense), in which either aspects of the web are reflected in the physical world, or – conversely – the habitual mode of browsing is being updated in ways that capture the user’s physical and bodily presence. A reflection of the medium web, its vernacular, and practical daily use is the starting point of this project. The students’ work is additionally being informed by analysis of select examples from art and design, exemplary for ways of re-framing the technical everyday. This course will make use of web technologies (p5.js), and physical computing techniques – and introduce students to various ways those can be technically, and conceptually, combined. Prerequisite: Interaction Lab or Creative Coding Lab. Fulfillment: IMA/IMB Elective.
In response to the popular conception of the “immaterial” Internet, and “datafication” of all aspects of life, how might we rethink the materiality and environmentality of media in our research? This upper-level seminar will introduce students to various theoretical frameworks in media studies including new materialism, media archaeology, studies of media infrastructures and ecologies, cultural geographies, and elemental media. Students are expected to critically assess the (geo)politics of material/environmental media and to adopt a mix of these frameworks to develop a research project and essay. Prerequisite: Junior standing OR What is New Media. Fulfillment: IMA/B Elective, Advanced IMA Elective.
This course investigates digital art and new media from creative, theoretical, and historical perspectives. We will examine the paradigm shift resulting from the rise of digital art and its expansion as well as explore current ideas, creative strategies, and issues surrounding digital media. The topics of study will include digital image, digital sound, net art, systems, robotics, telematics, data art, and virtual/augmented reality. The course provides students with the means to understand what digital media is, and establish their own vision of what it can become, from both a practical and a theoretical perspective. The course consists of lectures, field trips, and small studio-based practices. Prerequisite: None. Fulfillment: IMA/IMB Elective.
The aim of this course is to explore the relationship between the virtual self and environment and to assess both as a space for learning and collaboration using virtual reality. This course takes place entirely in virtual, immersive environments. Students will be provided Oculus Quest 2 virtual reality headsets and specialized software. See the principles above for further details. Prerequisite: IMA Major with junior or senior standing. Fulfillment: IMA/IMB Elective.
Web Page to Web Space is a course that explores virtual interactive experience in the context of Virtual Embodiment, Virtual Space, Telepresence, and Metaverse. Students will investigate new possible ways of using the Web to create new immersive environments in a web platform, by utilizing algorithmic 3D animation and server-side programming. This is an advanced course with technically challenging concepts with three.js and node.js and suitable for students with prior knowledge in visual programming. Prerequisite: Nature of Code or Machine Learning for New Interfaces or Critical Data and Visualization or ABC Browser Circus or Kinetic Interfaces or Machine Learning for Artists and Designers or Expanded Web or Movement Practices and Computing. Fulfillment: IMA/IMB Elective, Advanced IMA Elective.
Learning with Turtles explores programming languages, systems, and activities designed to help learners in computational environments. Starting from a constructionist principle that systems designed for beginners must be able to embody the most powerful ideas in computing, we master some of those systems, explore how those have been designed, and engage in contemporary debates. The environments we learn with include Turtle Geometry, Craft Computing withTextiles, Modelling, and other interactive projects using programming and modelling systems such as Snap!, TurtleArt, Turtlestitch and NetLogo. Individual and group projects involve students in advancing their computational knowledge and skills and provide opportunities to design for others, to teach, to study learning and expertise, and present projects in community and public forums. The course is fundamentally about ideas, and how some powerful ideas from computation can empower a learner to be a better creator and problem solver. Writing, presentations, and discussions will emphasize reflection on our own learning within the course. Prerequisite: None. Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
Welcome to the ABC Browser Circus (ABC), where acrobats juggle with hyperlinks, dance across scrolling grids, and jump through open server ports. This course introduces the students to the history of the internet, the World Wide Web, and specifically to the browser as a cultural object and its role in (net)art; in parallel, it teaches web development and guides the students to create three web-based projects. Theory and practice-based components are each conducted during one of two 75 minute classes per week. Prerequisite: Creative Coding Lab. Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
This course will be an introduction to studio art for students, to traverse both cultural and temporal barriers of visual arts. Students will examine the content of artwork, and build various skills to translate ideas into reality. Class time will be devoted to individual projects and critiques, lectures, and group discussions. This course is open to all students with or without an art background. Note that attendance in the first class meeting is mandatory, otherwise you will be dropped from the course. Prerequisite: None. Fulfillment: general elective
Painting is an incredibly versatile medium and its dynamic evolution across cultures and through millennia continues up until the present. The medium’s relevance and capacity for reinvention are evidenced in the work of a number of contemporary painters who have incorporated inventive materials and/or methods into their practice to both push its limits and explore contemporary concerns. In this class, students will get an introduction to the fundamental technical, formal, and conceptual principles of painting. Using watercolor, gouache, and acrylic, students will explore color theory, composition, texture, form, and surface using a wide range of techniques. Through selected readings, students will also examine the theoretical questions and historical precedents that have informed painting’s development, see how they relate to or have been challenged by the work of contemporary painters and be able to connect select concerns to their own practice. In addition to acquiring basic technical skills and conceptual know-how, students will also gain competency in art critiques and writing artist statements. Prerequisite: None. Fulfillment: general elective
This course aims to provide students with the means to understand immersive media experiences, and conduct experiments from both a practical and a theoretical perspective. The course consists of lectures, research, discussion and studio-based practice. Students will learn to produce stereoscopic – 3D images and photogrammetric 3D models, utilize multi-channel video and sound systems, and be introduced to the Unity game engine and VR hardware. For the final project, students produce VR environments in experimental and meaningful ways. Prerequisite: None. Fulfillment: IMA/IMB elective.
Electronic Textiles spans the worlds of craft, electronics, and computing. We will build skills in the often surprising world of using soft, stretchy or low tech materials where one might have expected hard, dimensionally stable, or high tech materials and vice versa. Weekly projects will have requirements for craftsmanship and design, and will build skills in integrating electronics and computing with soft items and wearables, making sensors and displays, tailoring and costuming, and creating your own materials. You will gain familiarity with materials and with hand and machine crafting skills. Weekly readings for discussion will be required, and presentations and guest speakers will offer you ideas and critical challenges. Pre-req: None. Fulfillment: IMA/B Elective
In this course we combine both analytic and embodied learning about human movement practices. We will learn selected computational and physical movement sensing techniques (webcam-based, wearable-based, and commercial motion capture technologies). We will combine guest and student-led presentations and activities that involve us in movement while learning structures and history of selected movement practices such as dance and circus arts. We will do four sprint projects of approximately one week in length (each semester projects differ, but may include examples such as PoseNet/MoveNet, Creating a Fitness Tracker, Rhythm Game, Non-humanoid MoCap avatars), alternating with work on a class choreographic project and individual research and writing of a paper on a movement practice. Prerequisite: Creative Coding Lab or equivalent programming experience. Fulfillment: IMA/B Elective.
An introductory course to machine learning aimed at a hands-on engagement and development of an intuitive understanding of related techniques and effects. The course uses the JavaScript language, and the ml5.js and p5.js frameworks to introduce the theory and application of machine learning algorithms. In exercises and assignments, students will experiment with building, using and critiquing machine learning models and datasets. Readings and discussions will cover relevant issues and frame the practice. This course builds on an existing practice of computer programming. Weekly assignments are required. Prerequisite: INTM-SHU 103 Creative Coding Lab Fulfillment: IMA/IMB elective.