An attempt to better understand and participate in the communications revolution we are undergoing through an investigation of the nature and consequences of previous communications revolutions. Using readings ranging from Plato to Sontag to Kundera, the course will look closely at the history of spoken language, images, writing, printing, photography, film, radio and television. How were they understood? How were they initially used or misused? What were their effects upon social patterns, politics and thought? How did innovations occur? What can that tell us about the potential and potential influence of digital communication? Students will be asked to undertake innovative experiments of their own in forms of new media. Prerequisites: None
People use their bodies in the workplace whether they are dancers or athletes, managers or engineers. Physical wellbeing, social teamwork, and cognition may be affected by our movement practices. How do people use physicality and motion to think? What is the interaction between body, motion, place, and goals? We will explore these questions by building physical-computing-based systems that encourage us to bring movement into new times and places in daily life, that coach users and develop learning environments for movement practices, and that test our understanding of ways that we “think with the body”. In this course we will bring practices such as fitness, dance, sports, and martial arts into a series of interactive installations, movement learning projects, and workspace modifications built on computing, sensing and actuator technologies. In this course we will also explore these questions through review of existing creative projects in this area, readings, presentations, and knowledge-sharing sessions. Prerequisites: Creative Coding Lab, Interaction Lab or equivalent programming experience Fulfillment: IMA/IMB elective.
This class focuses on the curiosity behind the greatest discovery of electromagnetism. By replicating experiments both with magnetic and electrical fields, we will explore the major breakthroughs that enabled us to power up devices, connect people, and store information. During the course we will have seminar discussions analyzing texts that contextualize the lab experiments and we will work toward conclusions on the implications of these discoveries. We will analyze different perspectives that led to the development of theories about the electromagnetic field, radio waves transmissions, and the quantum properties of electrons. Students will propose their own creative experiments, linking their personal interests with how electrons behave. As part of their final project report, they will submit an essay describing the technical methodology, critical framework, and the results of their experiment. Throughout the course they will acquire a working knowledge of components like capacitors, lasers, antennae, and circuit prototyping tools. Prerequisites: None Fulfillment: CORE ED; IMA/IMB elective.
Data is at the heart of the increasing role technology has in our lives. Data collection and algorithmic processing are not only central to recent technical breakthroughs such as in AI and automation but have created new economic paradigms where data equals value and shape political approaches to power and control. Decisions based on algorithms affect society at large whether it’s changing the way we transport and distribute goods, or influencing the things we buy, the news we read or even the people we date. The world that algorithms see is data. For the average person, however, data is seldom more than an abstract idea. So what exactly is data? How is value extracted from it? And why should we care? How can we ethically balance the positive uses of data-driven systems with the threats they pose to discriminate and infringe basic human rights? This class seeks to untangle some of these issues practically and theoretically. Prerequisite: Creative Coding Lab or equivalent programming experience. Fulfillment: CORE AT; IMA/IMB elective.
Toys are not only for kids. Toys are part of our culture and an important medium to develop essential skills like creativity, problem-solving, and socialization. They can also be a great contribution in education, medicine, and business, and can improve the quality of life for children and adults alike. The emphasis in this class is on designing for play and entertainment. Students will be introduced to the underlying essential concepts in designing toys and they will create their own utilizing hand-making craft skills and new technologies. This course will equip the students with a basic knowledge about various design topics including: brainstorming, sketching, graphic design, concept development, basic mechanisms, 3D modeling, rendering, and rapid prototyping. This is a hands-on class and students are required to bring their imagination in addition to a willingness to experiment and explore creative solutions for class assignments. Prerequisites: Interaction lab / Communication lab Fulfillment: IMA/IMB elective.
Exhibition: Next class is an exploration and observation of the fields of exhibition design and museum studies. This class will explore how emerging and interactive technologies can be applied to museum and exhibition design to enhance visitors’ experiences. What is an exhibition in a museum of today and how should it be experienced? What is the role of a museum in contemporary society? How does it engage the audiences of tomorrow? The class discusses curatorial practices, various exhibition concepts and forms, museum visitor experience, and exhibitions’ social values. Students will visit and immerse themselves in many museums and exhibitions as a professional observer who will be asked to write reflections of their observations as an essay for each museum visit. Students will choose a research topic at the beginning of the class and they will start collecting materials, building objects, designing experiences, and writing a statement for their final exhibition based on this topic. Students’ design work will be frequently reviewed and given feedback by the instructor, classmates, and guest speakers/critics. After the midterm, the instructor will initiate a collaboration with a local museum or art space. Based on the specific circumstances, students will face a design challenge to propose an exhibition proposal or provide a creative solution to the partner organization. By the end of the course, students will install and present their work as a group art show in the student art gallery. Prerequisites: Interaction Lab or Creative Coding Lab Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
Application Lab is an intensive project-driven course where students explore current challenges and opportunities at the intersections of emerging media and innovation through the lenses of design, prototyping and innovation. The course seeks to help students understand how these high-level concepts intersect with skills to form the basis for new applications of technology and human industrial art. At the end of this course, students will be able to think critically and holistically about not only what makes innovations possible but will also how to utilize emerging media technologies and ideas to bring innovations into the world that respect and acknowledge the values of design, iteration and innovation. Prerequisite: None. Fulfillment: IMA Major Other Foundation/Electives; IMB Major Emerging Media Foundation/ Interactive Media Elective.
Virtual Reality and Augmented Reality represent, respectively, visions of “being” somewhere else or augmenting your present environment. These visions are not new, but new technologies have made it possible to produce experiences unlike anything before, particularly through the use of headsets, spatial audio, touch sensors, and custom location-based installations. These new technologies are becoming small, powerful, and inexpensive, and as a result we are witnessing the birth of a powerful new medium, new art form, and new industry – all very quickly. The speed of VR and AR growth has created both opportunity and confusion. “VR / AR Fundamentals” takes a long, deep perspective. We will overview such basic elements as audiovisual resolution and fidelity; spatiality and immersion; other senses such as touch, smell, taste (and even mind); input and interactivity; and live and social. We’ll look at distinctions such as cinema versus games, movies versus models, public versus personal, real world versus fantasy worlds, linear versus interactive, and narrative versus ambient. These elements and distinctions will be presented partially as technical but in an understandable way for general liberal arts students, and will rely heavily on experiencing content and keeping up with current events. That’s the first half-semester. The second half-semester we’ll concentrate on collectively producing a series of timely and relevant projects, all short, entertaining, and useful to others exploring the world of VR / AR. Prerequisites: None Fulfillment: IMA Major Electives; IMB Major Interactive Media Elective.
User experience design (UXD, UED, or XD) is the process of enhancing user satisfaction with a product by improving its usability, accessibility, and desirability provided throughout the user’s interaction with a product. The class is designed for those who are passionate about creating user-centered experiences with interactive media. Students are encouraged to empathize with users, engaging them to make informed design choices from prototype right through to project completion. Prerequisites: None Fulfillment: IMA/IMB elective.
In this foundation course students will be asked to think beyond the conventional forms of human computer interaction (i.e. the keyboard and mouse) to develop interfaces that consider the entire human body, the body’s capacity for gesture, as well as the relationship between the body and its environment. Students will learn the fundamentals of electronics and programming as they build projects using the Arduino microcontroller platform. Arduino is a small computer based on open source hardware and software. When used in conjunction with various sensors and actuators, Arduino is capable of gathering information about and acting upon the physical world. In addition to these physical computing techniques, students will also learn to harness the methods of traditional computation. The fundamentals of programming will be explored using the Processing programming language. Processing has a simplified syntax and an approachable computer graphics programming model, making it an ideal platform for first-time programmers. Students will gain a deeper appreciation of the expressive possibilities of computation as they learn to author their own software and systems and not simply use off-the-shelf solutions. Additional topics will include algorithmic drawing and animation techniques, digital modeling and fabrication, data exchange, manipulation, and presentation, as well as control of images, audio and video, including computer vision techniques. Structured weekly exercises are aimed at building specific skills, however students are free to pursue their own diverse interests in their midterm and final projects. Prerequisite: None. Fulfillment: CORE AT; IMA Major Other Foundation; IMB Major Emerging Media Foundation.
In this foundation course students will explore the possibilities of emerging media by successively producing projects that make use of digital images, graphics, audio, and video. The course is designed to provide students with a framework to effectively communicate and tell stories through digital means. Students learn through hands-on experimentation in a laboratory context and the principles of interpersonal communication, media theory, and human factors will be introduced in readings and investigated through discussion. Adobe Creative Cloud and other relevant software applications will be examined to establish a diverse digital toolkit. Both traditional and experimental outputs will be explored. Weekly assignments, group and independent projects, as well as documentation of projects will be assigned in each of the core areas of study. Prerequisite: None. Fulfillment: IMA Major Other Foundation; IMB Major Emerging Media Foundation.
An introductory course designed to provide students with hands-on experience developing creative coding projects with machine learning. The history, theory, and application of machine learning algorithms and related datasets are explored in a laboratory context of experimentation and discussion. Examples and exercises will be demonstrated in JavaScript using the p5.js, ml5.js, and TensorFlow.js libraries. In addition, students will learn to work with open source pre-trained models in the cloud using Runway. Principles of data collection and ethics are introduced. Weekly assignments, team and independent projects, and project reports are required.
Rules of play shape competitive games from checkers to football. But how do the rules of interaction shape non-competitive play? In this course, we will explore, code and test design strategies for playful group interactions while at the same time interrogating both what it means to play and how individual identities and group behaviors. Some of the questions we will ask and attempt to answer: What motivates participation? What hinders it? When does participation become oppressive? What’s the difference between self-consciousness and self-awareness? Who has power? Who doesn’t? Are leaders necessary? What’s the difference between taking turns and engaging in conversation? What happens when the slowest person sets the pace? Interaction inputs we will play with will include: mouse, keyboard, mobile device sensors, and microphone. Outputs will include, visuals, text and sound. We will use p5, websockets and node.js for real-time interaction. Class time will be split between playing with and critiquing examples and translating design strategies into code and logic.
This class aims to provide students with the critical thinking and practical skills to explore and communicate ideas visually. This foundational course will introduce the fundamental principles of design including typography, color, composition, branding and environmental design, and offer hands-on application of those principles through both in-class exercises and weekly assignments. The structure of the class is part lecture and learning of concepts, but also very hands-on with a weekly workshop studio session (the weekend class). We will use Adobe software and students can expect to spend $150 on consumable art supplies which they will use to craft their design projects.
Whether it’s through photo realistic scans found in current-gen video games or the cartoonish and low-fi aesthetic of Bitmoji there is no limit to ways in which the body and the self are represented in digital spaces. This 2-credit class will look at how avatars have been historically used in the realm of art, commerce, and entertainment and utilize existing avatar creation tools to develop projects that examine identity, body politics, and contemporary performance. In class, we will cover the basics of Unreal Engine, photogrammetry, 3D scanning, and model rigging although students will be encouraged to use existing skill sets and creative thinking to complete some of the smaller week-by-week assignments. The class will culminate with a short performance, small installation or single/multi-channel video piece using one or more of the techniques covered in class. This can be a solo project or a group project. In this class students will: – Explore how avatars can be utilized in your creative practice – Gain an introductory understanding of Unreal Engine, photogrammetry, model rigging, and 3D scanning. – Learn how to recontextualize digital spaces for the purposes of art, installation, and performance. – Broaden your thinking of what performance can be, both in a physical setting and digital setting. – Think critically about how physical bodies inhabit digital spaces and how the hardware and software we use reinforces the acceptance and value of certain kinds of bodies.
3D environments and objects are powerful prototyping tools. This class will introduce the basics of 3D modeling techniques in Rhino and students will learn to create assets for prototyping and 3D printing. The class will take an industrial design approach to design and build with specifications and materials in mind. Students will learn to think, plan, design, and produce well thought out objects to fit their specific needs. (examples: motor mounts, enclosures, wearables etc.)
This course combines two powerful areas of technology that will enable you to leap from being just a user of technology to becoming a creator with it: Physical Computing and Programming. The course begins with Physical Computing, which allows you to break free from both the limitations of mouse, keyboard & monitor interfaces and stationary locations at home or the office. We begin by exploring the expressive capabilities of the human body and how we experience our physical environment. The platform for the class is a microcontroller (Arduino brand), a very small inexpensive single-chip computer that can be embedded anywhere and sense and make things happen in the physical world. The core technical concepts include digital, analog and serial input and output. The second portion of the course focuses on fundamentals of computer programming (variables, conditionals, iteration, functions & objects) as well as more advanced techniques such as data parsing, image processing, networking, computer vision. The Javascript ‘p5’ programming environment is the primary vehicle. P5 is more oriented towards visual displays on desktops, laptops, tablets or smartphones but can also connect back to the physical sensor & actuators from the first part of the class. The course is designed for computer programming novices but the project-centered pedagogy will allow more experienced programmers the opportunity to go further with their project ideas and collaborate with other students. What can computation add to human communication? You will gain a deeper understanding of the possibilities of computation–– possibilities that will augment and enhance the perspectives, abilities and knowledge you bring from your field of study (e.g. art, design, humanities, sciences, engineering). At first it may feel foreign, as foreign as learning a new language or way of thinking. But soon, once you get some basic skills under your belt, you’ll be able to make projects that reflect your own interests and passions.
Physical Computing is an approach to learning how humans communicate through computers that starts by considering how humans express themselves physically. In this course, we take the human body as a given, and attempt to design computing applications within the limits of its expression. To realize this goal, you’ll learn how a computer converts the changes in energy given off by our bodies (in the form of sound, light, motion, and other forms) into changing electronic signals that it can read and interpret. You’ll learn about the sensors that do this, and about simple computers called microcontrollers that read sensors and convert their output into data. In the other direction you will learn how to actual physical things in the world with devices like speakers, lights and motors. Finally, you’ll learn how microcontrollers communicate with other computers. To learn this, you’ll watch people and build devices. You will spend a lot of time building circuits, soldering, writing programs, building structures to hold sensors and controls, and figuring out how best to make all of these things relate to a person’s body.
An introductory course designed to provide students with hands-on experience using various technologies including time based media, video production, digital imaging, audio, video and animation. The forms and uses of new communications technologies are explored in a laboratory context of experimentation and discussion. The technologies are examined as tools that can be employed in a variety of situations and experiences. Principles of interpersonal communications, media theory, and human factors are introduced. Weekly assignments, team and independent projects, and project reports are required.