In this special format studio class, students will investigate techniques and frameworks to challenge the socioeconomics of planned obsolescence. We will research, design, and develop projects that rethink our strained relationship with smartphones and re-imagine the future of “old” devices. This is a production-heavy, four-credit course, where students will contribute to original research, and develop projects that combine HCI, design, and critical theory. Prerequisites include an open mind, the drive to make, and graduate-level Physical Computing.
The use of digital technology in mental health treatment, recovery, support, and prevention is rapidly gaining acceptance. For instance: The FDA recently approved the VR therapeutic EaseVRx to treat pain. Researchers recently found that exposure to natural environments in VR can provide emotional well-being benefits for people who cannot access the outdoors. Strobing lights can be tuned to stimulate temporary harmonic brain wave patterns usually only found in people who have been meditating for decades. Apps which help you track your mood could facilitate gaining knowledge and awareness of one’s mood patterns and thus help maintain emotional well-being. ASMR videos are reported to be effective in inducing sleep for those susceptible to insomnia, and assuaging a range of symptoms, including those associated with depression, anxiety and panic attacks. This class will focus on the use of technology to activate any and all of our senses to aid in mindfulness and meditation, distraction therapy, body awareness and acceptance, and more, via the use of tools and techniques shown to have a direct impact on our physiology as well as supportive and accessible user experience design with broad applications in other areas. Prerequisite: Basic coding and physical computing About Brian Lobser: http://light.clinic
This course examines magazines as collaborative sites for artists and writers internationally, leading the way to a global, networked cultural sphere. We will consider periodicals as both commercial and artist-driven enterprises and as material objects to be studied through the lens of the history of photography, journalism, and design.
“What capabilities does computational media have for depicting and conveying the experience of our minds? In this course we will start out using 3D graphics to depict the conventional physical reality that appears before us. Then we will turn inward to reflect the multidimensional reality of our minds, using artificial neural networks. Finally we return to embodied interfaces connected with cloud networking and databases to share with other people. The class will operate at a conceptual level, inviting students’ empirical psychological and philosophical investigations of the nature of their experience and how to convey it with art and story. It will ask students to look critically at existing computational media’s tendencies to bore, divide or inflame its users. But this is also very much a coding class where students will prototype their own ideas for new media first with 3D graphics using the threejs library, and then with machine learning models like Stable Diffusion using Huggingface APIs or Colab notebooks and finally with networking and databases using Firebase or P5 Live Media. Students can substitute other coding tools but game engines will not work for this class. The coding is in javascript, with a possible touch of python, and is a natural sequel to Introduction to Computational Media.” Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)
Decentralization has become a buzzword in the technology space, and there is much more to decentralized technology than NFTs and cryptocurrency. In this course, we will examine the fundamental concepts of the existing internet infrastructure, work to define what decentralization means, learn about the “why” of decentralization, survey the landscape of decentralized, distributed, and p2p protocols, and develop decentralized applications. We learn about will examine the implementation of decentralized technology and throughout the course, we will look at different use cases of decentralization such as evading censorship, protecting privacy, and creating resilient applications. We will also consider ethical questions about the decentralization movement—how will it grow, who benefits from decentralization, and whether a decentralized internet is even a good solution at all. We will examine the underlying technologies that enable decentralization, as well as looking at the current implementations of decentralized protocols and apps built on top of decentralized protocols. Finally, we will touch on adjacent topics such as local networks, mesh networking, and p2p networks. While this course will cover a breadth of decentralized and self-hosted applications, we will steer away from decentralized financing and NFTs and instead focus on decentralized information sharing. The goal of the class is to challenge students to think critically about the future of the decentralized web and develop applications that leverage these technologies. Students with or without a background in networking are both highly encouraged to enroll.
How do we make things move, produce sounds, or maybe even emit light without batteries? Through this course, each student will design their own purely mechanical automaton. We will learn how to use simple materials and tools to hand prototype mechanisms in their early stages. CAD software will be used to refine the designs and then a series of traditional and digital fabrication tools (various wood shop tools, laser cutter, CNC, 3D printers, etc.) will be used to produce the final pieces. We will learn how to work iteratively in the shop through weekly exercises, and a midterm and final project.
Our users have senses that they use to perceive information in different ways. Some perceive best through sight, some through hearing, others through touch. Designers often prioritize visual information, excluding those who benefit from other sensory modalities. In this class, we’ll take a multisensory approach to design that makes interfaces more accessible to disabled and nondisabled users. Students will learn how to design for the senses (think tactile controls combined with atmospheric sounds and olfactory or taste experiences), while gaining an understanding of the assumptions we make about our users’ sensory preferences. Students should come with prior experience with physical computing and fabrication techniques and can expect to learn technical processes for the user research, usability testing, and iterative design of multisensory interfaces. Over the course of 14 weeks, students will design an interface for the 5 senses (sight, hearing, touch, taste, smell), culminating in one final project that includes at least 3 sensory modalities.
For centuries, food production practices such as permaculture fostered ecosystems intended to be sustainable and self-sufficient, while producing nutrient-dense food. Modern farming has introduced harmful monoculture practices proven to cause collateral destruction of biodiversity and seasonal harvesting, distancing us from our food ecosystems. The future of food can be regenerative or continue to contribute to massive health and environmental issues. How can we challenge ourselves to regain connection to our food system? How might we use innovation, personal prowess, design, and biotechnology to reimagine healthier ecosystems? This course examines the historical context of the food ecosystems and encourages students to identify with these systems that we (in urban settings) are disconnected with. Students will build a project around exploring innovative approaches to the future of food and our relationships with it. These projects will incorporate design, technology, science, and research elements.
A programming course where we’ll explore various techniques and solutions for tracking and sensing people or objects in space. Students will get familiar with the terminology and algorithms behind many sensing topics such as computer vision, depth cameras, positional tracking, and coordinate mapping. As these subjects are explored, we will also dig into communication, and how this information can be transmitted from one tool to another, for example using OSC, Spout/Syphon, MIDI, DMX/ArtNet. The goal being to use the right tool for the job and not limit ourselves to a particular piece of software.
This course introduces students to modalities for creating site-specific and immersive art and performance. Assignments will examine the work of artists who challenge the limitations of the physical, psychological and transactional spaces that have come to define conventional production models. Students will regularly receive prompts from which collaborative work will be workshopped, generated and presented. The sites and practices explored will de-center script/text as spine, institutional space as gathering place, linear storytelling as narrative, and separation between audience and artist as social contract. Through group performance projects and presentations, students will investigate how Site evokes Narrative and Event differently in brick & mortar, virtual, historic, liminal, dead, found, contested, democratized and community spaces. Our work will unpack the challenges and opportunities presented when we relinquish creative control of such unfixed elements as serendipity, impermanence, improvisation, audience agency, public space, weather, and pandemic.
“As game and interaction designers we create systems and choices that can either prey upon our psychological foibles or help us avoid decision pitfalls. It is our responsibility to understand how we decide, to consider the ethics of the systems we create and to practice designing systems in a purposeful manner. Game Design & The Psychology of Choice will provide interaction and game designers with an understanding of the factors that influence behavior and decision-making by looking at the intertwining of cognitive psychology and economics through the development of behavioral economics. These disciplines study behavior on the individual and group level, often revealing some of the why behind the rules of thumb and folk wisdom that game designers come to intuitively. But understanding the why—why we fall into decision traps; why certain tradeoffs tax our brain more than others; why we are overconfident about our abilities; why certain decisions make us uncomfortable—allows us to more purposefully apply our design craft, both in and out of games. Finally, as a class, we will take what we learn about how we think and create series of game experiences based around key cognitive science concepts. Assignments may include: •Mod a cognitive science experiment into a game or experience •Analyze and present a game through the lens of cognitive science and behavioral economics •Create game or experience based around a particular insight from cognitive science or behavioral economics”
“In this course, we will explore how to create narratives that leverage our lesser used senses like touch, taste and smell as well as lesser-known ones like space, time, balance and scale. We will dig into the history of experiential storytelling, starting from immersive theater and Smell-O-vision to cutting-edge haptics and mind-bending illusions of proprioception. To help center this back in practical applications, we will also explore how this evolving art is commonly used in exhibition design, experiential marketing and brick and mortar retail. The class will be a healthy mixture of game theory as well as experienced based learning (meaning there will be a couple field trips and multisensory VR projects to explore). A basic knowledge of game engines is ideal but not mandatory because we will be using predesigned templates in Unreal engine to be experienced and manipulated in real-time through virtual reality hardware.”
To be a VR creator, it’s not enough to learn the hard skills—it’s also our responsibility to prime ourselves for the human impact of our work. As a means to design VR that is both enjoyable and accountable, this class proposes we borrow design principles from Hedonomics, a branch of ergonomic science that facilitates pleasurable human-technology interaction. Through the Hedonomic Pyramid, we’re able to section our thinking off into regions (Safety, Function, Usability, Pleasure and Individuation) and map out industry-tested VR design guidance for each. The result is a hierarchical checklist of proven principles, specifications and practices—that promote a culture of inclusive and holistic design—built to serve as a quickstart guide to designing accountable VR interfaces and systems. This class, divided into units that represent each level of the Hedonomic pyramid, will unpack both technical and conceptual strategies for creating VR, from visual interface fidelity to avoiding locomotion cybersickness to designing safer social VR spaces.
Throughout history, musicians have channeled their creativity into outrageous fashion statements and invented personas: think MF DOOM, Sun Ra, Ghostface Killah, Daft Punk, Leikeli47 and Rammellzee. By embracing their alter egos in extreme and outlandish ways, artists have found their authentic creative voices. This course will introduce participants to the art of masquerade using their resourcefulness to create costumes from found materials, and performance as an exploration in creative expression using new media and technology. Students will be introduced to ideas surrounding abstract storytelling, experimental audio video production, and A/V performance using a combination of technical and hands-on approaches. This course requires CL: Hypercinema or equivalent experience. Prerequisite: CL: Hypercinema (ITPG-GT 2004)
“How can motion capture (MoCap) be used to archive, preserve, and share intangible heritage forms, such as performing arts, rituals, and other social practices and traditions? This course approaches motion capture through the lens of ethnography — drawing on techniques of observation, participation, and qualitative design research. This class will offer an overview of different motion capture technologies, such as 2D-3D pose estimation and depth mapping, with a practical focus on learning the OptiTrack system at ITP. We will start by covering the basics of OptiTrack and build up to other workflows and techniques used across animation, game design, and virtual production (e.g. OptiTrack to Unreal Engine or Unity).” Prerequisite: CL: Hypercinema (ITPG-GT 2004)
On Becoming is a two-part professional development course. Finding Your Artist Voice (part one) filters your fears and apprehensions so you can declare your creative process and practice courageously. The seven-week system will help you proclaim your artistic identity, theoretical underpinnings, and trajectory with clarity, precision, and commanding written language. Students will build personalized masterplans and workflows to facilitate measurable professional growth while learning to catalog and archive their work. Students will develop a working artist biography, artist statement, and fully documented work samples. For the final project, students will be supported in selecting and submitting a post-graduate fellowship, residency, grant, or open call!
As software projects become more complex, it becomes increasingly important to keep the code organized and manageable; otherwise, it becomes extremely difficult to implement new ideas, and the project is much more likely to be prone to mysterious and frustrating bugs. This course will demonstrate several approaches to organizing code for larger-scale projects, including how to write and name functions and classes, DRY (Don’t Repeat Yourself), pure functions, unit testing and Test-Driven Development (TDD), and why to avoid “magic numbers” and global variables. The focus of the course will be on JavaScript, using P5.js, but the principles will apply to most languages. We will be doing an ongoing, step-by-step, in-class refactor* of a complex sketch. We will also be using version control to track our changes every class. Students will be expected to complete weekly readings and assignments, and to refactor one of their previous projects, using the principles learned in this course. * Refactoring means rewriting the code, without any changes to how the program behaves. Students should have some programming experience prior to taking this course, and would ideally have an existing software project they would like to develop.
“What is the medium of memory? In this 14-week studio class, we will dig into this question through creative storytelling. Starting from a lens-based practice, this class will introduce traditional and bleeding-edge documentary methods to inform our own varied approaches to activating archival material. Through weekly “readings” (articles, podcasts, films), written reflections, and creative assignments, we’ll explore: • how technology has impacted our relationship to memory; • how visual interventions can can surface alternative narratives; • how to make under- and unrecorded histories visible, and call into question the power dynamics embedded in “official” records; and • how we might recast objects and sites of memory-keeping, like heirlooms, journals, and memorials, as a mode of engaged preservation. Mid-way through the course, students will identify either personal or collective histories to open up to their own individual creative reexamination, memorialization, or transformation––each producing a final project with the technology and approaches of their choosing that serves to answer the question we started with––what is the medium of memory?”
“This 2-pt course aims to provide students with the critical thinking and practical skills for creating effective and compelling interfaces. We will dissect what a compelling user experience is, apply proven research techniques for approaching and defining UX problems and apply design frameworks including mapping and testing techniques. The class format will include lectures, discussion, in-class design exercises and a final project. Week 1: what is UX Week 2: inclusive research methods Week 3: frameworks for defining a problem Week 4: understanding behavior and motivation Week 5: mapping flow and visual strategies, final project intro Week 6: testing methods and future UX Week 7: final projects”
Your web browser is a digital canvas for 21st-century artists. While being one of the most common mediums today, web space has infinite possibilities for new aesthetics. This course covers Three.js fundamentals, providing students with the skills and insights to create arts in web 3D. This course requires ICM or equivalent coding experience. Prerequisite: ICM / ICM: Media (ITPG-GT 2233 / ITPG-GT 2048)