Duration: 14 Weeks
Dates: Fri
Interactive Telecommunications (Graduate)
4 credits – 14 Weeks
Generative machine learning models open new possibilities for creating images, videos, and text. This class explores the idea of how artists, designers and creators can use machine learning in their own design process. The goal of this class is to learn and understand some common machine learning techniques and use them to generate creative outputs. Students will learn to use pre-trained models, and train their own models in the cloud using Runway. For each week, we will discuss the history, theory, datasets, application of the machine learning models, and build experiments based on the model. In addition to Runway, we will be using JavaScript libraries like the p5.js, ml5.js, and TensorFlow.js, and software like Photoshop, Unity and Figma. Students are expected to have taken ICM (Introduction to Computational Media), or have equivalent programming experience with Python or JavaScript. A list of ML models we will be covering: Image generation: StylanGAN: https://github.com/NVlabs/stylegan BigGAN: https://github.com/ajbrock/BigGAN-PyTorch Style Transfer Fast-style-transfer: https://github.com/lengstrom/fast-style-transfer Arbitrary-Image-Stylization: https://github.com/tensorflow/magenta/tree/master/magenta/models/arbitrary_image_stylization Semantic Image Segmentation/Synthesis Deeplab: https://github.com/tensorflow/models/tree/master/research/deeplab Sapde-coco: https://github.com/NVlabs/SPADE Image-to-Image Translation: pix2pix: https://phillipi.github.io/pix2pix/ pix2pixHD: https://github.com/NVIDIA/pix2pixHD Text Generation LSTM gpt-2: https://github.com/openai/gpt-2
Interactive Telecommunications (Graduate)
2 credits – 6 Weeks
ITPG-GT 2054-000 (23367)01/31/2020 – 03/13/2020 Fri9:00 AM – 11:00 AM (Morning)at Brooklyn CampusInstructed by Shi, Yining
With Machine Learning models are getting smaller, and microcontrollers are getting more computing power, Machine Learning is moving towards edge devices. This class explores the idea of how machine learning algorithms can be used on microcontrollers along with sensor data to build Physical Computing projects. In this class, we will learn about TensorFlow Lite, a library that allows you to run machine learning algorithms on microcontrollers. We will talk about common machine learning algorithms and techniques and apply them to build hands-on interactive projects that enrich our daily lives. Students will learn to use pre-trained models, and re-train the models with sensor data. We are going to talk about Image Classification, Transfer Learning, Gesture and Speech Detection. For each topic, we will first discuss its history, theory, datasets, and applications, and then build simple experiments based on the topic. Prospective students are expected to have taken Introduction to Physical Computing and Introduction to Computational Media course, or have equivalent programming experience with Arduino and JavaScript.
Interactive Telecommunications (Graduate)
2 credits – 6 Weeks
ITPG-GT 2050-000 (22889)03/24/2020 – 05/05/2020 Tue6:00 PM – 9:00 PM (Evening)at Brooklyn CampusInstructed by Shi, Yining
For students joining IMA in Fall 2022 and beyond, our new program structure affects the categorization of courses on this site.
Classes listed in the “IMA Major Electives” categories refer to the old IMA program structure. If you’re under the new IMA program structure, these courses count as general IMA Electives for you. Your program structure is noted on your academic advising spreadsheet.
Students on the new program structure can search the Interchange for courses. If you’re looking for “IMA Major Distribution” courses, you'll find them listed here: