ITP Camp 2025 logo - click to go to home page.

EZ Code-free wireless communication (and how to incorporate your smartphone into your next interactive project)

Date: June 07, 2025 5:30-8pm


Session Leaders: Yonatan Rozin


Format: Hybrid (In-person with online access)


Tags: #Wireless #Networking #Communication #Multimedia #Live #Performance #Installation #TouchDesigner #MaxMSP #Ableton #Unity #Unreal #Arduino #ESP32 #OSC #HTTP #WiFi #Prototyping


This is going to be a DENSE survey workshop that combines 2 topics I feel everyone in the art/technology community needs to know about: wireless communication and embedded smartphones. Absolutely NO programming experience is required, all you need is your smartphone and a computer with a text/code editor and Node.js installed (bring these to the session).

Come learn how to create projects with multiple hardware or software components communicating wirelessly. No cord spaghetti, (mostly) no hassle. We'll be using Node-RED, one of my all-time favorite tools; a node-based, code-free, visual, accessible programming interface for creating event-driven networks. You'll learn how to create a simple and scalable network that most (if not all) of your favorite existing programs can communicate with.

Once we've created our networks, there's no better hardware to demonstrate them with than the smartphone you use every single day. Inside your smartphone is a suite of high-quality hardware waiting for you to tap into:

  • HD camera/microphone
  • HD display w/ touchscreen
  • Precise accelerometer/gyroscope/compass
  • WiFi/Bluetooth access
  • Long-lasting rechargeable battery
  • Sleek, compact enclosure

Prototyping with smartphones is a fantastic way to save time and money and reduce e-waste. You don't need to purchase separate components, wait for them to arrive, wire them up to an Arduino, program them from scratch, create an enclosure, worry about power, realize they don't work as well as you need, none of that. Any smartphone from the past decade+ will be a legitimate alternative for your next interactive project and include all of the hardware tools listed above.

With just a web browser, a WiFi network (internet access NOT required) and some code samples (provided), you'll learn how to use your smartphone as:

  • an embedded display or touchscreen in an interactive installation
  • a gestural controller in your next live performance
  • a custom interface with sliders, knobs, buttons, etc.
  • a compact and portable device for running a machine learning model (handpose, object detection, etc.)
  • a portable camera/microphone stream
  • an easily-distributed audience participation tool with any of the hardware access above

and then stream the data over your wireless network to TouchDesigner, Max/MSP, Ableton Unity, Unreal, etc. for real-time processing or to an Arduino to make some physical magic happen.

Session will consist of 2-3 hrs of hands-on demos and instruction and optional Q&A and brainstorming session. Come on by!

Stuff to bring:

  • Curiosity and an open mind
  • A computer with a text/code editor
    • Node.js installed (simply download and run the installer here!) - please come with Node installed beforehand to save time!
  • Any smartphone
  • (optional) Some creative software you like to use (TD, Max, Unreal, Ableton w/ M4L, etc.) or a WiFi-enabled microcontroller such as the Arduino Nano 33 Iot from the shop
  • No programming experience needed but familiarity with HTML and Javascript will be helpful