The ARpeggiator is a collaborative AR music-making application that works in Chrome on Android devices allowing multiple users to make music together in real-time by creating spherical notes in AR space.
zack lee
Description
The ARpeggiator is a collaborative augmented reality (AR) music-making application that works in Chrome on Android devices allowing multiple users to make music together in real-time by creating spherical notes in AR space.
App link: https://ar-peggiator.herokuapp.com/
The spherical notes created by users will be played in a loop while they are in the camera's view. The notes will be played in the order they are created. The vertical position of the note determines the pitch, and the distance between the note and the camera determines the velocity. Tilting the device along the x-axis controls the low-pass filter frequency, while the z-axis controls the decay of notes.
When another user joins, the notes created by other users will be visible to the newly joined user and they will also see each other's virtual phone in real-time in AR space. Since only the notes that are in the camera's view will be played, each user can play a different set of notes even though they are in the same AR space. This can generate interesting polyphonic/polyrhythmic patterns when two or more users share each other's audio or play together in the same physical space.
**Added: ** Now desktop users can see and hear existing users' performance in real-time
All these features make the app perfectly suitable for live performance as well as a collaborative musical experience.
The ARpeggiator was created with Node.js, Express, Three.js, WebXR, Socket.io, Pure Data, and Emscripten and it is open source on Github: https://github.com/cuinjune/ar-peggiator
