Using mobile technology in live musical perfomance
summary
A working prototype maps Kinect-detected gestures to sounds on audience phones using JavaScript and Web Audio, with a distributed pub/sub model where a central router plus super clients hold performance state; connection uses a ryome-like server and an Airport Extreme that caps at 50 devices, so custom APs are needed for larger crowds. Phones use accelerometer gestures (DTW mentioned and a simple magnitude threshold) and the live demo mostly succeeds despite intermittent Wi‑Fi failures.
AI-written summary · about
chapters (6)
- 0:00Start
- 2:09Synesthesia
- 10:31Preview Performance
- 16:57Audience Engineering
- 19:45Dynamic Time Warping
- 21:08Live Demo
related talks
08mNo merge conflicts
18mResponsive Space. Liveness through spatial distribution of sound and image
16mA Symphony Of Sound, Gone Mobile
43mInteractive and Collaborative Art for the Mobile Web
47mHow live music is evolving in a post pandemic world
11mResponsive Space
02mImmaterial.Cloud
25mFour to the floor JavaScript