RTC @Scale, Future RTC Experiences Session - Live Q&A
summary
Current end-to-end target for audio and video latency is 150 to 250 ms target, though real public networks and holographic processing run higher today; spatial audio uses client-side rotation for instant head turns and server-side mixing with position updates in the ~100–300 ms range. Mesh codecs get examined: Draco 10–15x helps static geometry but fails for dynamic point clouds; zstd is rejected (<10x), HEVC lacks silicon support, and VPCC 30 s/frame reference encoding is impractical for real time.
AI-written summary · about
chapters (10)
- 0:00Future RTC experiences intro
- 0:45Latency for holographic calls
- 1:26Evaluating Draco compression
- 2:28Head tracking in spatial audio
- 3:32Realism vs intelligibility in audio
- 4:58Traditional RTC limits for social calls
- 6:24Latency for music jamming
- 7:28Hologram codec exploration
- 9:16Server-side mixing with fast changes
- 10:01Closing remarks
