WebRTC and Spatial Computing on Apple Vision Pro
summary
Describes porting WebRTC to Apple Vision Pro using Janus, shipping a VisionOS app and passing security certs day‑and‑date; implements VP9 at up to 36 Mbps streams, stereoscopic side‑by‑side and top‑bottom and 360/180 sky‑dome rendering, and per‑stream 5.1/7.1 Opus audio with channel mapping; replaces native pipelines with a custom video pipeline with Metal vertex/fragment shaders and a custom ADM for microphone/Persona support; demos work over modest bandwidth though quality and latency depend on available throughput.
AI-written summary · about
chapters (6)
- 0:00Introduction and background
- 3:13Why Vision Pro support
- 8:55Porting WebRTC challenges
- 12:07Spatial video and 3D support
- 17:46Demo of immersive streaming
- 28:56Q&A session
related talks
53mThe Application of Apple Vision Pro Spatial Computing in Social Aspects
45mGetting Started Developing for Apple Vision Pro with Unity
54mMe, Myself and eyeOS
47mHow I Learned to Stop Worrying and Embrace visionOS
58mAccessible Spatial Computing
39mThe use cases and practices of spatial computing in enterprises
32mWebRTC Update
21mBuilding Intuitive AR Experiences on VisionOS