Holographic video calling

on YouTube ↗12m

" summary

Claims that realistic 3D calls need lots more than a 2D stream — experiments using Kinect textures show H264 depth artifacts with floating points and black holes, depth compresses far worse than RGB, and posture reconstruction sometimes fails (segmentation bleed). Point cloud coding (PCC) exists but is not silicon-backed and standards and encoders are immature. Real-time stacks like WebRTC use GCC and retransmits, leaving capacity unused so holograms cost 2–3× bitrate and suffer higher latency and buffering.

AI-written summary · about

" chapters (9)

1. 0:00Introduction
2. 1:21Ideal setup
3. 1:50Practical setup
4. 2:40Highlevel components
5. 3:35Data streams
6. 4:24H264
7. 6:47ABR
8. 8:00Quality metrics
9. 10:14Bandwidth

" related talks

• 17mHolographic Video CallingNitin Garg · RTC @Scale 2022
• 40mHolographic Telepresence with HololensM. Förtsch, T. Endres · Codemotion Amsterdam 2018
• 27mHoloportation: Virtual 3D Teleportation in Real-timeAdarsh Kowdle, Pushmeet Kohli, Vivek Pradeep, David Kim, Sarah Mennicken, Sean Fanello, Shahram Izadi, Cem Keskin, Christoph Rhemann, Sergio Orts-Escolano, Wayne Chang, Yury Degtyarev, Philip L Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A Chou, Julien Valentin, Shenlong Wang, Sing Bing Kang, Yuliya Lutchyn · UIST 2016
• 10mRTC @Scale, Future RTC Experiences Session - Live Q&ANitin Garg, Paul Boustead, Justin Uberti, Rahul Gowda · RTC @Scale 2022
• 31mDeveloping VR Media TechnologyAndrew Scherkus · Demuxed 2016
• 32mThe Future is Here, It's Just Not Evenly Distributed... YetJesse McCulloch · DevConf 2019
• 41mComputer Vision for Remote ARFlora Tasse · CVPR 2020
• 41mRTC in the Metaverse @Scale Live PanelMike Arcuri, Sriram Srinivasan, Paul Boustead, Cullen Jennings · RTC @Scale 2022