~/talk

Holoportation: Virtual 3D Teleportation in Real-time

on YouTube 27m
Talkat UIST 2016 · 2016-10-16..10-19· [webxr]

speakers

name:Sergio Orts-Escolano
links:none on file
name:Christoph Rhemann
links:none on file
name:Sean Fanello
links:none on file
name:David Kim
links:none on file
name:Adarsh Kowdle
github:adarshkowdle
name:Wayne Chang
links:none on file
name:Yury Degtyarev
links:none on file
name:Philip L Davidson
links:none on file
name:Sameh Khamis
links:none on file
name:Mingsong Dou
links:none on file
name:Vladimir Tankovich
links:none on file
name:Charles Loop
links:none on file
name:Qin Cai
links:none on file
name:Philip A Chou
links:none on file
name:Sarah Mennicken
links:none on file
name:Julien Valentin
links:none on file
name:Vivek Pradeep
links:none on file
name:Shenlong Wang
links:none on file
name:Sing Bing Kang
links:none on file
name:Pushmeet Kohli
github:PushmeetKohli-dev
name:Yuliya Lutchyn
links:none on file
name:Cem Keskin
links:none on file
name:Shahram Izadi
links:none on file

resources

video:https://youtu.be/KeuGwhv6yN4
slides:none on file

summary

End-to-end system reconstructs and streams full 3D scenes of people and objects in real time, delivering textured meshes at 30 fps from a capture rig of 24 cameras using custom depth sensors (two IR cameras + structured-light projector + RGB) and a random-forest depth regressor. A non-rigid temporal fusion with a deformation graph removes flicker, meshes compress from 23 Gbit/s raw to about 1 Gbit/s, and remote rendering plus image warping reduces latency for HoloLens/VR viewers. Works for hands and picked-up objects with minimal artifacts; limits include headset field-of-view, infrastructure weight, and compression budget.

AI-written summary · about

chapters (9)

  1. 0:00Introduction to holoportation
  2. 1:10History of virtual teleportation
  3. 4:23Why 3D human scanning is hard
  4. 8:35How holoportation works
  5. 10:25New depth camera technology
  6. 13:38Temporal reconstruction algorithm
  7. 16:49Mesh compression and streaming
  8. 18:47Current challenges in holoportation
  9. 22:21Q&A session

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.