DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented Reality
summary
DepthLab is an open-source library that turns ARCore depth-from-motion maps (depth-16, usable to ~8 m, best 0.5–5 m) into three realtime primitives—depth array (CPU 160×120+), depth mesh (GPU-displaced tessellated quad) and depth texture—and supplies APIs for occlusion, relighting, physics colliders (mesh cooking on CPU only when objects are thrown), wide-aperture focus, and particle hits. Benchmarks hit >100 FPS for a demo; relighting needs ~4–8 samples per ray on Pixel 3 and aperture kernels of 11–21 for realtime use.
AI-written summary · about
chapters (6)
related talks
12mIncrease AR realism and precision with Depth API
43mInto the Deep – or what would the 80s have done with depth sensing technology?
31mARCore
18mDeep-dive on ARCore | Fundamentals of designing AR apps with machine learning models
37mMobiconf 2018: Tobias Due Munk, Developmunk
37mExploring Augmented Reality with ARCore
14mHow to AR
01h 16mAugmented Reality For The Masses