Bringing back human interaction to a digital world
summary
Claims a single engine replaces depth sensors by combining two VGA cameras with IMU fusion to build real-time 3D maps, track position/orientation, and enable direct hand manipulation of virtual objects. Provides an SDK and demo headset integration (works with Unity, offloads rendering to GPU) while running tracking on about one CPU core on Snapdragon 800. Prototype glasses run roughly 3 hours battery in tests; demos show multi-user face-to-face interaction without active depth sensors.
AI-written summary · about
related talks
32mNext generation human character control
23mFuture of User Interaction: Mixed Reality, AI and IoT
17mLearnings & Challenges for the Integration of Touchless Interaction
17mEnabling AR Everywhere: An Overview of DAQRI Products
43mVirtual Reality; Past, Present and Future
17mFaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays
32mDesigning Beyond the Screen
23mParallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing