Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in ...
summary
Annexing Reality scans the room with an AR headset and depth sensor, extracts 3D primitives, and uses developer-specified haptic models (primitives, priorities, scale) plus a constraint solver to map virtual objects onto everyday things; implemented prototype with AR glasses and a depth camera and uses ICP for tracking. An 8-developer study (32 trials) shows perfect binary match classification but only 19/32 correct predictions of competing matches; ratings: primitives useful 4.5/5, predictability 3/5. Limits: only shape matching, no material recognition, occasional occlusion/collision and latency issues.
AI-written summary · about
chapters (10)
- 0:00Introduction and acknowledgments
- 1:14Limitations of current AR technology
- 2:24Exploring haptic feedback solutions
- 5:35Concept of annexing reality
- 7:01Haptic model generation process
- 9:11Object matching constraints
- 11:02System implementation overview
- 12:48Developer study results
- 16:00Practical examples and challenges
- 17:30Q&A session
related talks
42mHow to Augment Your Reality
29mExtend your reality with AR
16mLeaving the Reduced Reality and Into… AR, XR, VR?
43mBeyond The Printed Page
31mMerge Realities, Multiplay Wonder: Expert Guidance on Mixed Reality Development
21mBuilding Intuitive AR Experiences on VisionOS
59mThe Metaverse - Beyond the buzzword
10mReality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract Representations