PAIR: Phone as an Augmented Immersive Reality Controller
summary
Prototype turns an off‑the‑shelf phone plus unmodified AR headset into a 6DOF controller by printing ArUco marker bezels on the phone, aligning ARKit pose to headset vision, and continuously realigning; Vicon validation over 35 gestures shows ArUco‑corrected error is significantly lower than ARKit‑only, but latency averages ~150 ms and fast motions increase drift. Demonstrated techniques include a 3D trackpad, catapult swipe, room‑scale Fruit Ninja and furniture palette with touch + spatial input.
AI-written summary · about
related talks
21mBuilding Intuitive AR Experiences on VisionOS
38mImagining entertainment in the back of every ride with AR/VR
16mPortal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality
42mHow to Augment Your Reality
44mDiscovering Augmented Reality with ARCore
01h 16mAugmented Reality For The Masses
14mHow to AR
09mAdvanced Augmented Reality interactions