Video-Annotated Augmented Reality Assembly Tutorials
summary
System converts an unmodified 2D tutorial plus a 3D CAD model into interactive AR steps by computing an assembly graph, inferring disassembly in reverse, and animating parts with motion lines while overlaying cropped video labels for tool use and nonrigid actions. Implementation uses GrabCut, a CNN for initial 6DOF pose, histogram probability maps and per-part trackers with hand segmentation, and texture projection from video. A user study with a 34‑part car reports SUS score 87 and clear preference for the AR condition.
AI-written summary · about
chapters (10)
- 0:00Intro
- 0:31Videos/Augmented Reality (AR) Tutorials . Video tutorials
- 1:16Video-Annotated AR Assembly Tutorials
- 2:20Determining the Assembly Sequence Step 1 - Computing the Assembly Graph Step 2 - Extracting the Assembly Sequence • Step 3 - Generating Step-by-Step Animations
- 3:52Tracking & Removal Detection
- 6:46Sequence Refinement If multiple small parts block a large part, their order of removal is unknow → Additionally search for the user's hands and tools overlap area
- 7:52Video Label Extraction
- 8:54Video Label Placement
- 12:03Design Recommendations
- 12:57Future Work
related talks
41mComputer Vision for Remote AR
14mImaginateAR: AI-Assisted In-Situ Authoring in Augmented Reality
08mTraining for mechanics with Augmented Reality
01h 16mAugmented Reality For The Masses
09magentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents
44mDiscovering Augmented Reality with ARCore
48mRendering techniques for augmented reality and a look ahead at AR foundation
20mWorking with AR by Jayway (Main Stage)