SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ
summary
A hybrid system pairs a Surface tablet and pen tracked with motion markers to an AR headset so every tablet stroke becomes a 3D curve projected onto generated surfaces, letting users toggle filled surfaces for occlusion and shading. Canvases include planar patches and automatically fitted curved drawing canvases, workspaces map a canonical 1 m cube to arbitrary scale for zoomed editing, canvases snap to Hololens-detected planes, and a six‑artist study reports improved detail and precision.
AI-written summary · about
chapters (14)
- 0:00Introduction to SymbiosisSketch
- 1:13Why symbiosis between 2D and 3D
- 3:46Shortcomings of 3D sketching
- 6:14Complementary benefits of 2D sketching
- 7:16Mapping 2D strokes to 3D space
- 9:47Creating drawing canvases
- 11:35Scaling and workspace management
- 13:40Interacting with physical objects
- 14:46User study and feedback
- 16:54Future directions and conclusion
- 17:18Q&A: Texture and material
- 18:00Q&A: Drawing constraints
- 19:42Q&A: Surface proximity styles
- 20:26Closing remarks
related talks
07mScaffoldSketch: Accurate Industrial Design Drawing in VR
44mUX + Mixed Reality
14mCombining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance
17mDeveloping for the Hololens
19mMulti-device Storyboards for Cinematic Narratives in VR
10mSpatialstrates: Cross-Reality Collaboration through Spatial Hypermedia
26mDesigning in 3D Space, a practical Guide to Spatial Design
16mSceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing