Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations
summary
Markit is a Blender add-on that lets makers paint face-level annotations and add a printable tracker; eight non‑expert makers add two annotations in 275 seconds on average (SD=70). Talkit is a Python app that uses an RGB camera with a Chilitag tracker, a fingernail color sticker for fingertip detection and Pocket Sphinx for speech, runs on commodity devices and a MacBook, and eight blind participants find a named annotation in 7 seconds on average (SD=8).
AI-written summary · about
chapters (10)
- 0:00Introduction to Markit and Talkit
- 1:55Why augment 3D printed models
- 3:20Designing Talkit for blind users
- 6:34How Talkit works technically
- 8:02Evaluating Talkit with blind participants
- 11:38Introducing Markit for makers
- 13:22Using Markit to annotate models
- 14:48Evaluating Markit with makers
- 16:59Future improvements and research
- 18:29Summary and Q&A
related talks
20mNew User Interface - Part 1
12mMachine learning for Accessibility
10mTeethTap: Recognizing Discrete Teeth Gestures using Motion and Acoustic Sensing on an Earpiece
23mDesigning for Accessibility
45mBe My Eyes - Leveraging Generative AI to help the blind and visually impaired people
30mAccessibility sparks innovation: Democratize access to hearing devices
19mNew Tools for Old Problems
21mVizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World