Understood: Real-Time Communication Support for Adults with ADHD Using Mixed Reality
summary
Understood is an MR system on HoloLens 2 that uses GPT-4 to provide real-time dialogue summaries, context-aware next-word suggestions, and topic-shift detection; interface uses minimalist, gaze-triggered panels and time-limited support. A within-subjects study with 10 adults with ADHD plus two clinicians shows high perceived usability and immediate symptom relief but no reduction in surface issue frequency, and reveals problems from LLM hallucinations, latency of suggestions, and risk of user over-reliance.
AI-written summary · about
chapters (7)
- 0:00Introduction to project
- 1:28Communication challenges in ADHD
- 3:42Design study findings and goals
- 5:52System features and workflow
- 7:18User study and evaluation results
- 10:28Limitations and future work
- 11:08Q&A session
related talks
22mAccessibility and Interaction in a World Beyond Screens
17mContext-Aware Online Adaptation of Mixed Reality Interfaces
20mChallenges in Mixed Reality
16mWalking with adaptive augmented reality workspaces: design and usage patterns
50mAdvanced Mixed Reality Development and Best Practices
13mReMap: Lowering the Barrier to Help-Seeking with Multimodal Search
18mOne Reality: Augmenting How the Physical World is Experienced by Combining Multiple Mixed ...
30mDesigning a Mixed Reality Game Experience to foster Social Initiation in Children with Autism