Viago: Exploring Visual-Audio Modality Transitions for Social Media Consumption on the Go
summary
Viago is a background Android accessibility service that automates transitions between visual and audio modes for mobile task management while walking, built from a design probe with 10 participants and evaluated with 13 participants across 12 tasks in a simulated coffee-shop walk; it highlights frequent UI elements, uses a distinct voice and dimming for images, and caches high-risk actions until visual confirmation, enabling users to interleave modalities but revealing gesture learning issues and alignment errors; authors extract 5 design insights and 3 guidelines and suggest AI/contextual sensing for improvement.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 0:23Motivation and background
- 1:50Formative study and design probe
- 3:14Visual to audio transition demo
- 4:40Audio mode navigation
- 6:28Audio to visual transition
- 7:10User study findings
- 8:13Future improvements
- 9:34Conclusion and Q&A
related talks
13mVoice In, Visuals Out: The Agony and the Ecstasy
25mUX Challenges for Video Apps
10mTowards Context-aware Automatic Haptic Effect Generation for Home Theatre Environments
25mAlternative Smartphone Interactions based on Sensor Data
39mMobile Trends 2020 - Towards a Five-Star Mobile Experience
17mDesigning Visual Complexity for Dual-screen Media
19mInvestigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices
19mAn Eye For Design: Gaze Visualizations for Remote Collaborative Work