Nonvisual Interaction Techniques at the Keyboard Surface
summary
SPRITEs reimagines the keyboard as a pixelated 2D surface that maps HTML regions to keyboard edges and uses edge “homing” regions for menus, scrolling and table navigation, with modal switching to the screen reader. Implementation parses Wikipedia‑style HTML, tags elements, projects cells and search results onto keys, and supports bimanual proprioceptive navigation. In a 10‑participant study nine of ten could complete spatial tasks with SPRITEs versus three of ten with their usual screen reader — three times as many participants — showing clear gains for spatial layout tasks.
AI-written summary · about
chapters (10)
- 0:00Introduction to nonvisual techniques
- 2:14Limitations of auditory interfaces
- 4:23Introducing Sprites concept
- 6:09Demo of keyboard interaction
- 9:30Menu and list navigation
- 10:54Table interaction with Sprites
- 13:18User study setup
- 14:24Study results and findings
- 16:51Future work and deployment
- 17:32Q&A session
related talks
50mBuilding A11y & Inclusion into Interactive Science Simulations
31mThree Cheers for Keyboard Accessibility
45mIs Your Site Keyboard Accessible?
25mLove Thy Keyboard
28mYou're only supposed to blow the bloody doors off!
46mExclusive design
12mIt’s skeuomorphin’ time!! The enduring physicality of braille!
50mHijacking Screenreaders with CSS