Building an accessible smart guitar for the deaf, blind and mute
summary
A prototype smart guitar that teaches chords to blind, deaf and mute users and that actually works: voice or button input sends requests to Actions on Google / Dialogflow, backend on Firebase / Google Cloud returns chord instructions which the guitar plays as audio, shows on screen, vibrates a motor during network waits and raises a Braille pin array to spell frets; hardware runs on a Raspberry Pi with USB mic and speakers. Claims include support for multiple outputs and real-time feedback; built and tested as a working prototype.
AI-written summary · about
chapters (9)
- 0:00Start
- 3:26Making Google Maps Accessible for Wheelchair Users
- 5:02Physical Additions
- 7:19Autism
- 9:27Sensory Neural Hearing Loss
- 10:07Conductive Hearing Loss
- 10:20Vision Impairment
- 21:12Learn Chord Intent
- 24:42Network Requests
related talks
57mBuilding An Accessible Smart Guitar for the Deaf, Blind and Mute
36mCan you afford this? Tailoring Technology for Individuals
36mMaking Technology More Accessible with .NET and AI
22mBraille.js. Bringing together accessibility, JavaScript and IoT
20mHybrid-Brailler: Combining Physical and Gestural Interaction for Mobile Braille Input and Editing
31mA11Y IRL (Accessibility in real life)
53mAdapting Courses and Gamified Content for Blind and Low Vision Learners
17mTowards a Multisensory Augmented Reality Map for Blind and Low Vision People: a Participatory ...