Supporting Rhythm Activities of Deaf Children using Music-Sensory-Substitution Systems
summary
MuSS-Bits++ is a wearable music-sensory-substitution system that converts sound to light and vibration and measures latency (about 30 ms delay at max volume). A controlled study with 11 deaf children finds no overall accuracy boost in rhythm discrimination or reproduction, though four individuals (three with prior instrument experience and one very young participant) show improvements and most report more confidence in vibration mode. A small in-the-wild classroom trial reports better tempo synchronization for drums but limited usefulness for guitar.
AI-written summary · about
chapters (5)
- 0:00Introduction and motivation
- 3:43Music Bits system overview
- 6:28User study with deaf children
- 9:34Field study insights and future work
- 13:10Q&A session
related talks
36mCan you afford this? Tailoring Technology for Individuals
06mInvestigating the Effect of Sensory Concurrency on Learning Haptic Spatiotemporal Signals
06mToward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
52mMultisensory Design: Accessibility as a Creative Practice for Designers
31mBuilding an accessible smart guitar for the deaf, blind and mute
06mAcoussist: An Acoustic Assisting Tool for People with Visual Impairments to Cross Uncontrolled ...
57mBuilding An Accessible Smart Guitar for the Deaf, Blind and Mute
06mTeaching American Sign Language in Mixed Reality