FaraPy: An Augmented Reality Feedback System for Facial Paralysis using Action Unit Intensity ...
summary
FaraPy is a mobile AR mirror-therapy system that uses a LW-FAU lightweight CNN to estimate left- and right-side facial action unit intensities in real time on a smartphone, applies AR filters and symmetry ratios, and logs progress. The model claims to outperform prior AU-intensity models on benchmarks and produces a new dataset with unilateral AU intensity labels. A remote user study (n=20) reports high satisfaction and preference over traditional mirrors, though no eye-tracking and limited sample/device control remain.
AI-written summary · about
chapters (4)
related talks
19mMore than a Feeling: The MiFace Framework for Defining Facial Communication Mappings
06mNeckFace: Continuously Tracking Full Facial Expressions on Neck-mounted Wearables
03mFoldiverse: Augmenting Paper Folding Physiotherapy for Children with Autism via Family-Centered M...
50mVoices of Change | Panel Discussion
57mApplied AI and Accessibility to Play Games in New Ways
10mNon-isomorphic Interaction Techniques for Controlling Avatar Facial Expressions in VR
06mTeaching American Sign Language in Mixed Reality
17mHow Cephable Applies On-Device AI to Accessibility