ProbUI: Generalising Touch Target Representations to Enable Declarative Gesture Definition for ...
summary
A framework called ProbUI turns static bounding boxes into declarative gesture specifications that automatically map to simple probabilistic models (HMMs with 2D Gaussian emissions) computed on-device. Developers write area-and-transition tokens (like L→R or bidirectional arcs), the system derives state means, covariances and transition matrices, and emits live probabilities. Implemented widgets include a play/pause button with slide-to-skip, a timeline slider, and an adaptive floating menu; evaluation reports developer feedback and a lab study showing usable adaptive layouts and probabilistic feedback.
AI-written summary · about
chapters (4)
related talks
23mWearables as Context for Guiard-abiding Bimanual Touch
37mMind-Reading with adaptive UIs
07mLightning talk from Andy Matuschak
01h 10mSmart responsive interface design patterns
18mUIs as Values
17mBeyond Components: Designing Generative UI for MCP Apps
46mBDUI — Pleasure or Pain?
43mNext Steps and New Patterns for GenUI