Stewarding Usability for Humanitarian OSS
summary
Case study of Bayanat (Syria Justice and Accountability Centre) uses a two‑year, funder‑mandated program of quarterly surveys and per‑feature tests to track seven concrete metrics: system usability score, net promoter score and a custom user security score among them. Ten organizations provide data; baseline user satisfaction is ~70% (target 75–85) and security scores 27.5 (target 30–35). Testing uncovers a clunky access‑control bulk‑update flow, a dashboard reports progress to funders, and the metrics framework is reusable and low‑cost once established.
AI-written summary · about
chapters (13)
- 0:00Introduction to usability metrics
- 1:09Humanitarian OSS usability importance
- 3:01Why measure usability systematically
- 5:11Data collection methods overview
- 6:14Case study: Bionaut project
- 6:58Selected usability metrics explained
- 9:27Quarterly survey and testing process
- 10:54Survey results and benchmarks
- 12:00User testing insights and improvements
- 13:06Stakeholder dashboard for funders
- 14:11Project size and accuracy considerations
- 15:14Budget and sustainability tips
- 15:36Q&A on funding and metrics
related talks
27mHealth Check-ups on OSS Software Projects: Managing Risks While Promoting (Re)use
33mInvolving Stakeholders in User Testing
56mUX research and Ethnographic design for humanitarian technology
17mSecure by Design: Usable Security Tooling
29mSecurity Audits in Action: Helping Improve Multiple LF Energy Projects
14mBaking a Security Community From Scratch
29mSystems Thinking Unlocked
33mRapid-Fire Stories of Creative Solutions to InfoSec Problems