~/talk

Mask || No Mask? Detect Masks with ml5.js

Talkat CascadiaJS 2021 · 2021-11-03..11-04· [javascript, machine-learning]
slides:none on file

Client-side image classifier built with ml5.js (MobileNet feature extractor) uses a webcam to collect labeled examples via two buttons, trains on roughly 20 images per class (author notes 20 worked for the demo but recommends 100+), displays training loss, then outputs mask / no mask labels with a confidence score. The model saves to the repo assets and plugs into a serverless Twilio Programmable Video room to run live; detection can fail for masks worn incorrectly and needs more data to improve.

AI-written summary · about

  1. 0:00Introduction and setup
  2. 1:26What is ml5.js?
  3. 3:59Supervised vs unsupervised learning
  4. 6:29Classification vs regression
  5. 8:14Getting started with Twilio
  6. 10:00Training the mask model
  7. 12:32Adding training images
  8. 14:01Using the trained model
  9. 15:25Testing edge cases
  10. 15:47Summary and resources
  11. 16:52Q&A session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.