~/talk

Self-healing system for UI tests using ML

Talkat PyCon AU 2025 · 2025-09-12..09-16· [testing, machine-learning]
links:none on file
slides:none on file

A system is built around Python Playwright and pytest that wraps the page API with a self-healing locator which captures element fingerprints and, on timeout, generates alternatives (133 in an example) scored by a random forest classifier using 85 numerical features across six categories. Alternatives above a 0.5 confidence threshold are tried until one succeeds; successful and failed heals are logged. Demo shows pipelines recovering from broken selectors, model trained on synthetic data and slated to retrain on real events plus add notifications.

AI-written summary · about

  1. 0:00Introduction and background
  2. 2:11UI test fundamentals
  3. 6:00The UI testing problem
  4. 7:26Self-healing system flow
  5. 9:47Implementation details
  6. 12:32Interaction and fingerprinting
  7. 15:21Healing logic and ranking
  8. 18:56Machine learning model
  9. 21:44Feature engineering
  10. 28:18Practical demonstrations
  11. 29:47Future work and conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.