~/talk

Test Management Ninja

Talkat SeleniumConf Austin 2017 · 2017-04-04..04-06· [testing]
links:none on file
slides:none on file

A small internal tool called Test Management Ninja automates classification and reliability for about 150 tests (snapshot over 14 days), running each new test 40 runs and promoting it if pass rate exceeds a 90% threshold. Test results flow into an open source datastore called out where the tool excludes environmental and infra exceptions, computes reliability, and moves tests between buckets like smoke, regression and “tests under test,” creating tickets when flakiness requires human fixes.

AI-written summary · about

  1. 0:00Introduction
  2. 0:41Badly Written Tests
  3. 1:36Dependencies
  4. 2:18Lifecycle
  5. 3:50Design
  6. 5:02Test Output
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.