~/talk

Metrics Driven Machine Learning Development at Salesforce Einstein

Talkat QCon São Paulo 2019 · 2019-05-06..05-08· [machine-learning, observability]
links:none on file
slides:none on file

Covers how Salesforce Einstein’s automated ML pipeline (Einstein Prediction Builder) uses monitoring and alerting to make a black‑box AutoML system more diagnosable. Describes tracking data and modeling metrics at each pipeline stage to detect issues, raise production alerts, and drive development of new features in a data‑driven way.

AI-written summary · about

  1. 0:00Start
  2. 1:55Einstein Platform Machine Learning
  3. 5:23The Metrics Driven Approach to Model Development
  4. 25:37Experimentation with Label Leakage Detection
  5. 28:57Key Leamings from Modeling Experiments
  6. 31:40What Should We Track with Modeling Dashboards?
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.