~/talk

Explaining Machine Learning Models with LLMs

Talkat PyData NYC 2024 Β· 2024-11-06..11-08Β· [ai-assisted-development, machine-learning]
name:Avi Levin
links:none on file
slides:none on file

Claims that LLMs can explain both interpretable models and black boxes by taking model components, producing specific outputs, and finding real issues: uses GAM/EBM function-to-text conversion for modular interpretables and SHAP scatter plots for arbitrary models, sends per-feature plots plus dataset context (about 700 bike-rental samples) to an LLM, uses a chain-of-thought split with structured JSON outputs so the pipeline returns descriptions, highlighted anomalies, rules to check, notes on privacy/cost tradeoffs, and suggests how to validate results.

AI-written summary Β· about

  1. 0:00Introduction
  2. 3:00Why explainable AI is needed
  3. 6:01Challenges in explainable AI
  4. 7:08Talk to EBM and LLM summarization
  5. 10:00Shapley values and their role
  6. 12:53Generating scatter plots for features
  7. 14:02Sending plots to LLM for analysis
  8. 15:49Chain of reasoning for LLM accuracy
  9. 19:09Risks and limitations
  10. 22:05Optimizing cost and privacy
  11. 22:48Evaluating LLM explanations
  12. 24:23Improving metadata with LLMs
  13. 25:28Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark β€” the status bar button does the same
?
this help
esc
close this, then clear every filter β€” or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.