~/talk

AIRe - AI Reliability Engineering

TalkinUkrainianat DevOps fwdays'24 conference · on Saturday, 2024-02-17· [machine-learning, devops-and-delivery, security]
links:none on file
slides:none on file

Argues that reliability for AI means applying SRE practices to models and pipelines rather than treating AI as an extra layer. Demonstrates concrete work: an AutoGPT demo and a custom Longchain agent running GPT‑4 Turbo Preview instrumented with OpenTelemetry and the Open Inference tracer feeding a Phoenix UI, producing traces and metrics for debugging. Presents adoption and production statistics (LM growth; “one in three” experimental models reaching production) and operational challenges—7500‑node Kubernetes at GPT‑3.5 scale, data‑poisoning and GDPR risk, and cost/latency tradeoffs.

AI-written summary · about

  1. 0:00Intro. Agenda
  2. 3:57Inspiration
  3. 6:58Numbers
  4. 8:00AI Current State
  5. 11:55AIRe Challenges
  6. 14:53AI Observability
  7. 26:44Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.