~/talk

Exploring ChatGPT for Improved Observability

on YouTube 23m
Talkat Conf42 Observability 2023 · on Thursday, 2023-06-08· [ai-assisted-development, observability]

speaker

name:Gareth Emslie
linkedin:gareth-emslie

resources

video:https://youtu.be/EGxcQB92Zo0
slides:none on file

summary

Modern observability must handle hyperscaler fragility: 2022 Google maintenance causes 3h22m latency, March Traffic Director outage 2h35m, Azure East US2 ~12h and AWS us‑east power failure in July, driving high downtime costs (average $5,600/min in 2014, industry estimates up to ~$260,000/hour). Proposes using GPT-3.5 (175B params) for conversational UI, code generation, alert enrichment and intelligent problem remediation while warning of non‑determinism, prompt engineering needs, prompt‑injection risks, $20M+ training energy costs, and hyperscaler pushes (Azure $10B OpenAI, Google Gemini/Palm2, AWS CodeWhisperer).

AI-written summary · about

chapters (21)

  1. 0:00intro
  2. 0:21preface
  3. 0:31why do we care about observability?
  4. 0:51modern platforms are ephemeral
  5. 3:44cost of unexpected downtime has risen significantly
  6. 4:29todays observability challenges
  7. 5:21risk of it outages are set to grow even further in 2023
  8. 5:56modern observability solutions
  9. 6:53there is currently a lot of innovation occuring in ai, in particular llm's
  10. 8:02imitate brain-like functionality using deep neural networks
  11. 9:25dnn models are pre-trained from "the whole internet"
  12. 10:51chat gpt
  13. 11:52chat gpt is built on top of latest breakthroughs in language model design
  14. 13:05chat gpt ≠ skynet
  15. 14:58use cases of observability
  16. 15:56keep in mid that chat gpt's responses are non-deterministic
  17. 17:03chat gpt's informed decision making
  18. 18:08prompt engineering is a new discipline
  19. 20:48hyperscalers are investing heavily into gpt's
  20. 22:02so are large models a panacea?
  21. 22:55dynatrace - cloud done right

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.