~/talk

Designing a System for Chaos

Talkat DevConf 2019 · 2019-09-25..09-27· [devops-and-delivery, distributed-systems]
slides:none on file

Chaos engineering experiments on production-like failures to uncover real weaknesses: Netflix’s Simian Army (including Chaos Monkey and Chaos Kong) intentionally kills instances or zones, companies like Uber and Dropbox learned hard lessons, and tools such as Chaos Toolkit and Gremlin automate attacks. A typical test is to terminate DB master (Kubernetes pod) then probe for HTTP 200 and check logs; monitoring (uptime, system, user, service metrics) is mandatory. Start small—disable SSH or reboot a dev box—then fold tests into CI.

AI-written summary · about

  1. 0:00Introduction and speaker intro
  2. 1:13Complexity of modern systems
  3. 4:46Failures in distributed systems
  4. 6:54What is chaos engineering
  5. 9:51Injecting chaos into system layers
  6. 11:38Chaos engineering principles
  7. 13:47Types of monitoring for chaos
  8. 19:13Netflix and the Simian Army
  9. 25:11System failure inevitability
  10. 25:54Chaos Toolkit demo
  11. 28:48Gremlin tool overview
  12. 30:14Getting started with chaos
  13. 34:10Interactive chaos learning
  14. 35:36Chaos engineering resources
  15. 37:27Chaos in company culture
  16. 40:19Q&A and closing remarks
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.