GameDays: Practice Thoughtful Chaos Engineering

on YouTube ↗45m

" summary

Covers a practical GameDay workflow using Gremlin with 3–5 experiments per session, starting small in staging and escalating to prod with defined abort conditions. Shows concrete findings: a DB outage returns 404 instead of 500, latency injections amplify across multiple reads, Kafka consumers reveal backpressure without monitoring, and container kills expose hidden coupling in orchestration. Explains scoping (blast radius, duration, percent of hosts) and how to iterate: hypothesize, run, fix, repeat.

AI-written summary · about

" chapters (50)

1. 0:00Introduction
2. 3:42Reality
3. 4:13Dependency
4. 6:31Your Engineering Chaos
5. 6:58Chaos Engineering Analogy
6. 7:17GameDays
7. 7:39Chaos Hackathon
8. 7:58Chaos Engineering Sounds Good
9. 8:10Marios Objective
10. 9:29Chaos Engineering Objective
11. 10:51Why Resilience Matters
12. 12:09Start Your Journey
13. 12:23Where Do I Begin
14. 12:59Challenge To Scale
15. 13:31Its Not Fun
16. 13:50Ambitious Goals
17. 14:44Start Easy
18. 14:55Start Small
19. 15:52Chaos Party
20. 17:22Party
21. 17:33Testing Fraud
22. 18:34Training Ground
23. 19:49GameDay Structure
24. 20:23Experiment Form
25. 20:48Ask Questions
26. 21:30Experiments
27. 22:52Scoping
28. 23:35Inject Latency
29. 24:15Lower Left
30. 24:28Upper Right
31. 25:02Other Factors
32. 25:45Smart People
33. 26:12World Cup
34. 27:14Perfect
35. 27:49The Key
36. 28:53Using the Right Tool
37. 29:22Tools
38. 29:42Commercial Tools
39. 29:57Observability
40. 31:39Passing and Feelings
41. 32:54Leveling Up
42. 33:55Not a OneandDone Event
43. 34:58Practice
44. 35:12Enterprise Companies
45. 35:43User Experience
46. 36:09Infrastructure
47. 37:11Training
48. 40:40Gameday Monitoring
49. 42:08Orchestrator
50. 43:47Outro

" related talks

• 29mThe Road to ReliabilityJulie Gunderson · Conf42 Chaos Engineering 2022
• 57mLearning to Love your Non-functionalsRuss Miles · GOTO Chicago 2018
• 20mKeynote: Finding the Joy in Chaos EngineeringAna Medina, Lenny Sharpe · KubeCon + CloudNativeCon North America 2019
• 29mPractical distributed systems: Building for the real world with chaos engineeringJames Burns · Full Stack Fest 2017
• 42mPlan for Unplanned Work: Game Days with Chaos EngineeringDaniel Afonso · Voxxed Days CERN 2026
• 47mChaos Engineering Bottom UpBart Szulc · Build Stuff 2020
• 46mEmbracing Collaborative Chaos: Chaos Days on Large PlatformsLyndsay Prewer · Agile India 2020
• 21mSelf-Service Chaos Engineering: Fitting Gremlin into Grubhub's DevOps CultureDoug Cambell · Chaos Conf 2020