Testing in Production
summary
Argues that running automated checks in production yields more accurate, faster tests and higher release confidence by separating deployment from release with feature flags (Split) and by using canary release rollouts and CI/CD. Describes two automation patterns: targeting test users vs overriding flags in tests (run three tests: flag-on, flag-off, neutral) and marking test traffic with an is_test flag or unique API header. Recommends Robot Framework, Jenkins/CircleCI schedulers and PagerDuty/Slack alerts; reports faster releases, fewer staging failures and increased developer velocity.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 3:36Problems with staging
- 4:59Testing in production
- 7:45Automating tests in prod
- 10:32Tools for testing in prod
- 12:00Overcoming fear of testing
- 13:25Benefits of testing in prod
- 14:49Summary and contact
