Continuous Integration Testing

on YouTube ↗26m

" summary

Describes concrete CI patterns for high‑fidelity integration tests: build containers, provision an SUT, run curl/grep checks, then tear down. Compares four provisioning methods with tradeoffs — docker compose (fast, low fidelity), namespace-per-test on shared Kubernetes (good balance, recommended), self-destructing VM running single‑node k8s (perfect isolation, cheap but slower), and full cluster per test (best fidelity, slowest and costliest). Emphasizes speed, ephemerality, parallelism, and handling stateful DBs or sanitized prod data.

AI-written summary · about

" chapters (21)

1. 0:00Intro
2. 1:21Continuous All The Things! Good for business. Good for process. Good for people.
3. 1:37Before Continuous Integration (BCI)
4. 2:38Continuous Integration (CI)
5. 3:18Software Testing
6. 4:59Idealized Test Pyramid
7. 5:50Actual Test Pyramid
8. 6:34Integration tests are hard. Production runtimes != developer machines Cost
9. 6:57Microservices make it harder.
10. 11:47Integration Testing limits risk We can still do it - even on microservice applications. It's hard, but (potentially) worth it. Make informed risk analyses.
11. 12:18Provisioning Creating a System Under Test (SUT)
12. 15:21An example Kubernetes ("K85") microservice application
13. 16:23Integration test flow
14. 16:58Docker Compose
15. 17:55K8s Staging Cluster
16. 18:58Self-Destructing VM?
17. 20:11Technique 3: Self-destructing VM!
18. 20:50K8s cluster per test
19. 21:14Integration testing techniques
20. 24:01But Dave, what about... Lots of services? Stateful storage? PII?
21. 24:54Yes, we can (still) do integration testing

" related talks

• 31mContinuous Integration TestingDavid Stanke · DevOps Days Toronto 2019
• 28mContinuous Integration Testing: Fully Test your Microservices Application, Early and OftenDavid Stanke · DevOps World | Jenkins World 2019 San Francisco
• 45mRunning Tests in Continuous IntegrationSergey Pak · DelEx Conf 2018
• 30mContinuous Integration; Tips & TricksPaul Dragoonis · cdCon 2020
• 24mOrchestrating automation tests for Continuous testingManoj Kumar · HUSTEF 2022
• 01h 02mContinuous Integration: Tips & TricksPaul Dragoonis · PHP UK Conference 2023
• 37mUnderstanding the successes and the pain points of different testing strategiesBenjamin Bryant · GoLab 2023
• 43mEffective CI/CD for Large SystemsJosh Reed · Berlin Buzzwords 2022