Automated testing with 400TB memory
summary
Claims that a CI system handles SAP HANA testing at scale using Python, with a fleet totaling 400TB main memory across many hosts and about 1,300 servers in the lab. Describes splitting eight‑hour jobs, a Python‑based queue/waiter and prioritizer, local caching that cuts weekly artifact traffic from 9PB to about 3PB, health checks and automatic rescheduling; the system runs and materially speeds developer feedback.
AI-written summary · about
chapters (26)
- 0:00Introduction
- 2:36Database Interface
- 3:32Testing
- 6:38Jenkins
- 8:46Hana
- 9:53Scaling domain
- 10:44Test run time
- 12:37Failed tests
- 13:58Test scheduling
- 15:29Beta
- 16:25Queues
- 16:59Python
- 17:29artifacts
- 19:03external dependencies
- 19:26noisy neighbor problem
- 19:50health check
- 20:19current infrastructure
- 20:43queue processor
- 21:09process overview
- 21:44message
- 23:07outlook
- 24:27questions
- 25:01provisioning
- 27:24test runner
- 27:43unit test
- 28:11Why so many tests
related talks
53mStandardize complex IT with ansible i.e. SAP HANA
29mHow to Build a Cluster to Run Hundreds of Thousands of High-CPU/High-MEM Jobs
34mAutomating infrastructure at SA Home Loans with Python (and friends)
40mScaling Python - Bank Edition
22mHow SAp Leverages Chef Automation
01h 08mPerformance testing in the cloud
57mLast- und Performancetests in der Cloud?!
44mTaking CI and automated testing seriously