DevOps in a Data Warehouse: Inside Out
summary
A data-warehousing team at Sky Betting & Gaming moves DevOps in bottom-up: it scales from one squad to four, builds a Hadoop/ADUBA cluster, standardises Jenkins using Chef and Python, and open-sources tooling to copy and version-control Jenkins jobs. A platform of self-service Jenkins instances plus lifelike test environments and a one-week rotating Kanban responder for unplanned work lets four DevOps engineers clear backlog, deliver the platform and reduce incidents; container rollout and some AWS-to-datacentre connectivity remain work in progress.
AI-written summary · about
chapters (8)
- 0:00Intro
- 1:18Our Products
- 3:46Data Tribe 2014
- 6:26Datops Squad
- 10:40Devops - Three Ways
- 12:46Projects vs Products
- 17:58Devops - Four Types of Work
- 23:19Challenges
related talks
28mDevOps in a Data Warehouse: Inside Out
30mDevOps For Data Teams
30mA Devops Approach to Data: A Tale Through the Trenches in Search of a Cloud Data Revolution
30mWhat's It Like When DevOps Is Just Another Day at the Office?
44mBreaking a Monolithic Devops
42mData Driven DevOps
51mFrom DevOps for data to DataOps
30mDevOps to DataOps