Effective Migration, Balancing Cost, and Performance
summary
Migrated Big Data Hadoop to Databricks and DWS, using lift‑and‑shift, replatforming, accelerators, spot instances, autoscaling and FinOps to cut waste and enforce compute and cluster policies; outcome is concrete: 10 petabytes moved, $8M/year saved and 28% performance gain on reported workloads. Examples include a Databricks sizing that hits about $35,000/month for 500 jobs, and tactical steps — inventory, governance, job scheduling, archive cold data — that are implemented and working.
AI-written summary · about
chapters (6)
- 0:00Cloud migration challenges
- 3:12Cost savings from migration
- 9:17Efficient migration strategies
- 12:29Code conversion and optimization
- 15:36Immediate cost reduction
- 19:09Case study and call to action
related talks
38mLessons Learned from the Migration to Apache Airflow
44mBreaking a Monolithic Devops
46mWhen the CFO Comes Knocking: Our Journey to a Cost Efficient Data Platform
42mScaling Data at Ovoko: The Succesful Strategy
35mScaling up to Big Data Devops for Data Science
57mCloud Adoption Patterns
31mModernizing a megascale database
44mAutomating a Big Data Platform with Jenkins