Breaking into Data Engineering
summary
Brings 10+ years consulting and 3+ years in data engineering, lands first data-engineer role in 2022 and rises to senior within two years; learns via Udacity Google scholarship, studies Python and SQL, practices on cloud free tiers, uses Databricks and Spark SQL and PySpark for pipelines, and adopts git and cloud certifications to get hired. Recommends monitoring, orchestration (move beyond cron when >10 pipelines), validate source data, pick one cloud, and reach out to target teams with concrete learning goals.
AI-written summary · about
chapters (5)
- 0:00Breaking into data engineering
- 10:58Why choose data engineering
- 13:04Skills tools mindset
- 20:32Getting hired growing
- 22:42Corporate acrobatics roles
related talks
45mData Engineering- The Fastest Growing Tech Job
29mExploring Tech Career in Data Analytics and Science
22mDataEngBytes 2023 - BRI-T1-06 - Yanir Seroussi
40mData Engineering in a Rapidly Changing World
25m"Data Engineering: The World Between Worlds"
51mPanel Debate: Rise Of The Data Engineer
23mData engineering team leads
38mThe Rise & Downfall of the Data Engineer REVISITED