Scale up your job satisfaction, not your software
summary
Presents concrete engineering practices to reduce wasted effort caused by lack of trust in data systems: define business requirements with real users, add lightweight anomaly detection (ML), implement ingestion checks and reconciliation against Google Analytics, and establish clear data contracts so downstream teams stop treating mismatches as bugs. Describes building dashboards and pipelines with automated validation, lineage and alerts to catch divergences early, and reports that these measures measurably reduce repeated debugging and manual fixes.
AI-written summary · about
chapters (6)
- 0:00Introduction and context
- 4:03Software architecture challenges
- 6:52Data processing and engineering
- 10:23Scaling software vs. satisfaction
- 15:12Alternative solutions and approaches
- 18:08Conclusion and key takeaways
related talks
41mProficiency + Creativity = Happy Data Practitioners
38mBuilding Effective Data Teams: Strategies for Success
46mData-Driven Transformation: Organizational Changes and Leadership Insights
29mGood habits for data engineers
29mBuilding successful data teams in the realities of 2023
33mManaging Stakeholders: The Key to Successful Data Science for Business
32mWhy every developer should be a data scientist
54mThe secret sauce of data science management