Data Engineering for Social Good

on YouTube ↗19m

" summary

Kasna volunteer network The Good Data Institute has grown to about 150 volunteers and delivered 50+ projects and here presents a concrete case: One Tilt consolidates Google Forms/Google Sheets survey variants into a single dataset, runs NLP (keyword and bigram) in a Google Collab notebook, and visualizes results in Google Data Studio so cohorts and satisfaction can be tracked over time. Team chooses the free Google Workspace centered option tradeoff: occasional manual notebook runs but immediate actionable dashboards and low/no-cost maintainability.

AI-written summary · about

" chapters (12)

1. 0:00Data engineering for social good
2. 1:24Not-for-profits' data challenges
3. 3:10Data capability gap factors
4. 4:14GDI priorities for nonprofits
5. 5:39One Tilt case study
6. 8:54Survey data consolidation design
7. 10:18BigQuery for data processing
8. 12:27Google Colab notebooks option
9. 13:53BigQuery vs Colab decision
10. 14:57One Tilt solution impact
11. 15:19Engagement lessons
12. 16:26Q&A

" related talks

• 01h 01mData Con LA 2020 - Friday KeynotesPeter Zaitsev, Subash DSouza, Dimas Soeprapto, William Kehoe, Dr. Safiya Noble, Rebecca Ye, Dr. Jenny Rankin · Data Con LA 2020
• 20mSee and understand your dataGeraldine Zanolli · DevRelCon Earth 2020
• 14mCommunity Contributed Open Data in IndiaThejesh GN · IndiaFOSS 2.0
• 16mDo It For Yourself: Creating a data input platform using RHezi Buba · rstudio::conf(2022)
• 54mData engineering & DataOps: Ask Me AnythingLars Albertsson, Ellen Friedman · Berlin Buzzwords 2021
• 44mDemocratizing data with an internal data pipeline platformManoj Mahalingam · Scale By the Bay 2017
• 27mNavigating Data's Next Great ShiftDJ Patil, Daniel Francisco · Data @Scale 2024
• 32mData saves lives: The power of crowdsourcing in a pandemicShrey Jain · Big Data & AI Toronto 2020