Cataloging the world's data for great good

on YouTube ↗36m

" summary

Our World in Data claims to catalog and republish global datasets with provenance and visualization metadata, keeping an internal MySQL catalog and publishing 1000+ datasets on GitHub with a goal of ~90% republication. COVID-19 work combines Johns Hopkins WHO and manual scraping (including 12 countries via Twitter and video extraction) into a daily reference dataset. The data model is an entity variable time value tuple across ~100,000 variables, served via a static JAMstack site and visualized with an open source Grapher tool.

AI-written summary · about

" chapters (7)

1. 0:00Start
2. 7:16Covid-19 data
3. 13:39namespace, dataset, entity, variable, timepoint, value
4. 17:21Architecture
5. 20:42Getting your hands on global data
6. 25:00Frictionless data
7. 28:40Closing thoughts

" related talks

• 44mData Journalism 1David Stanton · Open Source Bridge 2013
• 42mVisualizing COVID-19 DataAlex Pudlin · Data Con LA 2020
• 42mMeasuring Data FAIRness: Lessons From the NHS, ONS and IPCCAdam Milward · Big Data Conference Europe 2022
• 35mDesigning for Impact in Civic Data ScienceAndrew Therriault · PyData Fest Amsterdam 2020
• 43mBehind the Scenes at Gapminder: A Story about Data and VisualizationsJasper Heeffer · Øredev 2018
• 19mBig data in the service of reliable newsRadu Pop, Benjamin Dauvissat · Berlin Buzzwords 2023
• 47mHow to get Open Data into the Hands of ActivistsAslam Khan · GOTO Aarhus 2013
• 40mOpen Data Dashboards & Python Web ScrapingMarie Whittaker · PyData DC 2016