Open Data Dashboards & Python Web Scraping
summary
Dashboard ingests and reshapes open data with Python and scrapers, using packages like openpyxl pandas BeautifulSoup and APIs (Fred), then visualizes in Tableau public and embeds on GitHub Pages. It automates repeated downloads so a two‑person team spends <10% time on data plumbing, pulls full histories to avoid revision shocks, and surfaces surprises — e.g. wages down 10% year‑over‑year before rebounding. Journalists embed charts, updates require a manual push to Tableau Public, and messy source quirks (misspelled District of Colombia) break scrapers.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 6:22Effective dashboard principles
- 16:42Python for scraping & dashboards
- 20:40Python scraping workflow
- 25:44Incremental scraping & revisions
- 26:05Demo: DC economic data
- 31:01Data blog & community
- 35:50D3 vs Tableau & future
- 37:35Open data publishing politics
related talks
51mWhat is a Data Desk?
33mData Science & Data Visualization in Python
41mDash: data exploration web apps in pure Python
22mGovernment dashboards and open data.
29mUsing Dash by Plotly for Interactive Visualisation of Crime Data
26mBuilding Dynamic Dashboards With Django and D3
32mDash: Interactive Data Visualization Web Apps with no Javascript
30mMeta-Dashboards: Accelerating Geospatial Web Apps Creation with Voilà