Simple Data Engineering in python 3.5+ with Bonobo
summary
A compact Python 3.5+ ETL library for small scale pipelines that wires plain functions and generators into a transformation graph and runs them in threads, with execution stats and FIFO node semantics. Demonstrates importing DBpedia via SPARQL into PostgreSQL and a Django site, using SPARQLWrapper and simple services, deduplicating roughly 13,000 items → 9,000 persisted, creating many‑to‑many links, and serving paginated lists, all working end to end though without workflow dependency management.
AI-written summary · about
chapters (6)
related talks
45mWorkshop 3: Data Engineering - A Roadmap... by Ramon Perez [Part 3]
48mSemantic Python: Mastering Linked Data with Python
26mLife Beyond Pandas: Workflows with DuckDB, Daft, Polars, and Datafusion
29m"Serpents and Ducks: wrangling data with Python and DuckDB"
35mData Processing Pipelines for Small Big Data
29mSwiss Army Django: Small Footprint ETL
34mpydiverse pipedag: A library for data pipeline orchestration
19mSwiss Army Django: Small Footprint ETL