Flow-based programming made easy with PyF 2.0
summary
PyF 2.0 implements flow‑based pipelines by chaining Python generators so each component is an iterator; it’s a friendly fork of zflow with a network manager that builds graphs from dictionaries or XML, a plugin set of producers/adapters/consumers, and a visual drag‑and‑drop designer. Components can run in separate processes for scaling, services parse CSV/XML descriptors, examples show splitting, joining customer+invoice streams and a summarizer that emits totals, and the demo produces CSV and PDF outputs successfully.
AI-written summary · about
chapters (7)
- 0:00Data flow programming intro
- 2:15Generators in PyF
- 5:51PyF architecture
- 8:24Visual designer & plugins
- 10:34Visual interface demo
- 13:24Resources & closing
- 14:52Q&A
related talks
35mPyFlink: Building Flink applications with Python language
38mDistributed Workflows with Flowy
25mBuilding a Python Data Pipeline with Apache Flink
41mTalk Python To Me: Stream Processing in your favorite language with Beam on Flink
39mFunctional Programming in Python
28mYour Pipeline as a Function.
30mLightflow - A lightweight, distributed workflow system
47mPython on the Client Side Web