Simple Data Processing Pipeline
summary
xfinda uses a small, practical pipeline that puts processing functions in files and configures runs with YAML mappings, letting analysts map old fields to new fields and chain functions by name. concrete helpers include clean_html to strip tags and extract_entities to create new fields. it targets diverse sources (Slack, knowledge bases, CRMs), claims to let non‑coders onboard customers without data science intervention, is on GitHub, and is used in production.
AI-written summary · about
related talks
26mOne Pipeline to Rule Them All: Unifying Multimodal and AI Data Processing with Daft
36mData pipelines engineering made simple with Scala
38mFrictionless Data Pipelines
49mData pipelines: building an efficient instrument to make custom workflow
32mBuilding Your First Data Pipelines
35mData Processing Pipelines for Small Big Data
42mBuilding a Data Driven Organization
23mWhat would the django of data pipelines look like? with Lisa Dusseault