Network Workflow Automation at Scale

on YouTube ↗18m

" summary

Meta describes a workflow platform that runs thousands of concurrent workflows and ~100,000 executions per month by composing reusable binary building blocks packaged as in-house FB packages and distributed via a torrent-based package system. A stateless decider and worker fleet interprets workflow graphs, executes user code in isolated Linux cgroups using POSIX process semantics, and stores a single atomic context for inputs/outputs; the system also integrates human tasks across chat/email and automates retries, timeouts, and escalation.

AI-written summary · about

" chapters (5)

1. 0:00Start
2. 0:24Meta's Network
3. 7:18Building Blocks
4. 8:57Workflows
5. 12:27Humans & Automation: Example

" related talks

• 25mNetwork Automation Tools & TechnologyCristian Sirbu · Network Automation Summit at Interop 2020
• 41mHow to Build a Network Automation Stack From The Ground UpDamien Garros · Network to Code Networking Summit at Interop 2019
• 20mPhysical Network Design at ScaleBrandon Premo, Richard Cziva · @Scale: Networking 2026
• 31mNetwork Automation Architecture: Platform vs Power ToolsDamien Garros · Network Automation Summit at Interop 2020
• 16mAutomatic Parallelization of Software Network FunctionsFrancisco Pereira, Fernando M. V. Ramos, Luis Pedrosa · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 31mWelcome & State of Network AutomationJason Edelman · Network Automation Summit at Interop 2020
• 58mPrinciples of Network AutomationKen Celenza, Jere Julian · Network to Code Networking Summit at Interop 2019
• 20mAnatomy of @Scale Machine Learning Network OperationsJim Julson · @Scale: Networking 2026