Network Fault Finding System: Packet Loss Triangulation
summary
An open source proof of concept called ffs actively maps ECMP paths with double traceroute and runs UDP iperf link quality tests from distributed pinger agents to a master that runs a simple triangulation algorithm. A lab demo injects loss by toggling an ACL on the core1–spine3 link, collects JSON results from multiple paths, and identifies the problematic 1‑3‑1 path with measured packet loss so automation can remove the bad interface.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:02Context
- 10:42Active probing
- 11:08Requirements
- 13:04Building Blocks
- 14:19Master
- 15:44Workflow
- 18:40Demo
- 28:26Outro
related talks
32mActive Fault Finding in Networks
22m007: Democratically Finding the Cause of Packet Drops
26mF10: A Fault-Tolerant Engineered Network
24mHarp: Improving VPC Network Availability via Efficient Failure Detection and Rerouting...
23mNetBouncer: Active Device and Link Failure Localization in Data Center Networks
36mNetwork Machinery: A United-Front for Network Troubleshooting with CRDs
16mFLB: Fine-grained Load Balancing for Lossless Datacenter Networks
46mLessons learned from monitoring a large production network