Distributed Tracing is Awesome, Testing is Not... Until Now

on YouTube ↗16m

" summary

Distributed traces become test assertions: instrumentation with openTelemetry sends spans to a central collector (Tempo) and Grafana for inspection, while Trace test polls for an embedded parent span ID and asserts on spans (for example “import span must not contain an exception”). The system is open source (MIT), has ~12 integrations, a server+UI+CLI that exports JUnit, handles delayed traces via configurable polling and sampling via collector rules, and a SaaS option is planned.

AI-written summary · about

" chapters (14)

1. 0:00Introduction
2. 1:02Why tracing is awesome
3. 2:03Testing tools gap today
4. 3:27OpenTelemetry and Grafana
5. 4:09Trace-based assertions
6. 5:34Demo: Pokemon import failure
7. 7:00Fixing with Trace Test
8. 8:25Trace testing advantages
9. 9:07Q&A: Trace delays and sampling
10. 11:36Q&A: Trace sources and integrations
11. 12:17Q&A: Dynamic tests and data
12. 12:58Q&A: Exporting test results
13. 13:41Q&A: YAML vs UI
14. 14:46Q&A: Trace Test license

" related talks

• 22mDistributed TracingHungai Kevin Amuhinda · GopherCon Europe 2019
• 30mTesting in A Distributed Systems WorldFernando Mayo · Observability Practitioners Summit 2019
• 32mDistributed Tracing in Action: Our Journey with OpenTelemetryChris Detsicas · SREcon25 Americas
• 29mIntroduction to Distributed TracingSuraj Sidh · Kubernetes Community Days Bengaluru 2023
• 57mDistributed Tracing: How the Pros Debug Concurrent and Distributed SystemsAaron Stannard · NDC London 2019
• 01h 28mUnderstanding Distributed Systems with OpenTelemetryLiz Fong Jones, Austin Parker · All Things Open 2020
• 49mDistributed Tracing: How the Pros Debug Concurrent and Distributed SystemsAaron Stannard · QCon São Paulo 2018
• 57mYour Distributed System is Talking to You: OpenTelemetryJessica Kerr · Philly ETE 2023