Monitoring GenAI Applications
summary
Monocle is an open source Linux Foundation AI&Data project that instruments GenAI apps with OpenTelemetry‑compatible traces, offering Python and TypeScript libraries plus a VS Code extension that adds two lines to enable tracing. It recognizes LangChain, LlamaIndex and Google Agent SDK calls, logs prompts, responses, token counts, agent delegations and latencies, writes local JSON or exports to S3/OTLP, and ships an MCP server with analysis prompts — demo finds a token‑truncation bug with minimal code change.
AI-written summary · about
chapters (8)
- 0:00GenAI monitoring intro
- 1:30GenAI design patterns
- 3:58Monitoring GenAI challenges
- 7:04Project Monle intro
- 8:50Monle live demo
- 14:39Monle architecture & benefits
- 17:27Analyzing Monle traces
- 18:57Call to action & Q&A
related talks
23mMonitoring GenAI Applications
39mMonitoring Agentic Applications
31mDeep Dive To AI Agent Observability
27mKeynote: Tracing the Agent's Mind: Extending OpenTelemetry for Deep...
29mNon-Invasive AI Agent Observability With OBI
24mOpenTelemetry GenAI in Practice: What the Spec Says Vs. What You Actually See
16mWhat Did the AI Just Do?: Making LLMs Observable with Open Telemetry
18mWhat did AI just do? Making LLMs Observable with OpenTelemetry