~/talk

Taming AI Sprawl: Your First Look at the Envoy AI Gateway

on YouTube 15m
Talkat Virtual EnvoyCon 2025 · on Wednesday, 2025-10-15· [ai-assisted-development, security]

speakers

name:Anmol Krisnan Sacnaeva
links:none on file
name:Bnavisnya Vupla
links:none on file

resources

video:https://youtu.be/T9RX7cgeYKA
slides:none on file

summary

Envoy AI Gateway is an open-source CNCF control plane built on Kubernetes Gateway API and Envoy proxy that centralizes API keys, routing and telemetry; a working demo shows multi-model, multi-cloud routing to 15+ providers and self‑hosted models, an external processor sidecar that extracts model and header info, and rate‑limit checks backed by a datastore to enforce token‑based rate limiting. Observability includes per‑request token counts and time to first token, and deployed demos succeed with failover and routing policies.

AI-written summary · about

chapters (7)

  1. 0:00Introduction and agenda
  2. 1:11Challenges of AI sprawl
  3. 3:12Overview of Envoy AI gateway
  4. 5:20Architecture and components
  5. 7:37Technical deep dive
  6. 11:38Live demonstration
  7. 12:42Key takeaways and conclusion

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.