Powering AI Capabilities with API Management
summary
Shows a concrete integration of Apache APISIX with the OpenAI API to secure and scale AI calls, using JWT auth, rate limiting, proxy caching to cut API calls and cost, and hot-reload plugins for zero‑downtime changes. A Java Spring Boot backend and Appsmith UI run in Docker Compose, with the gateway rewriting /askmeanything to /ai/chat. Demo uses gpt-3.5-turbo, claims ~95% correct generated code and ~50% developer productivity gain, and the whole setup works locally with a paid OpenAI key.
AI-written summary · about
chapters (8)
- 0:00AI and API management intro
- 2:10OpenAI API overview
- 8:13API Gateway for AI
- 12:49Securing AI APIs
- 16:22Live demo: AI app
- 26:29Demo architecture
- 31:25AI plugins: limits & future
- 32:12Q&A
related talks
22mLeading the future: AI and APIs, a powerful duo
26mAI in My API Gateway ... But Why?
31mAI APIs: Taming the Wild West with AI Gateways
28mWhy is API Gateway essential to business
22mBuilding Reliable APIs with Apache APISIX
30mAI APIs: Taming the Wild West with AI Gateways
01h 00mSpring AI
26mMocking and Deploying an AI Chatbot in Minutes