Use Envoy + Knative to auto scale Java RPC micro service

on YouTube ↗25m

" summary

Shows a concrete pipeline: an Envoy extension for Dubbo/RSocket that emits frame-type counters, Prometheus scrapes those stats and uses irate -> custom metrics API to feed Kubernetes HPA. Demo sends 3,000 concurrent requests with hey, HPA detects a surge and scales pods from 1 to multiple replicas (observed 2 in demo, 4 in home tests). Knative path is rejected because Knative only supports HTTP; adapter metric values are noisy and require tuning.

AI-written summary · about

" chapters (8)

1. 0:00Introduction to RPC and envoy
2. 1:09Apache dubbo and reactive
3. 3:22RSocket communication models
4. 4:31Challenges in auto scaling
5. 7:14Monitoring with envoy
6. 9:44System architecture and HPA
7. 14:14Architecture demo and testing
8. 22:16Conclusion and Q&A

" related talks

• 52mEvent-Driven Autoscaling for Serverless JavaDaniel Oh · JCON Europe 2023
• 55mEvent-Driven Autoscaling for Serverless JavaDaniel Oh · Devnexus 2023
• 34mScale your microservices by MicroProfile Metrics on KubernetesKenji Kazumura · EclipseCon 2022
• 35mKEDA - Real Time And Serverless Scaling In KubernetesZbynek Roubalik, Jeff Hollan · KubeCon + CloudNativeCon North America 2022
• 56mEvent-driven autoscaling for Serverless JavaDaniel Oh · GeeCON 2023
• 40mScaling microservices with Message queues, .NET and KubernetesLewis Denham Parry · NDC London 2019
• 36mUsing Ambassador to Build Cloud-Native ApplicationsSteve Flanders · KubeCon + CloudNativeCon China 2019
• 37mKEDA: Unlocking Advanced Event-Driven Scaling for KubernetesZbynek Roubalik, Jorge Turrado · KubeCon + CloudNativeCon Europe 2025