The Era of AAP: Ai Augmented Programming using only Java
summary
Shows a full-Java inference stack that runs LLMs without Python, with a single-file llama3.java implementation and a Swing IntelliJ plugin Devoxx Genie (≈9,000 downloads) that chains local and cloud models. Demonstrates local Llama 3.1/Qwen and cloud Claude and Gemini, cites Claude ~200k-token and Gemini 2M-token contexts, and claims native-image preloading drops time-to-first-token to about 1 ms while typical project scans hit ~140k tokens; privacy and on‑prem sharding options are explored.
AI-written summary · about
chapters (10)
- 0:00AI-augmented programming intro
- 1:07Local vs cloud LLM providers
- 8:36AI will not replace jobs but developers using AI will
- 11:05Devoxx Genie IntelliJ plugin
- 18:31Pure Java inference with GraalVM
- 27:17llama3.java implementation details
- 33:34Demo: llama3.java locally
- 39:56Integrating llama3.java
- 41:43LLM sharding for large models
- 44:25Future of agentic AI in Java
related talks
38mThe Era of AAP: Ai Augmented Programming using only Java
46mThe Era of AAP: Ai Augmented Programming using Modern Java
46mThe Era of AAP: Ai Augmented Programming using only Java
58mGenesis Keynote
47mPractical LLM Inference in Modern Java
57mPure Java Enterprise AI/LLM Integration (EAI 2.0)
51mPractical LLM Inference in Modern Java
30mDevoxxGenie: Your AI Assistant for IDEA
