~/talk

Build Smarter Knowledge Management Systems with AI Technology

Talkat Devoxx Belgium 2024 · 2024-10-07..10-11· [java, machine-learning]
slides:none on file

Claims a working Java stack: a Spring Boot app using Spring AI plus OCI Generative AI and Oracle Database 23ai vector types to build a RAG knowledge system. Implements neighbor‑graph and IVF indexes to scale (real pain point at ~500M chunks), supports embeddings from cloud or an AMA local LLM, and runs in Docker/Kubernetes with an Oracle Backend for Spring Boot for production. Demo ingests PDFs, returns grounded answers (embeddings ~100 ms on GPU) and an automated test run reports ~50% accuracy for one config.

AI-written summary · about

  1. 0:00Introduction to RAG
  2. 2:27Vector search fundamentals
  3. 5:28Vector indexing strategies
  4. 8:32Implementing vector search
  5. 10:39Getting started with Oracle
  6. 12:06Spring AI integration
  7. 15:25Configuration and ingestion
  8. 18:28Building a RAG demo
  9. 21:01Leveraging private LLMs
  10. 23:51Demo code walkthrough
  11. 30:33Production deployment
  12. 35:18AI microservices sandbox
  13. 40:58Evaluating RAG accuracy
  14. 49:43Conclusion and resources
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.