~/talk

Vector Databases Demystified: Discover how they work

Talkat PyData NYC 2024 · 2024-11-06..11-08· [databases, machine-learning]
links:none on file
links:none on file
slides:none on file

Shows concrete results not fluff: a runnable repo (create-a-vector-db) that builds an in-memory vector store using all-miniLM L6 v2 384‑dim embeddings, a brute‑force top‑5 cosine search over ~50 items, and a RAG demo that replaces hallucinations by passing retrieved product text into an LLM. Compares cosine vs Euclidean, context windows (4K→8K→1M+), hosting costs ($900/mo GPU vs cents on managed Gemini), and a scalable production path using HNSW hierarchical navigable small world indexes shipped in Aerospike.

AI-written summary · about

  1. 0:00Introduction
  2. 1:08LLMs and prompt engineering
  3. 10:24RAG applications and hallucinations
  4. 26:05Vectors and semantic search
  5. 37:40Build a vector DB from scratch
  6. 51:00Vectors with LLMs for answers
  7. 1:06:15Brute-force search limits
  8. 1:11:32HNSW indexes for scalability
  9. 1:18:03Dedicated vs multimodal systems
  10. 1:21:16Real-world applications
  11. 1:22:44Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.