~/talk

Offline vector search with SQLite and EmbeddingGemma

Talkat Web AI Summit 2025 · on Friday, 2025-10-17· [databases, large-language-models]
slides:none on file

Builds an offline browser RAG by encoding documents with EmbeddingGemma (38M parameters, 768‑dim), storing float32 vectors in SQLite VEC compiled to WASM, and syncing optional backups via Firestore vector support. Uses transformers.js/Onnx runtimes to run encoders locally, vectorizes a full Unicode emoji dataset and performs per‑keystroke queries, claims browser-side similarity search at massive scale (millions of comparisons per second), and demo shows it runs fully offline once the model is downloaded.

AI-written summary · about

  1. 0:00Introduction to vectors
  2. 0:40Client vs server vectors
  3. 1:55Hybrid vector approach
  4. 3:10EmbeddingGemma overview
  5. 4:12Transformers.js integration
  6. 5:14Firebase vector storage
  7. 6:17SQLite vector search
  8. 8:05SQL query implementation
  9. 8:43Emoji search demo
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.