~/talk

Creating Context: Loading your life into a vector database

Talkat Scale By the Bay 2023 · 2023-11-13..11-15· [databases]
links:none on file
slides:none on file

Builds a retrieval‑augmented pipeline that takes a natural question, asks an LLM to generate a GraphQL query, executes it against a vectorized dataset, and then asks the LLM to produce a final answer. Uses Airbyte to pull Strava activities, loads them into weaviate (cloud) which calls OpenAI to create embeddings, and runs the demo in Bun/TypeScript. Setup to ingest and query takes about 20 minutes, works but is fragile: results are non‑deterministic and produce non-deterministic math errors (off by factors up to seven), so rely on API aggregations and slicing for correctness.

AI-written summary · about

  1. 0:00Intro
  2. 0:45Who am I
  3. 2:04Titles
  4. 2:38Through Line
  5. 3:04Agenda
  6. 3:48Disclaimer
  7. 4:24Context
  8. 4:55Retrieval AR
  9. 6:14Unstructured to Structured
  10. 6:56Vectors
  11. 8:13Vector databases
  12. 9:30Use cases
  13. 10:16Loading data
  14. 11:55Setup
  15. 13:35Thanks Melissa
  16. 14:12Query for context
  17. 14:49Why graphql
  18. 16:42Token limits
  19. 19:02Demo
  20. 24:39Conclusion
  21. 25:36Future thoughts
  22. 27:24Questions
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.