~/talk

Extendable by Design: Building Generative AI Apps with Postgres and Vector Storage and Azure AI

Talkat SQLBits 2024 · 2024-03-19..03-23· [databases, large-language-models]
slides:none on file

Shows a working Rails app that loads ~30 years of mailing‑list emails (1998–Mar 2024), adds a generated ts_vector column for full‑text search, creates 1536‑dim embeddings via Azure OpenAI, stores them with pgvector, and compares IVF vs HNSW indexes. Demonstration runs vector search and RAG: initial sequential scans of ~10+ ms drop to <1 ms with an HNSW index; summarization and grounded answers come from retrieved emails, with occasional prompt‑level failures during the live demo.

AI-written summary · about

  1. 0:00Postgres and generative AI
  2. 1:10Postgres extendable by design
  3. 3:00Postgres extensions for features
  4. 7:37Mailing list search helper
  5. 8:39Email search challenges
  6. 10:03Full text search in Postgres
  7. 13:15How Postgres tokenizes text
  8. 15:03Highlighting search matches
  9. 16:06Ranking full text queries
  10. 18:36Vector storage with PG Vector
  11. 19:22Vector indexing: IVF vs HNSW
  12. 22:11Azure AI for embeddings
  13. 23:38Retrieval augmented generation
  14. 26:27Email embeddings generation
  15. 28:13Semantic email retrieval
  16. 29:18Optimizing vector queries
  17. 30:23Testing RAG with Azure AI Studio
  18. 31:50Live demo of RAG
  19. 34:43Refining prompts for responses
  20. 37:15Hybrid search: text and vectors
  21. 38:42Exploring email dataset
  22. 42:55Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.