~/talk

Lets Build A Node.js ChatGPT-Like Bot With AI APIs

Talkat XtremeJS 2024 · 2024-11-12..11-13· [nodejs, ai-assisted-development]
links:none on file
slides:none on file

Builds a Node.js RAG system using OpenAI models, LangChain, Express and Chroma vector DB, ingesting documents, chunking to embeddings and serving retrieval-augmented answers. Demo ingests Amazon shareholder letters and answers specific queries correctly; ChatGPT is cited as ~175 billion parameters. Notes cost and performance: stuffing a half‑terabyte into the context window is impractical, ingestion runs out of memory, and production fixes include async iterators and worker threads or S3 + queue consumers for scalable ingestion.

AI-written summary · about

  1. 0:00Building a custom ChatGPT-like bot
  2. 1:08Understanding LLMs
  3. 5:44LLM building blocks
  4. 12:11Designing RAG architecture
  5. 16:30Code walkthrough
  6. 19:24Live demo with Amazon letters
  7. 22:13Scaling for performance
  8. 24:47Summary
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.