~/talk

LLMs for Web Developers

Talkat Connect.Tech 2024 · 2024-11-18..11-20· [ai-assisted-development, web-platform]
slides:none on file

Walks through concrete patterns web devs can code today: basic prompt inferencing, RAG with a vector DB (example uses 200-token chunks, overlap, embeddings), and tool-calling/agents that plan and invoke APIs. Recommends LangChain and Chroma, shows ~30–80 lines of JavaScript to call models, uses TensorFlow GPU for local embeddings, demos with llama 3.2 and IBM/OpenAI endpoints, notes token costs (~$5 per million tokens) and that a hand-rolled agent example sometimes fails.

AI-written summary · about

  1. 0:00Introduction to LLMs
  2. 6:26AI's impact on coding
  3. 9:32AI Engineer role
  4. 14:27Building AI solutions stack
  5. 15:30Prompt engineering basics
  6. 23:39Context and model cards
  7. 24:00Retrieval augmented generation
  8. 34:14Tool calling and agents
  9. 46:51Demo and resources
  10. 48:37Final thoughts and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.