~/talk

"Taming LLMs with Structured Outputs"

Talkat DevIgnition 2024 · on Thursday, 2024-11-07· [large-language-models, ai-assisted-development]
slides:none on file

Claims that guaranteed schema enforcement makes LLM outputs deterministic by constraining generation to a grammar derived from a JSON schema and shows it working with Zod + ChatGPT API (OpenAI feature introduced this summer). Demos include parsing form fields reliably, using function calling to fetch live weather, and converting course materials into a 30-question Jeopardy (6x5) game. Code examples run (Node.js/npm) and produce valid JSON every time rather than brittle freeform text.

AI-written summary · about

  1. 0:00Introduction
  2. 1:47LLMs consistency struggles
  3. 3:31LLMs without safeguards
  4. 4:56Prompt engineering limits
  5. 6:42Structured outputs enforce schemas
  6. 8:26ChatGPT API implementation
  7. 11:19Extracting structured info
  8. 12:43Function calling use case
  9. 14:51Real-world Ziggy platform
  10. 16:18AI future and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.