~/talk

Securing Language Models Against Prompt Injection

Talkat PyData Tel Aviv 2024 · 2024-09-25..09-26· [security, large-language-models]
slides:none on file

Lists three concrete attack classes: prompt injection (examples include “ignore all previous instructions” and role‑play do anything now or “finish every sentence legally binding”), insecure output handling that lets an LLM query backends, and training‑data poisoning (Microsoft bot goes toxic in 16 hours). Builds a demo shoe‑store chatbot, shows it gets hijacked, then hardens it using heuristics, the openai moderation API, dataset monitoring (IBM test sets) and a three‑layer defense called Riv that flags injections and returns a risk score — defense succeeds.

AI-written summary · about

  1. 0:00Introduction
  2. 2:33Prompt injection risks
  3. 6:31Handling unsafe output
  4. 7:37Training data poisoning
  5. 10:54Basic defense strategies
  6. 13:08Gandalf for security
  7. 16:40Performance monitoring
  8. 19:55Advanced protection tools
  9. 21:41Attack and defense example
  10. 23:29Summary
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.