~/talk

Mind your business: Secure your generative AI application on AWS

Talkat AWS re:Inforce 2024 · 2024-06-10..06-12· [large-language-models, security]
slides:none on file

Walks through a concrete RAG architecture that uses embeddings, a vector store and Amazon Bedrock for inference and guardrails and shows how documents get chunked, embedded and semantically retrieved into prompts. Recommends explicit controls: prompt templates versioned and permissioned, continuous monitoring for model drift, fine tuning or temperature reduction to curb hallucinations, and Bedrock content filters that can mask or block outputs and register up to three‑word profanity phrases.

AI-written summary · about

  1. 0:00Introduction to AI security
  2. 0:51Application security controls
  3. 2:56Generative AI risk layers
  4. 4:48Architecture vulnerabilities
  5. 6:54Preventing injection attacks
  6. 8:06Robust prompt engineering
  7. 11:18Mitigating hallucinations
  8. 12:21Securing RAG architectures
  9. 13:55Managing toxicity and bias
  10. 15:04Using Amazon Bedrock tools
  11. 15:35Implementing guardrails
  12. 16:02Securing external plugins
  13. 16:33Final summary and best practices
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.