~/talk

Introducing Agent Testing

on YouTube 31m
Talkat TestMu Conference 2025 · 2025-08-19..08-21· [ai-assisted-development, large-language-models]

speakers

name:Sai Krishna
github:saikrishna321
name:Srinivasan Sekar
x:SrinivasanSekar

resources

video:https://youtu.be/OmimdkNRrAE
slides:none on file

summary

TestMu AI shows a beta agent-to-agent testing platform that ingests PRDs, Confluence and Jira, auto-generates hundreds of scenarios (intent recognition, conversational flow, multimodal) via parallel agents, and evaluates a target bot on probabilistic metrics like hallucination rate and conversational completeness. Tests run on HyperExecute, keep a human-in-the-loop for prompt/data tuning, and surface concrete failures (repeatedly asking for an order number, fabricating policies) so teams can iterate before production.

AI-written summary · about

chapters (5)

  1. 0:00Welcome
  2. 3:03Why testing agents matters
  3. 11:55LambdaTest agent testing
  4. 22:35Evaluation and results
  5. 25:23Q&A

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.