~/talk

Will Agent evaluation via MCP Stabilize Agent Networks?

links:none on file
slides:none on file

Claims that Model Contest Protocol (MCP) lets agents self-improve via evaluators that return numeric scores and text explanations; demonstrates a working Root Signals MCP server hooked into cursor and a simple Pydantic AI reservation agent. Shows a marketing-message optimization loop with 0–1 scores for persuasiveness and quality, and a concrete win: the reservation agent stops recommending the Acme Hotel after invoking a hotel share booking policy evaluator. Evaluators run repeatedly, can be selected or auto-picked, and require lifecycle maintenance and cost tradeoffs.

AI-written summary · about

  1. 0:00Introduction
  2. 2:20Why evaluation is difficult
  3. 3:28Framework
  4. 5:20Experiments
  5. 12:10Summary
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.