Why an Agent Eval Can Pass on Monday and Fail on Friday

A passing eval is evidence about one version of an agent system. When the model, context, tools, policies, or environment change, the evidence needs to be renewed.

11 min read · 2 primary sources.