n. / AI agents

Agent regression testing

Definition

Agent regression testing is re-running a fixed set of cases after a prompt, model or tool change to confirm that behavior that used to work still works.

← Evaluation dataset Hallucination →

In more detail

Because agent output varies run to run, regression tests compare scores and pass rates across many cases rather than exact strings.

Related terms

Evaluation dataset
Agent evaluation

See it in a live trace

Definitions are the start.

Open a real trace and watch these terms move.

Open the demo Read the docs