All documentation

Evaluate / guide 20

Human review queues

Route uncertain or high-value traces to reviewers for consistent feedback.

Copy or share.

Human review queues

Use human review when an automated evaluator cannot reliably judge the behavior. Define the question reviewers answer, the allowed score range, and the evidence they should inspect before assigning work.

Keep review criteria stable across a comparison. Store the reviewer score with the trace and use disagreements to improve the rubric or create new evaluator examples.