Human review queues
Use human review when an automated evaluator cannot reliably judge the behavior. Define the question reviewers answer, the allowed score range, and the evidence they should inspect before assigning work.
Keep review criteria stable across a comparison. Store the reviewer score with the trace and use disagreements to improve the rubric or create new evaluator examples.