← Glossary / 17 of 100
n. / AI agents
LLM-as-a-judge
Definition
LLM-as-a-judge is an evaluation method where one language model scores another model's or agent's output against a rubric, such as correctness, helpfulness or safety.
In more detail
It scales far beyond manual review, but judges have biases, so teams validate them against a human-labeled sample before trusting the scores.
Related terms
