← Glossary / 88 of 100

n. / Quality and evaluation

Ground truth

Definition

Ground truth is the known correct answer or label for an input, used as the standard when scoring a model's output.

In more detail

For some tasks it is clear, like the right category or the correct number. For open-ended tasks there may be many good answers, so ground truth becomes a list of required facts or a rubric instead of one string. Labels made by people are not perfect either, so check agreement between reviewers on a sample.

Example

For the question "What is the refund window?", the ground truth is "30 days from delivery". An answer of "two weeks" is marked wrong.

Definitions are the start.

Open a real trace and watch these terms move.