n. / Quality and evaluation
Definition
Ground truth is the known correct answer or label for an input, used as the standard when scoring a model's output.
In more detail
For some tasks it is clear, like the right category or the correct number. For open-ended tasks there may be many good answers, so ground truth becomes a list of required facts or a rubric instead of one string. Labels made by people are not perfect either, so check agreement between reviewers on a sample.
Example
For the question "What is the refund window?", the ground truth is "30 days from delivery". An answer of "two weeks" is marked wrong.
Related terms
