← Glossary / 69 of 100
n. / Agents and tools
Human-in-the-loop
Definition
Human-in-the-loop means a person reviews, approves or corrects an agent's work at defined points, such as before it sends money or deletes data, or after it produces an answer a reviewer samples.
In more detail
It is the practical answer to actions that are costly to undo. You decide which steps need approval, which can run alone, and how reviewers' labels flow back into your evaluation data. Reviewer decisions are valuable data: each correction shows where the agent falls short.
Example
A finance agent drafts payments but cannot send any over $500 until a manager approves. Rejected drafts are saved to a dataset for review.
