Jargonautica
Agents and Tools

Human in the Loop

Keeping a person in the process at the points where it matters, rather than automating end to end. That might mean approving an action before it happens, reviewing output before it is sent, or handling anything the system is not confident about. It is the main practical control on systems that are usually right but not reliably so.

Technical view

Design choices include where the checkpoint sits, what the reviewer is shown, and how their decision is captured for later training and audit. Confidence-based routing sends only uncertain cases for review, which controls cost but depends on calibration that language models tend to lack. The main failure mode is automation bias: reviewers who rubber-stamp fluent output provide the appearance of oversight without the substance, so review interfaces should surface evidence and disagreement rather than presenting a finished answer for approval.


Part of AI Terminology Index, section: Agents and Tools.

How it connects

Human in the Loop links to 20 other terms, and the 12 closest are drawn here. The faint lines are links between those terms. See it in the full graph.

AgentAgentAutomation BiasAutomation BiasHuman-AI TeamingHuman-AI TeamingDeskillingDeskillingAssistant, Copilot and AgentAssistant, Copilot …Trust CalibrationTrust CalibrationAutomationAutomationLevels of AutonomyLevels of AutonomyAlignmentAlignmentGuardrailsGuardrailsWorkflow Versus AgentWorkflow Versus Age…Approval GatesApproval GatesHuman in the Loop