Jargonautica
Testing, Safeguarding and Running Models in Practice

Guardrails

Also called: Guardrail

Checks placed around a model rather than inside it. A separate system inspects what goes in and what comes out, blocking or flagging anything that breaks the rules. Because these sit outside the model, they can be updated immediately when a problem is found, without any retraining.

Technical view

Typically implemented as classifiers, rule sets or smaller models applied to inputs and outputs, covering categories such as harmful content, personal data leakage, off-topic use and prompt injection patterns. The trade-off is between false positives, which block legitimate use and frustrate users, and false negatives, which let harmful content through. Output-side guardrails add latency, particularly where they require the full response before a judgement can be made.


Part of AI Terminology Index, section: Testing, Safeguarding and Running Models in Practice.

How it connects

Guardrails links to 22 other terms, and the 12 closest are drawn here. The faint lines are links between those terms. See it in the full graph.

JailbreakingJailbreakingAlignmentAlignmentPrompt InjectionPrompt InjectionRed TeamingRed TeamingSystem PromptSystem PromptAgentAgentRefusal and Over-refusalRefusal and Over-re…Content ModerationContent ModerationSafety ClassifierSafety ClassifierSystem Prompt ExtractionSystem Prompt Extra…Human in the LoopHuman in the LoopAccuracy, Precision and RecallAccuracy, Precision…Guardrails