Jargonautica
Controlling and Extending Behaviour at Run Time

Structured Output

Forcing a model to reply in a strict machine-readable format rather than free text, so its answer can be fed directly into other software without anything having to interpret it. Essential for anything automated, since prose replies that are almost the right shape will break a program.

Technical view

Implemented either by prompting alone, which is unreliable, or by constrained decoding, where the sampling process is restricted at each step to tokens that keep the output valid against a schema. The latter guarantees syntactic validity but not semantic correctness: a model can return well-formed output containing the wrong values.


Part of AI Terminology Index, section: Controlling and Extending Behaviour at Run Time.

How it connects

Structured Output links to 16 other terms, and the 12 closest are drawn here. The faint lines are links between those terms. See it in the full graph.

Tool Use and Function CallingTool Use and Functi…Model Context ProtocolModel Context Proto…Temperature and SamplingTemperature and Sam…Repetition PenaltyRepetition PenaltyAgentAgentLogits and SoftmaxLogits and SoftmaxTool SchemaTool SchemaGreedy DecodingGreedy DecodingLogit BiasLogit BiasStreamingStreamingStop SequenceStop SequencePrompt EngineeringPrompt EngineeringStructured Output