Jargonautica
Controlling and Extending Behaviour at Run Time

Reasoning Models and Test-Time Compute

Also called: Reasoning Models, Test-Time Compute

A newer class of model that spends longer thinking before answering, sometimes working through a problem at length internally before producing a response. They cost more and take longer, but do markedly better on hard problems in mathematics, coding and logic. For simple questions they are usually overkill.

Technical view

The insight is that quality can be bought with inference-time computation rather than only with training-time scale. These models are typically trained with reinforcement learning on verifiable tasks where correctness can be checked automatically. Techniques include extended internal reasoning, sampling multiple candidate solutions and selecting among them, and iterative self-correction. The trade-off is a substantial rise in latency and token cost, and the gains are concentrated in domains with checkable answers.


Part of AI Terminology Index, section: Controlling and Extending Behaviour at Run Time.

How it connects

Reasoning Models and Test-Time Compute links to 16 other terms, and the 12 closest are drawn here. The faint lines are links between those terms. See it in the full graph.

Chain of ThoughtChain of ThoughtChain-of-thought FaithfulnessChain-of-thought Fa…ScratchpadScratchpadReinforcement LearningReinforcement Learn…Reinforcement Learning with Verifiable RewardsReinforcement Learn…Thinking BudgetThinking BudgetProcess Reward ModelProcess Reward ModelBenchmarks and EvalsBenchmarks and EvalsAgentAgentLLM as a JudgeLLM as a JudgeTree of ThoughtsTree of ThoughtsGroup Relative Policy OptimisationGroup Relative Poli…Reasoning Models and Test-Time Compute