Jargonautica
Hardware, Compute and Training Mechanics

Emergent Capabilities

Also called: Emergence

Abilities that appear in larger models without having been trained for or anticipated, and which smaller models of the same design simply do not have. Multi-step arithmetic and translating between language pairs never seen paired in training are commonly cited examples. It is one of the more genuinely unsettling features of the field, since it means capability is not fully predictable in advance.

Technical view

Reported as sharp discontinuities in performance at particular scales. A significant critique holds that much apparent emergence is an artefact of measurement: all-or-nothing metrics such as exact-match accuracy create the appearance of a sudden jump where continuous metrics reveal smooth improvement. The distinction matters considerably for safety policy, since genuinely unpredictable capability gain is much harder to plan around than smooth improvement.


Part of AI Terminology Index, section: Hardware, Compute and Training Mechanics.

How it connects

Emergent Capabilities links to 12 other terms. The faint lines are links between those terms. See it in the full graph.

Artificial General IntelligenceArtificial General …Scaling LawsScaling LawsExistential RiskExistential RiskTakeoff SpeedsTakeoff SpeedsBenchmarks and EvalsBenchmarks and EvalsLarge Language ModelLarge Language ModelZero-shot, One-shot and Few-shotZero-shot, One-shot…Standard BenchmarksStandard BenchmarksStochastic ParrotStochastic ParrotTheory of MindTheory of MindInduction HeadInduction HeadWorld ModelWorld ModelEmergent Capabilities