Jargonautica
Building and Using Models

Base Model and Instruct Model

Also called: Base Model, Instruct Model, Chat Model

Two versions of the same model, and the difference catches people out. The base model is the raw product of pre-training: it continues text and does not converse. The instruct or chat version has had further training to follow instructions and behave like an assistant. If you download an open model and find it rambling or repeating your question back at you, you have probably got the base one.

Technical view

Base models are the starting point for custom fine-tuning, since they carry no imposed chat format, refusal behaviour or persona, and they remain useful for research into raw capability. Instruct variants expect a specific chat template of role markers and special tokens, and using the wrong template degrades output noticeably. Base models are also far less safety-trained, which is part of the argument about what should be released openly.


Part of AI Terminology Index, section: Building and Using Models.

How it connects

Base Model and Instruct Model links to 7 other terms. The faint lines are links between those terms. See it in the full graph.

Fine-tuningFine-tuningSystem PromptSystem PromptInstruction TuningInstruction TuningPre-trained ModelPre-trained ModelChat TemplateChat TemplateOpen WeightsOpen WeightsPre-trainingPre-trainingBase Model and Instruct Model