Jargonautica
Other Kinds of Neural Network

Diffusion Model

Also called: Diffusion Models, Diffusion

The approach behind most image generators. It is trained by taking real images and progressively adding random noise until nothing recognisable is left, then learning to reverse that process. To generate a new image, it starts from pure noise and repeatedly removes a little of it, guided by your text description, until a picture emerges.

Technical view

The model learns to predict the noise component at each step of a denoising schedule. Text conditioning is usually supplied through cross-attention to an embedding of the prompt. Latent diffusion performs the process in a compressed representation rather than pixel space, cutting compute cost substantially, which is what made these models practical to run widely. Sampling requires many sequential denoising steps, though distilled variants reduce this considerably.


Part of AI Terminology Index, section: Other Kinds of Neural Network.

How it connects

Diffusion Model links to 11 other terms. The faint lines are links between those terms. See it in the full graph.

Generative AIGenerative AIText to ImageText to ImageDeepfakeDeepfakeText to VideoText to VideoMultimodalMultimodalU-NetU-NetGenerative Adversarial NetworkGenerative Adversar…3D Generation3D GenerationVariational AutoencoderVariational Autoenc…AttentionAttentionWorld ModelWorld ModelDiffusion Model