Jargonautica
Running It in Production

Drift

The world changing underneath a model that has not changed. Customers behave differently, vocabulary shifts, a supplier alters a data format, a competitor launches something. Nothing errors and nothing alerts; performance simply degrades, often for months before anyone notices.

Technical view

Distinguish data drift, a change in the input distribution, from concept drift, a change in the relationship between inputs and the target, which is the more damaging and harder to detect. Input drift is measurable without labels using distributional distances or a discriminator trained to separate training from live data; concept drift requires outcome labels, which usually arrive late or not at all. Practical responses are proxy monitoring on prediction distributions and downstream outcomes, scheduled retraining, and alerting on absence of expected signal rather than only on error.


Part of AI Terminology Index, section: Running It in Production.

How it connects

Drift links to 8 other terms. The faint lines are links between those terms. See it in the full graph.

Machine Learning OperationsMachine Learning Op…Observability and TracingObservability and T…Continual LearningContinual LearningOnline LearningOnline LearningTime Series ForecastingTime Series Forecas…Data PipelineData PipelineOnline and Offline EvaluationOnline and Offline …Interpolation and ExtrapolationInterpolation and E…Drift