Jargonautica
Maths and Statistics

Normalisation and Standardisation

Also called: Standardisation, Feature Scaling

Putting different measurements on a comparable scale before feeding them to a model. Income in pounds and age in years are wildly different sizes, and many methods will treat the larger numbers as more important purely because they are larger. Rescaling is dull, easy to get wrong, and frequently the difference between a model working and not.

Technical view

Min-max scaling maps to a fixed range; standardisation subtracts the mean and divides by the standard deviation. Required for distance-based methods, gradient-based optimisation and regularised models; unnecessary for trees. The critical discipline is fitting the transformation on training data only and applying the stored parameters to validation and test, since fitting across the whole dataset is a common and quiet form of leakage.


Part of AI Terminology Index, section: Maths and Statistics.

How it connects

Normalisation and Standardisation links to 5 other terms. The faint lines are links between those terms. See it in the full graph.

Feature EngineeringFeature EngineeringData LeakageData LeakageGradient DescentGradient DescentK-Nearest NeighboursK-Nearest NeighboursBatch NormalisationBatch NormalisationNormalisation and Standardisation