Jargonautica
Classical Machine Learning

Naive Bayes

A fast classifier that assumes every feature is independent of every other. That assumption is almost always false, and the method works anyway, which is one of the more entertaining facts in the field. It was the standard spam filter for years.

Technical view

Applies Bayes’ theorem with a conditional independence assumption, reducing estimation to per-feature counts. Trains in a single pass, handles high-dimensional sparse data such as bag-of-words well, and needs smoothing for unseen combinations. Class predictions are often correct even where probability estimates are badly miscalibrated, since the ranking survives the violated assumption better than the magnitudes do.


Part of AI Terminology Index, section: Classical Machine Learning.

How it connects

Naive Bayes links to 4 other terms. The faint lines are links between those terms. See it in the full graph.

Model Confidence and CalibrationModel Confidence an…Classification and RegressionClassification and …BaselineBaselineBayes' TheoremBayes' TheoremNaive Bayes