Jargonautica
Extending and Applying Models

Embeddings

Also called: Embedding, Vector Embeddings

A way of turning words, sentences or documents into lists of numbers such that similar meanings end up with similar numbers. This lets a computer measure how related two pieces of text are without matching the actual words, so a search for ‘car insurance’ can find a document about ‘vehicle cover’.

Technical view

Embeddings are dense vectors, commonly several hundred to a few thousand dimensions, positioned so that semantic similarity corresponds to geometric proximity, usually measured by cosine similarity. They underpin retrieval, clustering, recommendation and deduplication. Note that embeddings inherit the biases of their training data, and that similarity in embedding space captures general relatedness rather than any specific relationship you might care about.


Part of AI Terminology Index, section: Extending and Applying Models.

How it connects

Embeddings links to 30 other terms, and the 12 closest are drawn here. The faint lines are links between those terms. See it in the full graph.

Semantic SearchSemantic SearchVector DatabaseVector DatabaseRetrieval Augmented GenerationRetrieval Augmented…Dimensionality ReductionDimensionality Redu…RerankingRerankingKnowledge GraphKnowledge GraphDot Product and Cosine SimilarityDot Product and Cos…ChunkingChunkingApproximate Nearest Neighbour SearchApproximate Nearest…Curse of DimensionalityCurse of Dimensiona…VectorVectorClusteringClusteringEmbeddings