Jargonautica
Retrieval and Knowledge

Multi-vector Retrieval

Also called: ColBERT, Late Interaction

Representing a document with several vectors instead of one, so that different parts of it can match different queries. A single vector for a long passage averages everything together and loses the details; several vectors keep them.

Technical view

Late-interaction models such as ColBERT store per-token embeddings and score by summing maximum similarities across query tokens, giving finer-grained matching than single-vector approaches at substantially higher storage and compute cost. Compression techniques reduce the footprint. It sits between single-vector retrieval and full cross-encoder reranking in both cost and quality, and suits cases where precise term-level matching matters.


Part of AI Terminology Index, section: Retrieval and Knowledge.

How it connects

Multi-vector Retrieval links to 5 other terms. The faint lines are links between those terms. See it in the full graph.

Semantic SearchSemantic SearchRerankingRerankingEmbeddingsEmbeddingsVector DatabaseVector DatabaseHybrid SearchHybrid SearchMulti-vector Retrieval