Jargonautica
Retrieval and Knowledge

Memory

Also called: Persistent Memory

How a system carries information from one conversation to the next, given that the model itself remembers nothing. Anything that persists is stored outside the model by the application and put back into the prompt when relevant. Understanding this explains both why assistants can seem to know you and why they sometimes confidently forget something you told them last week.

Technical view

Typical implementations combine a running summary of the conversation, an extracted store of durable facts and preferences, and retrieval over past sessions, all reinserted into context at the start of a turn. The hard problems are deciding what is worth keeping, resolving contradictions when a stored fact is superseded, and forgetting on request, which matters for data protection. Everything held in memory occupies context and shapes behaviour, so an incorrect stored fact is persistent and can be difficult for a user to detect or remove.


Part of AI Terminology Index, section: Retrieval and Knowledge.

How it connects

Memory links to 10 other terms. The faint lines are links between those terms. See it in the full graph.

Context WindowContext WindowContext EngineeringContext EngineeringSession StateSession StateRetrieval Augmented GenerationRetrieval Augmented…Prompt CompressionPrompt CompressionKnowledge CutoffKnowledge CutoffPersonalisationPersonalisationData Subject RightsData Subject RightsData Residency and ConfidentialityData Residency and …Companion AICompanion AIMemory