Human-Inspired Memory Architecture for LLM Agents

Doga Kerestecioglu, Alexei Robsky, Clemens Vasters, Anshul Sharma, Yitzhak Kesselman · 2026

Read Human-Inspired Memory Architecture for LLM Agents by Doga Kerestecioglu, Alexei Robsky, Clemens Vasters, Anshul Sharma, Yitzhak Kesselman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08538.txt.

Introduction

Doga Kerestecioglu and four coauthors give language model agents a memory system modeled on the human brain. Current agents pile up past events with no clear way to keep what matters. Their design uses six linked parts, among them sleep like consolidation, forgetting through overlap, and knowledge graphs for named entities, plus search that uses several cues at once.

On a large coding issue dataset, merging duplicate memories kept recall near perfect while cutting storage by more than half. On a long personal chat test, the system matched plain search accuracy while using far less space. Agent builders gain a principled way to remember more without storing everything.

Catalog record

CREATORDoga Kerestecioglu, Alexei Robsky, Clemens Vasters, Anshul Sharma, Yitzhak Kesselman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08538

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Human-Inspired Memory Architecture for LLM Agents Doga Kerestecioglu, Alexei Robsky, Clemens Vasters, Anshul Sharma, Yitzhak Kesselman Abstract Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2) interference-based forgetting, (3) engram maturation, (4) reconsolidation upon retrieval, (5) entity knowledge graphs, and (6) hybrid multi-cue retrieval. Each mechanism addresses a specific failure mode of naive memory accumulation. We introduce a synthetic calibration methodology that derives all pipeline thresholds without benchmark data exposure, eliminating a common source of evaluation leakage. We evaluate on two benchmarks. First, a VSCode issue-tracking dataset (13K issues, 120K events) where deduplication-based consolidation achieves 97.2% retention precision with 58% store reduction (+21.8 pp over baseline). Second, the LongMemEval personal-chat benchmark where we conduct the first streaming M-tier evaluation (475 sessions, ∼ \sim 540K unique turns). At a 200K-token context budget, our pipeline matches raw retrieval accuracy (70.1% vs. 71.2%, overlapping 95% CI) while exposing a tunable accuracy/store-size operating curve. At S-tier scale (50 sessions), dedup-based consolidation yields a +13.3 pp improvement in preference recall. 1 Introduction Large Language Model (LLM) agents have demonstrated remarkable capabilities in reasoning, planning, and task execution. Yet, a fundamental limitation constrains their utility in enterprise settings: the absence of persistent, adaptive memory. Current approaches fall into three categories, each with shortcomings. Stateless agents treat each interaction independently, losing all context between sessions. This forces users to repeatedly re-establish context and prevents agents from learning from past interactions. Context window approaches attempt to maintain memory by expanding the prompt with historical information. Recent advances have extended context windows to millions of tokens, but this approach scales cost without scaling intelligence (i.e., the agent still cannot prioritize, forget, or learn). Similarly, approaches based on rolling summarization suffer from compounding information loss as history grows. Vector database approaches (RAG) store and retrieve information based on embedding similarity. While an improvement over stateless designs, these systems treat all information equally, lack mechanisms for consolidation or forgetting, and cannot evolve memories based on new information. We propose a fundamentally different approach inspired by human neurology and present a memory architecture grounded in the neuroscience of human memory systems. Our design implements the key mechanisms that make biological memory effective by introducing (1) a multi-tier storage, (2) offline consolidation, (3) adaptive forgetting, (4) gradual maturation, and (5) reconsolidation upon retrieval. The architecture is designed for enterprise-grade scalability, governance, and integration. Contributions. This paper makes the following contributions: • A biologically-grounded memory architecture mapping six cognitive mechanisms to system components, with detailed specifications for each. Four mechanisms have ablation evidence in this paper ( consolidation , forgetting , graph retrieval , importance scoring ). Two are implemented for operational completeness but require deployment conditions absent from current benchmarks. Maturation requires repeated retrieval over weeks to activate, and reconsolidation requires cross-session contradictions, which are both structurally absent from LongMemEval’s construction. • A synthetic calibration methodology that derives all pipeline thresholds from LLM-generated corpora produced from a fixed specification (no benchmark exposure), eliminating evaluation leakage. • A streaming evaluation protocol that processes sessions sequentially in temporal order, simulating realistic agent deployment. • A nine-configuration ablation study on LongMemEval S-tier with bootstrapped 95% confidence intervals, isolating the contribution of consolidation, forgetting, reconsolidation, and graph retrieval. • A streaming M-tier evaluation (475 sessions per question, \sim 540K unique turns), demonstrating that the pipeline matches raw retrieval accuracy at a 200K-token context budget and exposes a tunable accuracy/store-size operating curve at lower budgets. The remainder of this paper is organized as follows. § 2 reviews the biological foundations. § 3 presents the technical architecture. §§ 4 – 6 detail the consolidation, forgetting, and maturation mechanisms. § 7 covers retrieval and agent integration. § 8 describes experimental methodology and § 9 presents evaluation results. §§ 10 – 12 address related work, limitations, and conclusions. 2 Biological Foundations Our architecture draws on six established neuroscientific principles. Table 1 summarizes the mapping from biological mechanism to system design. Table 1 : Mapping from system mechanism to neuroscience inspiration. Mechanism Neuroscience Inspiration Consolidation Sleep-phase memory integration Forgetting Decay + interference Maturation Engram stabilization Reconsolidation Memory lability on retrieval Knowledge Graph Semantic memory networks Hybrid Retrieval Multi-cue recall The core insight from complementary learning systems theory 5 is that rapid episodic encoding (hippocampus) and slow semantic extraction (neocortex) serve different roles. Our architecture mirrors this. A vector store provides high-fidelity episodic retrieval while a knowledge graph accumulates semantic relationships through consolidation. Sleep-phase consolidation 2 runs offline to deduplicate and merge redundant traces. Forgetting combines exponential trace decay (the Ebbinghaus forgetting curve) with retrieval-induced interference 1 . Memory maturation follows the Kitamura et al. 4 finding that engrams form immediately but remain “silent” for days before becoming explicitly retrievable. Reconsolidation 6 enables retrieved memories to be updated with new information during a lability window, preventing stale facts from persisting indefinitely. The graph layer is grounded in semantic-network and spreading-activation theories from cognitive psychology. 3 Technical Architecture The architecture maps three biological memory tiers to system components: short-term (prefrontal cortex \to hot cache, in-memory with TTL min–hrs), medium-term (hippocampus \to warm episodic store, full fidelity with TTL days–weeks), and long-term (neocortex \to knowledge graph, semantic and permanent). Concretely, the system comprises three layers: (1) an ingestion layer that stores raw events with embeddings and metadata enrichment; (2) an episodic store providing time-indexed vector search over recent memories with tiered caching; and (3) a semantic graph organizing long-term memories by entity relationships, enabling multi-hop traversal queries. All three layers share a unified data layer, eliminating data movement between services and enabling unified governance. 4 Memory Consolidation Pipeline The consolidation pipeline implements the biological sharp-wave ripple mechanism through scheduled batch processing (default is every 6 hours, but optimized based on domain) that identifies, validates, transforms, and promotes valuable memories to long-term storage. Events not promoted remain in the episodic store subject to TTL-based expiration and active forgetting mechanisms operate independently (Section 5 ). Importance scoring. Each pending event is scored for long-term retention value using five factors (Table 2 ): S(e)=\sum_{i=1}^{5}w_{i}\cdot f_{i}(e) (1) where f_{i} represents each scoring factor and w_{i} its weight. Events are classified by composite score: promote (top 20%), retain (middle 60%), and prune (bottom 20%). Table 2 : Importance scoring factors with default weights. Factor Weight Computation Biological Basis Recency 0.25 Exponential decay from timestamp Hippocampal consolidation Frequency 0.25 Inverse frequency of similar events Hebbian learning Bayesian Surprise 0.20 Distance from prior distribution Dopaminergic signaling Entity Salience 0.15 Max importance of referenced entities Amygdala tagging Outcome 0.15 Goal completion signal Reward reinforcement Downstream stages. Before filtering, a temporal validation step detects out-of-order arrivals, duplicates, and causal inversions, quarantining anomalous events (TTL: 15 min) to prevent “agent déjà vu.” Score-based filtering then downweights automated and low-authority events while preserving high-surprise system alerts. Promoted events are transformed into semantic summaries via LLM-generated gists and clustering, then integrated into the knowledge graph with entity edges. Newly integrated memories begin in a “silent” state with low activation strength (Section 6 ), ensuring only stable knowledge influences long-term reasoning. 5 Adaptive Forgetting Our architecture treats forgetting as essential maintenance that improves retrieval accuracy, reduces interference, and ensures

Read the complete text