Multi-Layered Memory Architectures for LLM Agents: An Experimental Evaluation of Long-Term Context Retention

Payal Fofadiya, Sunil Tiwari · 2026

Read Multi-Layered Memory Architectures for LLM Agents: An Experimental Evaluation of Long-Term Context Retention by Payal Fofadiya, Sunil Tiwari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29194.txt.

Introduction

Tiwari and Fofadiya present a multi-layer memory framework for language-model agents. Long chats suffer semantic drift and unstable recall. Their design splits dialogue history into three layers. Working, episodic, and semantic layers store different kinds of memory. Adaptive gating controls what gets retrieved. Retention rules keep growth bounded across sessions. On LOCOMO and LOCCO tests, success rate reached 46.85 percent. Six-period retention hit 56.90 percent, and false memories fell to 5.1 percent.

Catalog record

CREATORPayal Fofadiya, Sunil Tiwari
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32027
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29194

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Layered Memory Architectures for LLM Agents: An Experimental Evaluation of Long-Term Context Retention Payal Fofadiya, Sunil Tiwari Abstract Long-horizon dialogue systems suffer from semantic drift and unstable memory retention across extended sessions. This paper presents a Multi-Layer Memory Framework that decomposes dialogue history into working, episodic, and semantic layers with adaptive retrieval gating and retention regularization. The architecture controls cross-session drift while maintaining bounded context growth and computational efficiency. Experiments on LOCOMO, LOCCO, and LoCoMo show improved performance, achieving 46.85 Success Rate, 0.618 overall F1 with 0.594 multi-hop F1, and 56.90% six-period retention while reducing false memory rate to 5.1% and context usage to 58.40%. Results confirm enhanced long-term retention and reasoning stability under constrained context budgets. I Introduction Large Language Models (LLMs) have achieved strong performance across dialogue reasoning and task-oriented interaction [ 1 ] . However, their ability to retain information across extended sessions remains limited by fixed context windows and uncontrolled memory accumulation. As dialogue length increases, earlier contextual signals are compressed or discarded, which leads to loss of persona consistency, entity drift, and factual instability [ 8 ] . Long-horizon conversational benchmarks such as LOCOMO and LOCCO highlight this limitation, where performance declines as sessions progress. Efficient memory consolidation has therefore become a central challenge in long-context agent systems. The motivation of this work arises from the need to design structured memory mechanisms that preserve semantic continuity while maintaining computational efficiency under bounded context constraints [ 11 ] . The core research problem addressed in this paper is long-term context retention under constrained memory budgets [ 21 ] . Specifically, given multi-session dialogue sequences, how can a model maintain stable semantic representations across sessions without incurring quadratic context growth or increased inference cost. Traditional concatenation of dialogue history leads to memory interference and computational inefficiency [ 19 ] . Therefore, the challenge lies in designing a hierarchical memory structure that separates short-term interaction from long-term abstraction while controlling semantic drift across temporal intervals [ 2 ] . Existing approaches attempt to address this limitation through hierarchical working memory, retrieval-based consolidation, parameter-based memory tuning, or context compression strategies. Hierarchical working memory methods reduce context size but focus mainly on intra-session tasks without cross-session persistence [ 22 ] . Retrieval-based architectures improve relevance selection yet remain vulnerable to false memory accumulation. Parameter-based memory approaches measure retention but do not provide explicit structural control over semantic stability [ 13 ] . Context compression techniques reduce token usage but do not maintain persistent multi-layer memory across sessions. As a result, current solutions either improve efficiency without stabilizing retention, or improve recall without constraining memory drift [ 12 ] . This work introduces a Multi-Layer Memory Framework that decomposes dialogue history into working, episodic, and semantic layers with adaptive gating and retention regularization. Working memory preserves recent interaction within bounded windows, episodic memory accumulates compact session summaries, and semantic memory maintains structured entity-level abstractions. An adaptive layer-weighting mechanism controls retrieval importance, while a retention stability objective constrains semantic shifts across sessions. This design improves long-term retention, reduces false memory rate, and decreases context usage without increasing computational overhead. Experimental results across LOCOMO, LOCCO, and LoCoMo confirm improved retention stability and reasoning performance compared to prior multi-layer and compression-based approaches. The aim of this work is to design a structured multi-layer memory architecture that preserves long-term conversational context across extended sessions while maintaining computational efficiency under bounded memory constraints. 1. How does hierarchical decomposition into working, episodic, and semantic memory layers affect long-term retention across multi-session dialogue benchmarks? 2. How does adaptive layer-weighted retrieval influence reasoning accuracy and multi-hop consistency under constrained context budgets? 3. What does retention regularization impact semantic drift and false memory rate during extended conversational progression? TABLE I: Comparison of multi-layer memory and long-context management approaches Ref Dataset Used Methodology Limitation Evaluation Results (Reported in Paper) Hu et al. [ 3 ] Blocksworld, Gripper, Tyreworld, Barman, Jericho Hierarchical working memory using subgoal-based memory chunks; summarized observation replacement for selective retention Focus limited to in-trial working memory; no cross-session long-term evaluation Overall Results: SR 21.00 \rightarrow 42.00; PR 38.61 \rightarrow 62.55; Steps 26.41 \rightarrow 22.61; Context usage 100% \rightarrow 64.98%; Time 100% \rightarrow 80.58% Ming et al. [ 10 ] Chat-based long-context dialogue tasks Integrated Long-Short Term Memory Architecture (ILSTMA) combining systematic memory space planning with most-relevant dialogue retrieval strategy Additional memory planning overhead; evaluated primarily in chat scenarios Execution efficiency improved by 21.45%; answer accuracy increased to 88.4%; outperforms baseline long-term retrieval architectures Kang et al. [ 5 ] GVD; LoCoMo Three-tier Memory Operating System (short-, mid-, long-term) with dialogue-chain FIFO updating, segmented paging, and tier-aware retrieval-generation integration Primarily dialogue-focused; evaluation limited to conversational benchmarks GVD (GPT-4o-mini): Acc 93.3, Corr. 91.2, Coher. 92.3 (+5.4% over best baseline). LoCoMo (GPT-4o-mini): Single-hop F1 23.2, Multi-hop F1 30.1, Temporal F1 8.18, Open-domain F1 22.39; Avg Rank (F1) 1.0; improvements up to +32.35% Phadke et al. [ 14 ] Long-context dialogue benchmarks Four-tier hierarchical memory (Working, Summarized, Archival, Flagged) with proactive write-time truth verification, token gating, and credibility-aware retrieval Additional verification overhead; multi-agent control stack increases computational complexity Dialogue Benchmark: Accuracy 78.2%, Understanding 94.5%, False Memory Rate 6.8%, DAR 82.4%, CDR 41.2%. SGD Benchmark: BLEU 5.75, F1 0.654, Intent Accuracy 55.5%, FMR 10.5%, DAR 73.3%, CDR 34.2% Jia et al. [ 4 ] LOCCO (3080 dialogues, 100 users); LOCCO-L Parameter-based memory via supervised fine-tuning; dialogue QA evaluation with trained consistency model Generated dialogues; mainly evaluates explicit factual memory Openchat-3.5: M_{1}=0.455\rightarrow 0.05 ( -85.27\% ); ChatGLM3-6B retained 48.25% after 6 periods; 20-user M_{1}=0.420 vs 100-user M_{1}=0.283 ; at T_{6} : 0.15 vs 0.033; Consistency model accuracy 98% Maharana et al. [ 9 ] LOCOMO Very long-term conversational benchmark with persona and temporal event graphs Dataset contribution only Average 588.2 turns per conversation; 27.2 sessions; 16,618.1 tokens per conversation Lee and Rew [ 6 ] University LMS data Memory-augmented RAG with short-term, long-term, and temporal event memory modules Domain-specific chatbot setting BERTScore F1: 0.8012 → 0.8154; contextual consistency: 3.20 → 4.07; memory utilization: 1.97 → 4.00; user satisfaction: 3.30 → 3.90 (p¡0.01) Wadkar [ 17 ] Multi-agent conversational evaluation Four-layer memory agent (Short-Term, Episodic, Semantic, Procedural) with MCP synchronization Non-standard benchmark setting Perplexity reduced: STM 327.18→294.47; Episodic 348.49→313.64; Semantic 344.22→309.79; semantic coherence improved by 28.5% Shah et al. [ 15 ] LoCoMo (1,986 QA pairs; 5 reasoning categories) Self-adaptive three-tier hierarchical memory (L0 raw experiences, L1 summaries, L2 principles) with dynamic clustering and automated self-improvement engine Additional computational overhead due to reclustering; scalability validated up to few-thousand experiences Overall F1 =0.583\pm 0.028 ; BLEU-1 =0.599 ; Entity Tracking F1 =0.719 ; Multi-hop F1 =0.550 ; Temporal F1 =0.473 ; Causal F1 =0.577 ; +78.3% overall improvement over A-MEM Xiao et al. [ 20 ] \infty -Bench (¿100K avg tokens); LongBench; sequences up to 1,024K tokens Training-free block-level external memory with sliding-window attention and selective memory lookup Block granularity affects retrieval precision; adds lookup overhead Supports extrapolation up to 1,024K tokens; evaluated on ¿100K-token \infty -Bench; maintains comparable performance to continual long-sequence training baselines Shen et al. [ 16 ] LongBench; Needle-In-A-Haystack; Ruler; InfiniteBench Layer-wise KV cache eviction with dynamic head and layer budget allocation via residual information loss minimization Designed for KV cache compression;

Read the complete text