FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory
Lei Wei, Xu Dong, Xiao Peng, Niantao Xie, Bin Wang · 2026
Read FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory by Lei Wei, Xu Dong, Xiao Peng, Niantao Xie, Bin Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18642.txt.
Introduction
Lei Wei and four colleagues give smart agents a way to forget that works more like the brain. An agent that keeps all it meets will drown in old facts. An agent that drops facts at a hard edge will lose key facts all at once. The brain does not work in that all-or-none way. It lets weak facts fade bit by bit while strong ones stay.
Their tool, FadeMem, lets facts fade at rates set by how much they count and how new they are. Old facts that get used stay. Old facts that sit idle fade out. A fade rule should keep the store lean with no loss of the facts that count. Lean stores cost less to run and search. The work brings a brain trick to a clear need in agent design.
Catalog record
| CREATOR | Lei Wei, Xu Dong, Xiao Peng, Niantao Xie, Bin Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18642
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory Lei Wei, Xu Dong, Xiao Peng, Niantao Xie, Bin Wang Abstract Large language models deployed as autonomous agents face critical memory limitations, lacking selective forgetting mechanisms that lead to either catastrophic forgetting at context boundaries or information overload within them. While human memory naturally balances retention and forgetting through adaptive decay processes, current AI systems employ binary retention strategies that preserve everything or lose it entirely. We propose FadeMem, a biologically-inspired agent memory architecture that incorporates active forgetting mechanisms mirroring human cognitive efficiency. FadeMem implements differential decay rates across a dual-layer memory hierarchy, where retention is governed by adaptive exponential decay functions modulated by semantic relevance, access frequency, and temporal patterns. Through LLM-guided conflict resolution and intelligent memory fusion, our system consolidates related information while allowing irrelevant details to fade. Experiments on Multi-Session Chat, LoCoMo, and LTI-Bench demonstrate superior multi-hop reasoning and retrieval with 45% storage reduction, validating the effectiveness of biologically-inspired forgetting in agent memory systems. † † address: 1 Alibaba International Digital Commerce Group 2 School of Software and Microelectronics, Peking University † † footnotetext: 🖂 Corresponding author. † † footnotetext: * These authors contributed equally to this research. 1 Introduction The advent of large language models (LLMs) has revolutionized AI systems’ ability to process and generate human-like text, yet their practical deployment as autonomous agents remains constrained by fundamental memory limitations [ 10 , 16 , 9 ] . Recent advances in agent memory architectures have explored various approaches to extend context windows and maintain conversation history, from retrieval-augmented generation (RAG) systems that leverage external knowledge bases [ 13 , 7 ] to memory-augmented neural networks that incorporate differentiable memory modules [ 2 , 14 , 12 , 19 ] . These developments have enabled agents to handle increasingly complex tasks requiring long-term context retention, multi-turn interactions, and knowledge accumulation across sessions [ 5 , 4 ] . However, existing agent memory architectures suffer from a critical flaw: they lack selective forgetting mechanisms, causing either catastrophic forgetting at context boundaries or information overload within them [ 11 , 3 , 23 , 26 ] . Current agent memory systems predominantly operate on simplistic storage-and-retrieval paradigms that treat all information with equal importance, leading to context windows cluttered with irrelevant details and degraded performance as memory scales. While human memory elegantly balances retention and forgetting through natural decay processes, where unimportant information gradually fades while significant memories are reinforced, current AI systems employ binary retention strategies that either preserve everything within their capacity or lose it entirely [ 22 , 21 ] . This limitation becomes increasingly problematic as agents handle longer interactions and accumulate vast amounts of potentially redundant or outdated information. The biological inspiration from Ebbinghaus’s forgetting curve reveals that human memory strength follows predictable exponential decay patterns modulated by factors such as repetition, emotional significance, and relevance [ 6 ] . This natural forgetting is not a weakness but an adaptive feature that prevents cognitive overload, maintains information relevance, and enables efficient generalization by removing specific details while preserving important patterns [ 24 ] . To address these fundamental limitations, we propose FadeMem, a biologically-inspired agent memory architecture that incorporates active forgetting mechanisms to mirror human cognitive efficiency [ 15 , 27 ] . Our system implements differential decay rates across a dual-layer memory hierarchy, where each memory’s retention is governed by adaptive exponential decay functions modulated by semantic relevance, access frequency, and temporal patterns [ 8 ] . Through LLM-guided conflict resolution and intelligent memory fusion, our architecture naturally consolidates related information while allowing irrelevant details to fade, achieving a dynamic balance between memory capacity and retrieval precision. Our contributions can be summarized as follows: (1) We present the first dual-layer biologically inspired agent memory with adaptive forgetting. (2) We devise a unified framework with LLM-guided conflict resolution and memory fusion that enforces temporal consistency and aggressively compresses redundancy, yielding compact, coherent memory states. (3) Extensive experiments on Multi-Session Chat, LoCoMo, and LTI-Bench show superior multi-hop reasoning and retrieval with large storage savings, and thorough ablations validate each component’s impact. 2 Methodology 2.1 Dual-Layer Memory Architecture with Differential Forgetting Inspired by human memory systems, we design a dual-layer architecture that mimics the differential forgetting rates observed in biological memory, as shown in Fig. . Each memory m_{i} at time t is represented as: m_{i}(t)=(c_{i},s_{i},v_{i}(t),\tau_{i},f_{i}) (1) where c_{i} is the content embedding, s_{i} is the original text, v_{i}(t)\in[0,1] is the memory strength, \tau_{i} is the creation timestamp, and f_{i} is the access frequency. The memory importance score determines layer assignment: I_{i}(t)=\alpha\cdot\text{rel}(c_{i},Q_{t})+\beta\cdot\frac{f_{i}}{1+f_{i}}+\gamma\cdot\text{recency}(\tau_{i},t) (2) where Q_{t} represents recent context, the frequency term follows a saturating function to prevent over-weighting, and recency is defined as \text{recency}(\tau_{i},t)=\exp(-\delta(t-\tau_{i})) . In practice, we replace the raw count f_{i} with an exponentially time-decayed access rate \tilde{f}_{i}=\sum_{j}\exp(-\kappa(t-t_{j})) to emphasize recent accesses. Memories are dynamically assigned to layers based on importance: • Long-term Memory Layer (LML): High-importance memories with slow decay • Short-term Memory Layer (SML): Low-importance memories with rapid decay Layer transitions occur when: \text{Layer}(m_{i})=\begin{cases}\text{LML}&\text{if }I_{i}(t)\geq\theta_{\text{promote}}\\ \text{SML}&\text{if }I_{i}(t)<\theta_{\text{demote}}\end{cases} (3) This allows memories to migrate between layers as their importance evolves over time. The thresholds \theta_{\text{promote}} and \theta_{\text{demote}} are determined through grid search on validation data. Using \theta_{\text{promote}}>\theta_{\text{demote}} introduces hysteresis that prevents oscillation. 2.2 Biologically-Inspired Forgetting Curves We measure time in days, consistent with our 30-day evaluation setup. We model memory decay using differential exponential functions that simulate human forgetting patterns, consistent with Ebbinghaus’s forgetting curve: v_{i}(t)=v_{i}(0)\cdot\exp\left(-\lambda_{i}\cdot(t-\tau_{i})^{\beta_{i}}\right) (4) The decay rate adapts to memory importance: \lambda_{i}=\lambda_{\text{base}}\cdot\exp(-\mu\cdot I_{i}(t)) (5) where \lambda_{\text{base}} approximates human short-term memory decay rates and \mu modulates the importance effect. The shape parameter \beta_{i} depends on the memory layer: \beta_{i}=\begin{cases}0.8&\text{if }m_{i}\in\text{LML}\quad\text{(sub-linear decay)}\\ 1.2&\text{if }m_{i}\in\text{SML}\quad\text{(super-linear decay)}\end{cases} (6) These values mirror biological memory consolidation where long-term memories exhibit slower, more gradual decay. Memory consolidation occurs during access, simulating the strengthening effect observed in human memory: v_{i}(t^{+})=v_{i}(t)+\Delta v\cdot(1-v_{i}(t))\cdot\exp(-n_{i}/N) (7) where \Delta v is the base reinforcement strength, n_{i} counts accesses within a sliding window of W days, and N implements diminishing returns consistent with spacing effects in human learning. Memories undergo automatic pruning when their strength falls below \epsilon_{\text{prune}} or they remain dormant beyond T_{\text{max}} days. Half-life With time measured in days, the half-life of memory m_{i} under our model is t_{1/2}(i)=\Big(\tfrac{\ln 2}{\lambda_{i}}\Big)^{\!1/\beta_{i}},\quad\lambda_{i}=\lambda_{\text{base}}\exp(-\mu I_{i}(t)). At I_{i}(t)=0 , this gives t_{1/2}\approx 11.25 days for LML ( \beta_{i}=0.8 ) and t_{1/2}\approx 5.02 days for SML ( \beta_{i}=1.2 ) when \lambda_{\text{base}}=0.1 . 2.3 Memory Conflict Resolution When new information arrives, we detect and resolve conflicts through semantic analysis and LLM-based reasoning. For each new memory m_{\text{new}} , we retrieve semantically similar memories: \mathcal{S}=\{m_{i}:\text{sim}(c_{\text{new}},c_{i})>\theta_{\text{sim}}\} (8) where \text{sim}(\cdot) is cosine similarity on \ell_{2} -normalized embeddings. For each m_{i}\in\mathcal{S} , an LLM examines (s_{\text{new}},s_{i}) and classifies their relationship into one of four categories in text: compatible , contradictory , subsumes , or subsumed . We then apply the corresponding resolution strategy: Compatible : Both memories coexist, while the existing memory’s importance is reduced by redundancy: I_{i}=I_{i}\cdot\bigl(1-\omega\cdot\text{sim}(c_{\text{new}},c_{i})\bigr). (9) Contradictory : Apply competitive dynamics where newer information suppresses older. We use a window-normalized age difference with W_{\text{age}} days: v_{i}(t)=v_{i}(t)\cdot\exp\!\Bigl(-\rho\cdot\mathrm{clip}\!\bigl((\tau_{\text{new}}-\tau_{i})/W_{\text{age}},\,0,\,1\bigr)\Bigr). (10) Subsumes/Subsumed : The more general memory absorbs the specific one via LLM-guided merging (content is consolidated;