TrustMem : Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory

Tianyu Yang, Sudipta Paul, Vijay Srinivasan, Vivek Kulkarni, Srinivas Chappidi · 2026

Read TrustMem : Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory by Tianyu Yang, Sudipta Paul, Vijay Srinivasan, Vivek Kulkarni, Srinivas Chappidi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25161.txt.

Introduction

Language model agents with long term memory keep rewriting that memory: writing, revising, and deleting entries over time. Tianyu Yang and four colleagues warn that bad updates, omissions, corruption, and invented content become persistent failures once stored, poisoning later reasoning. Their framework, TrustMem, makes the updating itself trustworthy.

A Memory Transition Verifier grades each proposed update on coverage, preservation, and faithfulness. Candidate updates under the same memory state are then ranked into preference pairs, and preference guided reinforcement learning trains the agent to pick the safer update. TrustMem posts state of the art results on three memory benchmarks. On one of them it lifts memory extraction by about twelve F1 points. Against the strongest baseline for each error type, it cuts omissions, corruption, and hallucination by roughly forty, seventy nine, and fifty percent.

Catalog record

CREATORTianyu Yang, Sudipta Paul, Vijay Srinivasan, Vivek Kulkarni, Srinivas Chappidi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.25161

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TrustMem : Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory Tianyu Yang, Sudipta Paul, Vijay Srinivasan, Vivek Kulkarni, Srinivas Chappidi Abstract Large language model (LLM) agents rely on long-term memory to support extended interactions and personalized assistance beyond finite context windows. Existing memory agents actively update external memory through generated write, revise , and delete operations, but these updates may omit important information, corrupt existing memory, or introduce unsupported hallucinated content. Once stored, such errors become persistent system-state failures that can affect future reasoning and generation. In this paper, we propose TrustMem , a framework designed to improve the trustworthiness of memory consolidation. TrustMem relies on a Memory Transition Verifier to evaluate the transition process of memory updates in terms of coverage, preservation, and faithfulness. It further constructs preference pairs among candidate updates under the same memory state, enabling preference-guided reinforcement learning to directly optimize memory updating behaviors. Extensive experiments demonstrate that TrustMem improves both memory utility and reliability: it achieves state-of-the-art results across MemoryAgentBench, HaluMem, and the Mem- α \alpha validation set, improves HaluMem memory extraction by 12.14 F1 points, and reduces transition-level omission, corruption, and hallucination by 40.1%, 79.1%, and 50.0%, respectively, compared with the strongest baseline for each error type. † † affiliation: AI Center-Mountain View, Samsung Electronics † † affiliation: University of Notre Dame 2 2 footnotetext: Work done during an internship at AI Center-Mountain View, Samsung Electronics. 1 Introduction Figure 1: Comparison of memory consolidation results produced by existing methods and TrustMem . Compared with Mem1 ( Zhou et al. 2025 ) and Mem-T ( Yue et al. 2026 ) , TrustMem better preserves input evidence and avoids corruption, omission, and hallucination when converting user inputs into persistent memory. As Large Language Models (LLMs) evolve into intelligent agents capable of long-term interaction and personalized service, long-term memory has become a pivotal component Shinn et al. 2023 ; Park et al. 2023 . By maintaining an external memory store, agents can transcend finite context windows to preserve user preferences, historical facts, and reasoning trajectories Zhong et al. 2024 ; Lu et al. 2023 ; Packer et al. 2023 . Recent advancements Yu et al. 2025 ; Wang et al. 2025b ; Yan et al. 2025 ; Yue et al. 2026 ; Zhou et al. 2025 have moved beyond passive retrieval toward active memory management, where agents actively maintain and revise memory over time. Specifically, a memory agent typically processes streaming inputs in chunks: at each step, it retrieves relevant past contexts and executes structured memory-editing actions, such as inserting new insights, updating existing records, or deleting obsolete information, to consolidate its persistent state. While this flexibility enhances controllability, it raises a critical concern: can we trust the autonomously generated memory updates? As shown in Figure 1 , representative memory agents can introduce persistent errors during memory consolidation. These examples are drawn from outputs of Mem1 ( Zhou et al. 2025 ) and Mem-T ( Yue et al. 2026 ) under the same memory-consolidation setting used in our evaluation. For instance, the first row shows a Corruption error, where an existing method incorrectly places Voltaire in the 17th century despite the input associating him with the 18th century. The second row illustrates Omission , where key split and reunification timelines are dropped from memory. The third row shows Hallucination , where an unsupported statement about John W. Ingram is introduced despite being grounded in neither the input nor the previous memory state. Since these errors can compound over time, the reliability of a memory system cannot be judged solely by terminal performance. Once a flawed entry is consolidated, it may be repeatedly retrieved and amplified in subsequent interactions, persistently contaminating the agent’s reasoning chain Chen et al. 2025 . Consequently, the core challenge of long-term memory systems has shifted from merely “retaining” information to building trustworthy memory . Furthermore, existing supervisory signals struggle to address these issues due to a severe credit assignment gap Luo et al. 2025 . Most training paradigms Wang et al. 2025b ; Yu et al. 2025 ; Yue et al. 2026 ; Yan et al. 2025 rely on terminal scalar rewards—such as final task success or tool-calling validity—which act on the trajectory level rather than the transition level for memory updates. These global signals are too coarse to pinpoint exactly when or where a faulty memory update occurred within a long sequence of updates. An incorrect final answer could stem from an early omission, a destructive overwrite in mid-stream, or a simple reasoning flaw at the final step. Conversely, a correct answer may mask unsafe intermediate updates that did not trigger a failure in the current turn but remain latent risks for future tasks. Therefore, relying solely on terminal outcomes fails to provide the granular supervision necessary to explicitly correct the agent’s specific memory-editing behaviors. To address this challenge, we shift the focus from evaluating only the final memory outcome to supervising how memory is constructed step by step. The agent processes the input chunk by chunk and executes structured memory-editing actions, such as writing new information, revising existing entries, or pruning outdated content. Each action sequence induces a local transition from the previous memory state to the updated one, enabling us to inspect whether each intermediate update is trustworthy before it becomes persistent. Based on this formulation, we propose TrustMem , a framework for training memory agents to perform trustworthy memory consolidation at the transition level. In particular, TrustMem introduces a Memory Transition Verifier to evaluate each memory update along coverage, preservation, and faithfulness, and further proposes Transition-Ranked GRPO , built upon GRPO Shao et al. 2024 , to optimize the memory-update policy. By ranking candidate updates under the same memory state, TrustMem provides fine-grained supervision for memory-editing behaviors while maintaining the downstream utility of the final memory. We evaluate TrustMem across three settings: MemoryAgentBench Hu et al. 2025 , HaluMem Chen et al. 2025 , and the Mem- \alpha Wang et al. 2025b validation set, covering accurate retrieval, test-time learning, long-range understanding, and memory reliability. Extensive experiments demonstrate that TrustMem achieves state-of-the-art results across these settings, improving over the strongest baseline by 6.5 points on MemoryAgentBench and 12.14 F1 points in HaluMem memory extraction. Beyond final task performance, Figure 2 shows that TrustMem achieves the lowest transition-level error rates across omission, corruption, and hallucination. Compared with the strongest baseline for each error type, TrustMem reduces omission, corruption, and hallucination by 40.1%, 79.1%, and 50.0%, respectively. These results demonstrate that TrustMem improves not only memory utility, but also operation-level reliability and transition-level safety. Figure 2: Transition-level error rates of existing memory agents and TrustMem . TrustMem achieves the lowest omission, corruption, and hallucination rates, reducing errors by 40.1%, 79.1%, and 50.0% over the strongest baseline for each error type. 2 Related Works Long-Term Memory Systems for LLM Agents. Long-term memory enables LLM agents to preserve information beyond finite context windows. Early systems store interactions, reflections, or user-specific notes in external memory, including Generative Agents ( Park et al. 2023 ) , Reflexion ( Shinn et al. 2023 ) , MemoryBank ( Zhong et al. 2024 ) , and MemoChat ( Lu et al. 2023 ) . System-level frameworks such

Read the complete text