Is One Score Enough? Rethinking the Evaluation of Sequentially Evolving LLM Memory

Songwei DongUniversity of Virginia [email protected], Zihan ChenUniversity of Virginia [email protected] Chengshuai ShiPrinceton University [email protected] Peng WangUniversity of Virginia [email protected] Jundong LiUniversity of Virginia [email protected] Cong ShenUniversity of Virginia [email protected] · 2026

Read Is One Score Enough? Rethinking the Evaluation of Sequentially Evolving LLM Memory by Songwei DongUniversity of Virginia [email protected], Zihan ChenUniversity of Virginia [email protected] Chengshuai ShiPrinceton University [email protected] Peng WangUniversity of Virginia [email protected] Jundong LiUniversity of Virginia [email protected] Cong ShenUniversity of Virginia [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15384.txt.

Introduction

Songwei Dong and five others argue that one score is not enough for evaluating sequentially evolving language-model memory. Overall final accuracy or total results hide forgetting and harmful transfer. Their SeqMem-Eval framework targets test-time settings where memory is outside, channeled, and updated without changing weights. It gauges online utility, hold-out generalization, backward transfer, and forgetting alone. Experiments show strong final gains often coexist with large loss or harmful transfer, so memory quality needs the finer-grained view.

Catalog record

CREATORSongwei DongUniversity of Virginia [email protected], Zihan ChenUniversity of Virginia [email protected] Chengshuai ShiPrinceton University [email protected] Peng WangUniversity of Virginia [email protected] Jundong LiUniversity of Virginia [email protected] Cong ShenUniversity of Virginia [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79921
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15384

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Is One Score Enough? Rethinking the Evaluation of Sequentially Evolving LLM Memory Songwei DongUniversity of Virginia [email protected], Zihan ChenUniversity of Virginia [email protected] Chengshuai ShiPrinceton University [email protected] Peng WangUniversity of Virginia [email protected] Jundong LiUniversity of Virginia [email protected] Cong ShenUniversity of Virginia [email protected] Abstract Memory plays a central role in enabling large language models (LLMs) to operate over sequential tasks by accumulating and reusing experience over time. However, existing evaluations of LLM memory mostly rely on aggregate metrics such as final hold-out accuracy or cumulative online performance. We argue that these metrics can be misleading: they collapse distinct memory behaviors into a single number and obscure critical failure modes such as forgetting and negative transfer. In this paper, we introduce SeqMem-Eval , a diagnostic evaluation framework for sequentially evolving LLM memory. Drawing inspiration from continual learning, it targets a distinct test-time setting in which memory is external, prompt-mediated, and updated without changing model parameters. Rather than only measuring whether the final memory state improves performance, SeqMem-Eval examines how memory states evolve, generalize, consolidate experience, and retain useful information during sequential inference. Specifically, it measures online utility, hold-out generalization, backward transfer, and forgetting, providing a finer-grained view of whether memory updates help current tasks, generalize to unseen tasks, improve past predictions, or degrade previously acquired knowledge. Through extensive experiments across diverse tasks and memory methods, we uncover several previously overlooked phenomena. In particular, we show that higher final or cumulative accuracy does not necessarily imply better memory quality: many methods exhibit strong performance gains while suffering from significant forgetting or negative transfers. Moreover, different memory designs exhibit distinct trade-offs between adaptability and stability, which are invisible under standard evaluation metrics. Our findings show that aggregate metrics systematically miss several recurring failure modes, suggesting that a multi-dimensional perspective is essential for understanding LLM memory. Code and evaluation framework are available at: https://github.com/ShenGroup/SeqMem-Eval 1 Introduction Large language models (LLMs) are increasingly equipped with external memory to evolve over sequential tasks ( 40 ; 9 ; 35 ) , where models are expected to accumulate experience and adapt their behavior over time. Through continual interaction with tasks or environments, LLMs generate rich trajectories that contain not only successful solutions but also failed attempts, feedback signals, and intermediate reasoning traces ( 43 ) . Rather than serving as passive records of past interactions, these trajectories can provide valuable experience for refining future decisions, improving task strategies, and enabling test-time adaptation ( 35 ; 26 ; 47 ) . Such sequentially evolving systems are central to many emerging applications, including reasoning assistants ( 13 ) , tool-use agents ( 30 ) , and interactive decision-making systems ( 44 ; 1 ) , where performance depends not only on the current input but also on previously encountered tasks. Wei et al. 35 formalize this setting by viewing memory as an evolving state that is retrieved , synthesized , and updated throughout a task sequence. This perspective marks an important step beyond static conversational recall, highlighting the role of memory in test-time adaptation and experience reuse. Despite this progress, the evaluation of sequentially evolving LLM memory remains incomplete. Existing studies typically assess memory methods using aggregate performance metrics, such as final hold-out accuracy after memory construction ( 43 ) or cumulative online accuracy along the sequence ( 35 ; 26 ) . While useful, these metrics collapse the behavior of an evolving memory system into a single number. As a result, they do not reveal whether memory updates genuinely improve future behavior, whether later experiences help consolidate earlier ones, or whether the system forgets knowledge that was previously useful. In practice, similar final or average accuracy may mask fundamentally different learning dynamics: one method may steadily accumulate reusable knowledge, while another may exhibit oscillatory behavior or transient improvements followed by degradation. Thus, aggregate metrics can create an illusion of comparable memory quality, even when the underlying memory dynamics are substantially different. Figure 1 : SeqMem-Eval : Beyond aggregate evaluation of LLM memory. Left: In sequential settings, an LLM processes a stream of tasks while maintaining an evolving memory state. Middle: Existing evaluations reduce memory performance to aggregate metrics, which collapses complex memory dynamics and hides important behaviors. Right: SeqMem-Eval decomposes memory quality into multiple dimensions, including online utility, hold-out generalization, backward transfer, forgetting, and efficiency, enabling fine-grained analysis of how memory evolves. In this paper, we propose SeqMem-Eval , a diagnostic evaluation framework for sequentially evolving LLM memory. While motivated by continual learning ( 37 ; 17 ) , sequentially evolving LLM memory is a distinct test-time setting: the LLM remains fixed, and adaptation occurs through updates to an external textual memory that influences predictions via retrieval and context construction. Therefore, evaluation should focus not only on final task performance, but also on how these memory updates affect predictions throughout the sequence. SeqMem-Eval captures this behavior through five complementary dimensions: online utility , hold-out generalization , backward transfer , forgetting , and efficiency . Together, these diagnostics reveal whether memory updates are useful, transferable, stable, and cost-effective, rather than merely improving aggregate accuracy. We conduct a systematic empirical study across diverse tasks, models, and representative memory methods under the SeqMem-Eval protocol. Our results show that standard aggregate metrics can be misleading: methods with strong final or online accuracy may still exhibit substantial forgetting, limited backward transfer, or weak generalization from accumulated experience. These findings suggest that current evaluation practices can overestimate the effectiveness of LLM memory and obscure important failure modes. Our contributions are summarized as follows: • Diagnostic evaluation framework. We introduce SeqMem-Eval , a continual-learning-inspired framework for evaluating sequentially evolving LLM memory beyond aggregate accuracy. • Comprehensive empirical study. We provide a systematic comparison of representative memory methods across diverse tasks and models under a unified sequential evaluation protocol. • Actionable findings for memory design. We identify key failure modes, including forgetting, limited backward transfer, and weak generalization, offering design implications for more reliable memory-augmented LLMs. 2 Related Work Sequentially evolving LLM memory and evaluation. Memory has become a central mechanism for enabling LLM agents to move beyond isolated inputs and adapt over sequential interactions ( 40 ; 8 ; 18 ; 7 ) . Recent memory-augmented agents extract reusable information from prior trajectories, feedback, reflections, or workflows, and use such information to improve future reasoning and decision-making ( 29 ; 6 ; 9 ; 46 ; 41 ) . Representative approaches include reflection- or experience-based methods such as ExpeL ( 43 ) , dynamic memory construction methods such as Dynamic Cheatsheet ( 26 ) , workflow-level memory methods such as Agent Workflow Memory (AWM) ( 34 ) , and retrieval- or structure-based memory systems such as G-Memory ( 42 ) and Memento ( 47 ) . These methods differ in how they store, retrieve, and update memory, but share the goal of improving future behavior through test-time experience reuse ( 27 ; 10 ; 13 ) . Recent benchmark efforts further formalize this setting: for example, Evo-Memory ( 35 ) converts static datasets into sequential task streams and evaluates agents whose memory is searched, synthesized, and evolved after each interaction. Broader works of self-evolving agents also frame memory and trajectory reuse as part of environment-centric self-evolution 40

Read the complete text