MemPro: Agentic Memory Systems as Evolvable Programs
Qingshan Liu Guoqing Wang Wen Wu Jingqi Huang, Xinqi Tao Dejia Song Jie Zhou Liang He · 2026
Read MemPro: Agentic Memory Systems as Evolvable Programs by Qingshan Liu Guoqing Wang Wen Wu Jingqi Huang, Xinqi Tao Dejia Song Jie Zhou Liang He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00619.txt.
Introduction
Liu and co-authors treat an agent's whole memory pipe as code that can evolve, not a fixed frame. Long-run agents need memory past the span of one chat. Most memory tools build a bank, then fetch from it by a set pipe. That pipe stays fixed while the bank grows and shifts shape.
Their frame, MemPro, keeps a tree of full pipe builds that can run. An evolve agent picks bright builds from that tree. It reads where those builds fail in a loop of runs. Fresh child builds are made by edits led by those fail modes. Tests span long chat, ask, and tale sets. MemPro beats fixed and prompt-led kin tools in few rounds. Gains keep up as rounds grow, at a fair cost.
Catalog record
| CREATOR | Qingshan Liu Guoqing Wang Wen Wu Jingqi Huang, Xinqi Tao Dejia Song Jie Zhou Liang He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00619
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MemPro: Agentic Memory Systems as Evolvable Programs Qingshan Liu Guoqing Wang Wen Wu Jingqi Huang, Xinqi Tao Dejia Song Jie Zhou Liang He Abstract Long-horizon autonomous agents require memory systems to retain historical information, track evolving states, and reuse relevant knowledge beyond finite context windows. Existing agentic memory systems typically follow a memory construction–retrieval (MCR) pipeline, but often adapt mainly the memory bank while keeping the surrounding pipeline fixed after deployment. This fixed-pipeline design struggles to handle heterogeneous task-specific failure modes and can become misaligned with memory banks that evolve in scale and structure over time. To address these limitations, we propose MemPro , a system-level evolution framework that treats the entire MCR pipeline as an evolvable program rather than adapting only the memory bank or prompt text. MemPro maintains a version tree of runnable memory-system implementations, where an Evolving Agent iteratively selects promising versions, diagnoses recurring failures, and creates improved child versions through failure-mode-guided edit–debug refinement. Experiments on LongMemEval, LoCoMo, HotpotQA, and NarrativeQA show that MemPro consistently outperforms strong static and prompt-level evolving baselines within a few iterations, continues to improve with evolution, and achieves a favorable performance–cost trade-off. Code is available at https://github.com/wanghai673/MemPro . 1 1 footnotetext: Equal contribution. 2 2 footnotetext: Corresponding author. 1 Introduction Figure 1: Evolution dynamics of MemPro on the LoCoMo evaluation set, showing the performance of each evolved version, the best-so-far performance, and the main improvements of performance-enhancing versions. Large language models (LLMs) ( 2 ; 16 ; 8 ; 30 ) increasingly serve as the foundation for autonomous agents ( 22 ) , yet long-horizon tasks and sustained interactions require them to retain and reuse historical information over time. Simply extending the context window with more history is costly, noisy, and insufficient for maintaining structured long-term state ( 19 ) . Memory systems therefore play a central role, maintaining and retrieving task- or user-relevant information beyond the context window ( 35 ; 27 ) . Recent agentic memory systems typically follow a memory construction–retrieval (MCR) pipeline, where construction builds or updates a structured memory bank from interaction histories or task inputs, and retrieval selects and uses relevant memories to answer downstream queries ( 28 ; 4 ) . Prior work has improved this pipeline by designing more structured and compact memory banks, including hierarchical organizations ( 19 ; 9 ) , graph-based or dynamically linked memories ( 27 ; 4 ) , and summarization or compression pipelines ( 36 ; 5 ) . However, existing agentic memory systems typically treat the memory bank as the primary adaptive component, while the surrounding MCR pipeline is manually designed and kept fixed after deployment ( 35 ) . This fixed-pipeline assumption leads to two key limitations. First, it struggles with task heterogeneity : different long-term memory tasks exhibit different failure modes and therefore require different memory-use strategies. For example, temporal reasoning may require tracking event order or identifying the latest state, whereas multi-session reasoning may require linking scattered evidence across sessions—yet a fixed pipeline must apply the same strategy to all of them. Second, it creates memory–pipeline misalignment : as the memory bank evolves in scale and structure over time, a fixed pipeline may no longer match how memories are organized and used. Together, these limitations can lead to incomplete retrieval, noisy evidence, or ineffective use of retrieved memories. Although prompt-level optimization methods ( 1 ; 10 ) can adapt the textual components of such systems, they cannot change the executable pipeline logic and are therefore insufficient to address the above limitations. This motivates a broader view of memory self-evolution: an agentic memory system should not only update the memory bank or prompt text, but also evolve the MCR pipeline system-wide. To address these limitations, we propose MemPro (Agentic Mem ory Systems as Evolvable Pro grams), a system-level evolution framework that treats the MCR pipeline as an evolvable program. MemPro evolves runnable memory-system versions containing both prompts and executable code for constructing and maintaining memory banks, as well as using retrieved memories to solve downstream queries. It maintains a version tree of MCR pipeline implementations, where each node corresponds to a runnable pipeline version and its evaluation log. Starting from an initial pipeline, an Evolving Agent iteratively selects promising versions, diagnoses recurring failure modes, and creates improved child versions through failure-mode-guided edit–debug refinement. This tree structure lets MemPro branch from strong historical versions and explore alternative directions rather than following a single linear trajectory. Figure 1 illustrates the evolution dynamics of MemPro. We evaluate MemPro on two long-term memory benchmarks, LongMemEval and LoCoMo, and two long-context QA benchmarks, HotpotQA and NarrativeQA. Across both memory-centric and QA settings, MemPro consistently outperforms strong static and prompt-level evolving baselines within a few iterations, and keeps improving as the version tree expands—suggesting that evolving the executable MCR pipeline yields benefits beyond adapting the memory bank or prompts alone. Our contributions are as follows: • We identify two limitations of fixed-pipeline agentic memory systems: task heterogeneity and memory–pipeline misalignment. We argue that memory self-evolution should operate at the system level rather than only on stored memories or prompt text. • We propose MemPro , a system-level evolution framework that treats the MCR pipeline as an evolvable program. MemPro maintains a version tree of runnable pipeline implementations and uses failure-mode-guided edit–debug refinement to evolve both prompts and executable pipeline code. • We conduct extensive experiments across four long-term memory and long-context QA benchmarks, demonstrating MemPro’s consistent gains over strong baselines, continued improvement with evolution, and favorable performance–cost trade-off. 2 Related Work 2.1 Agentic Memory Systems Agentic memory systems extend LLM agents beyond finite context windows and typically follow a memory construction–retrieval pipeline, where a memory bank is built or updated from historical inputs and later retrieved for downstream tasks. Prior work has improved this pipeline through persistent memory management ( 20 ; 36 ; 19 ) , structured or hierarchical memory organization ( 9 ; 13 ) , graph-based or dynamically linked memories ( 4 ; 27 ) , lightweight summarization and compression ( 5 ; 14 ; 28 ) , learned or heuristic memory writing and retrieval strategies ( 29 ; 23 ; 33 ) , and experience-based or procedural memory reuse ( 24 ; 6 ; 3 ; 18 ) . Despite these advances, most systems adapt mainly the memory bank while keeping the surrounding pipeline fixed after deployment, so it struggles with heterogeneous, task-specific failure modes and may become misaligned with evolving memory banks. In contrast, MemPro treats the whole pipeline as an evolvable program and optimizes runnable memory-system implementations. 2.2 Prompt-Level Evolution Prompt-level evolution methods improve LLM systems by refining textual instructions without updating model weights. Representative methods optimize prompts through instruction search, feedback, or evolutionary refinement ( 37 ; 31 ; 21 ; 34 ; 7 ; 10 ) . GEPA further uses trajectory-level reflection to diagnose failures and evolve prompts ( 1 ) . Closely related to agentic memory, MetaMem optimizes a self-evolving meta-memory that provides textual guidance for using memorized knowledge ( 26 ) . When applied to memory systems, prompt-level evolution can refine prompts and improve over static systems, but cannot modify the executable logic that constructs memory banks or uses retrieved memories