EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory
Wenzhe Fan Ning Yan Masood Mortazavi · 2025
Read EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory by Wenzhe Fan Ning Yan Masood Mortazavi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01912.txt.
Introduction
Wenzhe Fan, Ning Yan, and Masood Mortazavi give planning agents a memory that learns in two directions at once. Language-model multi-agent systems can plan trips and schedules, but how memory should coordinate the agents is underexplored, even though constraint tracking and error correction decide success. Their framework, EvoMem, borrows its design from the working memory model of cognitive psychology.
Three agents, a constraint extractor, a verifier, and an actor, share two memory modules. Constraint memory stores task rules and constraints, fixed within one query but evolving across queries. Query-feedback memory accumulates feedback across iterations within a query, refining the solution as it goes; both reset when a session ends. On trip planning, meeting planning, and calendar scheduling benchmarks, the dual-evolving memory delivered consistent improvements.
Catalog record
| CREATOR | Wenzhe Fan Ning Yan Masood Mortazavi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01912
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory Wenzhe Fan Ning Yan Masood Mortazavi Abstract Planning has been a cornerstone of artificial intelligence for solving complex problems, and recent progress in LLM-based multi-agent frameworks have begun to extend this capability. However, the role of human-like memory within these frameworks remains largely unexplored. Understanding how agents coordinate through memory is critical for natural language planning, where iterative reasoning, constraint tracking, and error correction drive the success. Inspired by working memory model in cognitive psychology, we present EvoMem, a multi-agent framework built on a dual-evolving memory mechanism. The framework consists of three agents (Constraint Extractor, Verifier, and Actor) and two memory modules: Constraint Memory (CMem), which evolves across queries by storing task-specific rules and constraints while remains fixed within a query, and Query-feedback Memory (QMem), which evolves within a query by accumulating feedback across iterations for solution refinement. Both memory modules are reset at the end of each query session. Evaluations on trip planning, meeting planning, and calendar scheduling show consistent performance improvements, highlighting the effectiveness of EvoMem. This success underscores the importance of memory in enhancing multi-agent planning. \workshoptitle Bridging Language, Agent, and World Models for Reasoning and Planning 2 2 footnotetext: Work done during the author’s internship at Futurewei Technologies. Correspondence to: [email protected] 1 Introduction Planning is a fundamental cognitive ability that involves generating sequences of actions and reasoning about future states [ 11 , 28 ] . However, prior work has shown that large language models (LLMs) often struggle with planning tasks, especially those requiring multi-step reasoning or long-range dependencies [ 12 , 26 , 22 ] . At the same time, the crucial role of memory in supporting computational reasoning, planning, and other cognitive functions has been widely recognized across computing, computational neuroscience, and psychology [ 21 , 19 , 2 , 10 , 5 ] . Yet, while memory has been understood as useful to reasoning and adaptation, its structure and mechanisms in the natural language planning tasks remain largely underexplored in LLM-based multi-agent frameworks. Inspired by working memory model in cognitive psychology [ 3 ] , we propose EvoMem, a multi-agent framework that explicitly incorporates the dual-evolving memory into the planning process. The framework assembles three agents (Constraint Extractor, Verifier, and Actor) and two memory modules. Given a query, the Constraint Extractor identifies task-specific rules and constraints, establishing the Constraint Memory (CMem). This fixed memory anchors the Actor’s solution generation across iterations and updates only when a new query is introduced. The Verifier evaluates the Actor’s output and provides feedback for subsequent iterations, forming the Query-feedback Memory (QMem). This dynamic memory evolves within a single query, enabling solution refinement throughout the ongoing task. CMem and QMem are reset after each query. EvoMem is conceptually aligned with Baddeley’s multi-component theory of working memory first proposed in 1974 [ 3 ] (Details shown in App. B ). CMem plays a role analogous to the phonological loop by maintaining all constraints in a stable, verbalized form across rounds. QMem functions similarly to the scratch pad, accumulating intermediate outputs, verifier feedback, and error signals into a coherent multi-round representation. The iterative Actor–Verifier process serves as a central executive that selectively attends to CMem, updates QMem, and directs the next reasoning step. This cognitive framework explains why combining long-lived constraints with dynamically updated, per-round information leads to a more consistent and effective planning process. We evaluate EvoMem on the NaturalPlan benchmark, covering trip planning, calendar scheduling, and meeting planning tasks. Using Gemini-1.5-Pro [ 24 ] as the primary backbone, EvoMem outperforms strong baselines, achieving average gains of +11.17% in trip planning, +2.56% in calendar scheduling, and +3.76% in meeting planning. To assess model-agnostic performance, we further test on DeepSeek V3 [ 15 ] and GPT-4.1-mini [ 1 ] , and observe consistent improvements across models. In summary, our contributions are as follows: First, we present EvoMem, a multi-agent framework that integrates specialized agent roles with dual-evolving memory mechanism to address complex natural language planning tasks. Second, we demonstrate that EvoMem achieves state-of-the-art performance on the NaturalPlan benchmark, validating the effectiveness of its memory-centric design. Finally, we show that for complex planning tasks, maintaining per-query memory is sufficient to capture iterative reasoning and substantially improve performance. 2 EvoMem We propose EvoMem, a multi-agent framework for solving complex planning tasks through an iterative self-correction process. As illustrated in Figure 1 , the framework employs two complementary evolving memory modules, i.e., CMem and QMem, to guide reasoning and ensure that solutions progressively align with all specified constraints. Figure 1 : The dual-evolving memory mechanism in EvoMem: CMem evolves across queries to establish fixed, task-specific constraints for the actor and verifier. QMem evolves within a single query by recording failed attempts (solution, score, errors), providing iterative feedback until the solution is verified or the turn limit is reached. 2.1 Multi-Agent Design Constraint Extractor Constraints are the rules and limitations that a valid plan must satisfy. For instance, in trip planning tasks, constraints may involve the total trip duration, fixed-date events (e.g., weddings or conferences), city-specific stays, and available flights. Prior work [ 20 ] indicates the criticality of constraint identification for reliable plan verification. The constraint extractor derives task-specific constraints from the problem description, capturing the essential conditions that any candidate plan must satisfy. These constraints are then appended to the actor’s prompts, ensuring its reasoning remains grounded in the core requirements of the task. Verifier The verifier evaluates each solution against the extracted constraints and facilitates refinement through QMem-mediated feedback. This agent provides two types of output: (i) Reward Score (0-100) that measures plan quality based on constraint satisfaction, and (ii) Feedback (including constraint violations) which the agent deposits in QMem for future iterations. To ensure full compliance, only plans with a perfect score of 100 are accepted. Actor The actor generates a solution for a given query. The actor takes the query and the extracted constraints (CMem), incorporating feedback from QMem in subsequent turns if an earlier turn fails. Prompts and examples for these three agents are given in App. D and App. E . 2.2 Memory Modules Given a query, our framework generates a solution through the iterative process of up to T turns. Planning is jointly guided by the Constraint Memory (CMem), which adapts across queries but remains fixed within a single query, and the Query-feedback Memory (QMem), which evolves across iterations within the same query. Together, these two modules form what we call “a dual-evolving memory” mechanism. CMem and QMem are reset at the end of each query session. Constraint Memory (CMem) CMem stores the constraints extracted from the query and is appended to the actor’s prompt at every turn. It remains fixed throughout the multi-turn refinement process, ensuring that the actor consistently adheres to the core requirements of the problem. The importance of CMem is further validated in our ablation study (Sec. 3.2 ). Query-feedback Memory (QMem) QMem is a dynamic memory module that evolves across iterations by recording information from failed attempts in earlier turns. Whenever a candidate solution violates constraints, its solution, score, and identified errors are logged in QMem. This memory evolves across at most T iterations, guiding subsequent refinements. 2.3 Proposed Framework The planning process for