Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems
Shanglin Wu † \dagger, Yuyang Luo, Yueqing Liang, Kaiwen Shi, Yanfang Ye, Ali Payani, Kai Shu * · 2026
Read Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems by Shanglin Wu † \dagger, Yuyang Luo, Yueqing Liang, Kaiwen Shi, Yanfang Ye, Ali Payani, Kai Shu * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03295.txt.
Introduction
Wu and colleagues compare scaling multi-agent language-model systems by adding agents versus by accumulating experience over time. Their LLMA-Mem framework gives teams flexible memory topologies for reusing experience, and tests on MultiAgentBench show it improves long-horizon results while cutting cost. Larger teams do not always win: smaller teams can beat bigger ones when memory supports experience reuse well.
Catalog record
| CREATOR | Shanglin Wu † \dagger, Yuyang Luo, Yueqing Liang, Kaiwen Shi, Yanfang Ye, Ali Payani, Kai Shu * |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57018 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03295
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems Shanglin Wu † \dagger, Yuyang Luo, Yueqing Liang, Kaiwen Shi, Yanfang Ye, Ali Payani, Kai Shu * Abstract Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions separately, their interaction under realistic cost constraints remains unclear. In this paper, we introduce a conceptual scaling view of multi-agent systems that jointly considers team size and lifelong learning ability, and we study how memory design shares this landscape. To this end, we propose LLMA-Mem , a lifelong memory framework for LLM multi-agent systems under flexible memory topologies. We evaluate LLMA-Mem on MultiAgentBench across coding, research, and database environments. Empirically, LLMA-Mem consistently improves long-horizon performance over baselines while reducing cost. Our analysis further reveals a non-monotonic scaling landscape: larger teams do not always produce better long-term performance, and smaller teams can outperform larger ones when memory better supports the reuse of experience. These findings position memory design as a practical path for scaling multi-agent systems more effectively and more efficiently over time. Our code is available at https://github.com/ShanglinWu/MAS_lifelong_learning . Figure 1 : Scaling space and cost comparison of LLMA-Mem. Top: LLMA-Mem enabled scaling space for multi-agent systems. Bottom: Average token usage per task, where LLMA-Mem shows substantial cost reduction compared to baselines across models. 1 Introduction Large language model (LLM)-based agent systems have demonstrated remarkable capabilities across diverse domains, from complex reasoning and code generation to embodied task execution and scientific discovery ( 6 ; 23 ) . These systems extend beyond passive language generation to exhibit autonomous decision-making, tool use, and environmental interaction. A natural extension of this paradigm involves scaling from individual agents to multi-agent systems (MAS), where multiple LLM agents collaborate to tackle problems that exceed the capacity of a single agent. Such architectures prove essential for tasks requiring diverse expertise, extended context processing, parallel execution, or collective verification to reduce hallucinations ( 5 ; 7 ) . Beyond scaling team size, a distinct dimension of scaling emerges in lifelong learning ( 31 ) , where agents continuously adapt and improve over time. Current research predominantly addresses these two scaling dimensions in isolation. Studies on team-size scaling investigate how performance varies with the number of agents, revealing that collaborative scaling can follow logistic patterns ( 17 ) and that smaller models with more agents can sometimes outperform larger models with fewer agents ( 11 ) . Separately, research on lifelong learning mainly focuses on how individual agents improve through accumulated experience, often through increasingly sophisticated memory architectures ( 31 ) . However, the intersection of these dimensions remains largely unexplored. In practice, once a system moves from a single agent to a multi-agent team, lifelong learning is shaped not only by the quality of memory, but also by coordination overhead, communication cost, and information fragmentation ( 10 ) . This observation motivates the central perspective of our paper. We argue that LLM multi-agent systems should be viewed through a conceptual scaling space jointly defined by team size and lifelong learning ability. In this view, scaling is no longer a single-axis question of whether “more agents are better” or “more experience is helpful”. Instead, it becomes a systems question about how the interaction between team composition and learning over time shapes long-horizon effectiveness and efficiency. Our experiments make this tension explicit: larger teams do not always achieve better long-term performance, and better memory can change the outcome enough that a smaller team becomes preferable. This reveals a new trade-off between scaling horizontally through more agents and scaling temporally through better learning over time. Among the many potential factors, we focus on memory as the primary mechanism governing lifelong learning ability, because memory determines how agents retain, retrieve, and build upon past experiences ( 29 ; 31 ) . The difficulty of memory management grows with memory complexity, which depends on both team size and communication mechanism ( 10 ) . We further argue that memory topology, which determines who can read or write which memories, is also a crucial factor in this complexity ( 24 ) . Even under identical communication structures, different topologies distribute complexity very differently across the system. Existing work mainly studies isolated memory designs and does not sufficiently address cross-task learning in multi-agent settings. This leads to our first research question: RQ1: How can memory design improve lifelong learning in multi-agent systems? To answer it, we propose LLMA-Mem , a multi-agent memory framework that distills compact procedural memories from episodic experience while also modeling team capabilities through transactive memory. This design aims to improve both long-horizon performance and efficiency: in our experiments, LLMA-Mem improves lifelong learning ability over the baseline in all model-environment settings while reducing token usage by ( \downarrow 9.4%) to ( \downarrow 71.7%) relative to competing memory baselines. To study these effects, we require benchmarks that go beyond static question answering or single-turn reasoning, with a focus on multi-agent scenarios. We therefore select MultiAgentBench ( 32 ) , whose multi-step environments expose both task completion and inter-agent communication over sequential tasks. Following the previous discussion, our second research question is RQ2: How does lifelong learning ability interact with team size in multi-agent systems? To answer RQ2 , we study LLMA-Mem over long task sequences and explicitly quantify how increasing team size changes the marginal value of experience. Intuitively, larger teams can provide stronger parallelism, which may accelerate learning early on. At the same time, scaling the team introduces coordination overhead, duplicated effort, and fragmented information flow, all of which can weaken long-horizon gains. Our results confirm that this relationship is not monotonic: smaller teams can outperform larger ones when memory supports stronger accumulation and reuse of experience. Through systematic analysis, we demonstrate how the interplay between memory design and team size creates a nuanced landscape for agentic scaling, offering guidance for researchers and practitioners in designing effective multi-agent systems. Our main contributions are as follows: • We introduce a joint scaling perspective for LLM multi-agent systems that connects team size scaling and lifelong learning scaling, framing them as an interacting scaling space rather than two isolated axes. • We propose LLMA-Mem , a lifelong memory framework that separates episodic memory as experiential substrate, procedural memory as the main mechanism for cross-task transfer, and transactive memory as the mechanism for team-level capability and coordination modeling. • We conduct systematic empirical study of how lifelong learning interacts with team size in LLM multi-agent systems, revealing a non-monotonic scaling pattern. • We show that LLMA-Mem improves long-horizon performance while reducing token cost relative to existing memory baselines, highlighting memory design as a practical path toward more effective and more efficient multi-agent systems. 2 Related Works 2.1 Scaling of team size in LLM Multi-agent Systems A central question in designing LLM-based multi-agent systems (MAS) is how many agents to deploy in the systems, yet recent evidence suggests that team size scaling is highly conditional rather than universally monotonic. Early work on scalable collaboration networks argues that increasing the number of collaborating agents can produce systematic gains that follow a saturating scaling