RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

Jun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqin Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu Zhao, Xue Lin, Dong Huang, Yanzhi Wang · 2025

Read RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory by Jun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqin Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu Zhao, Xue Lin, Dong Huang, Yanzhi Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04903.txt.

Introduction

Jun Liu and fourteen co-authors stop teams of AI agents from drowning each other in shared notes, in this 2025 paper. Multi-agent language model systems divide work by role, but most still hand every agent the entire shared memory, or route context by fixed rules. Each agent then pays, in time and tokens, to read material its role does not need.

Their layer, role-conditioned context routing, sits between the shared memory and the agents at run time. It scores each memory item's relevance to an agent's role and task stage, selects what fits a token budget, and updates the memory as work proceeds. The authors report that selective routing cuts redundant context exposure during execution, trimming cost and runtime while keeping the coordination that shared memory exists for. It treats attention as a budget, which, for systems billed by the token, it literally is.

Catalog record

CREATORJun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqin Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu Zhao, Xue Lin, Dong Huang, Yanzhi Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04903

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory Jun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqin Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu Zhao, Xue Lin, Dong Huang, Yanzhi Wang Abstract Multi-agent large language model (LLM) systems have shown strong potential in complex reasoning and collaborative decision-making tasks. However, most existing coordination schemes rely on static or full-context routing strategies, which lead to excessive token consumption, redundant memory exposure, and limited adaptability across interaction rounds. We introduce RCR-Router , a modular and role-aware context routing framework designed to enable efficient, adaptive collaboration in multi-agent LLMs. To our knowledge, this is the first routing approach that dynamically selects semantically relevant memory subsets for each agent based on its role and task stage, while adhering to a strict token budget. A lightweight scoring policy guides memory selection, and agent outputs are iteratively integrated into a shared memory store to facilitate progressive context refinement. To better evaluate model behavior, we further propose an Answer Quality Score metric that captures LLM-generated explanations beyond standard QA accuracy. Experiments on three multi-hop QA benchmarks—HotPotQA, MuSiQue, and 2WikiMultihop—demonstrate that RCR-Router reduces token usage (up to 30%) while improving or maintaining answer quality. These results highlight the importance of structured memory routing and output-aware evaluation in advancing scalable multi-agent LLM systems. We will release code upon acceptance. Introduction Large Language Models (LLMs) ( Team et al. 2023 ; Touvron et al. 2023 ; Chiang, Li et al. 2023 ; Liu et al. 2024a ; Lu et al. 2024 ) have achieved impressive results across a wide range of tasks, from language understanding to multi-step reasoning. Recently, multi-agent LLM systems ( Wu et al. 2023 ; Han et al. 2024 ; Ye et al. 2025 ; Krishnan 2025 ) —compositions of specialized LLM agents cooperating over shared tasks—have emerged as a promising paradigm for complex, open-ended problem solving. By assigning different roles (e.g., planner, searcher, summarizer) to agents and allowing them to interact over structured workflows, these systems can better leverage modularity, specialization, and iterative reasoning. Despite recent progress, current multi-agent LLM architectures ( crewai 2025 ; Wu et al. 2023 ; Chase 2024 ; Elovic 2025 ; Gao et al. 2025 ) still rely on relatively simplistic context management strategies. Two commonly adopted approaches in existing systems are static routing ( Chase 2024 ; Gao et al. 2024 ; Ye et al. 2025 ) , which assigns each agent a fixed set of inputs based on predefined templates, and full-context routing ( crewai 2025 ; Wu et al. 2023 ; Hong et al. 2023 ) , which provides complete memory or interaction history to all agents at each step. Although these methods are simple to implement and have shown some effectiveness, they also exhibit critical limitations: excessive token consumption ( Liu et al. 2025a ; Li et al. 2025a ; Liu et al. 2025b ; Zhang et al. 2025 ; Kong et al. 2025 ) , redundant or irrelevant information processing ( Liu et al. 2025c ; Ji et al. 2025 ; Niu et al. 2025 ; Yang et al. 2025 ) , and poor adaptability to evolving task requirements ( Liu et al. 2024b ; Yuan et al. 2022 ; Liu et al. 2023a ) . These issues become increasingly problematic as multi-agent reasoning tasks grow in scale and complexity, ultimately impairing the overall coordination quality and system efficiency. To address these challenges, we introduce RCR-Router , a role-aware and context-efficient routing mechanism tailored for multi-agent LLM systems. RCR-Router employs a structured memory layer that stores agents’ intermediate outputs across interaction rounds and dynamically routes context to each agent based on its functional role and the current task stage . This enables agents to focus on semantically relevant information while avoiding redundant input exposure. The routing policy \pi_{\text{route}} is lightweight and modular, supporting both heuristic and learnable variants, and the overall architecture seamlessly integrates with existing multi-agent LLM workflows. Table 1: Comparison of Routing Strategies. Abbreviations: Dynamic = Dynamic Memory, Role-Aw. = Role-Aware, Tok. Budg. = Token Budgeted. Routing Dynamic Role-Aw. Tok. Budg. Full-Context ✗ ✗ ✗ Static Routing ✗ ✓ ✗ RCR (Ours) ✓ ✓ ✓ We summarize the conceptual differences between our method and standard routing paradigms in Table 1 . While existing systems support multi-agent composition and interaction, they lack structured or dynamic memory routing and do not enforce token-level context budgeting. Our contributions are as follows: • We propose RCR-router , a lightweight, modular routing strategy for multi-agent LLM systems, enabling context selection that improves answer quality and reduces token usage across multiple benchmarks. • We design an iterative routing mechanism with feedback , which allows agents to exchange structured output, update shared memory, and progressively refine their contextual understanding throughout multiple interactions. • We formalize role-aware and task-stage-aware routing policies , supporting both heuristic and learned approaches, with role-specific token budget constraints. • We conduct extensive experiments on multi-agent benchmarks (HotPotQA ( Yang et al. 2018 ) , MuSiQue ( Trivedi et al. 2022 ) , 2wikimultihop ( Ho et al. 2020 ) ), demonstrating that RCR-router reduces token consumption by 25–47% across benchmarks without compromising performance. Our results highlight that efficient and adaptive context management is essential for scaling multi-agent LLM systems , and that semantic-aware routing offers a principled and practical solution to this emerging challenge. The Proposed Method Problem Formulation We consider a multi-agent LLM system composed of N collaborative agents \mathcal{A}=\{A_{1},A_{2},\dots,A_{N}\} interacting over a shared task. Each agent A_{i} operates with a specific role R_{i} (e.g., Planner, Searcher, Recommender) and interacts with other agents and external tools in discrete interaction rounds t=1,2,\dots,T . At each round t , agents exchange messages and perform reasoning based on a Shared Memory Store M_{t} , which contains: • Agent interaction history : prior communication between agents; • Task-relevant knowledge : external facts, retrieved documents, or tool outputs; • Structured state representations : entities, plans, and tool traces encoded in structured formats (YAML, graphs, tables). Each agent A_{i} receives as input a routed context C_{t}^{i}\subseteq M_{t} , which is selected by a centralized RCR-router according to the agent’s role R_{i} ; the current task stage S_{t} ; and a token budget B_{i} allocated to the agent. Our framework supports a broader set of roles to address various task requirements; see the detailed example in Appendix D. Each agent A_{i} then performs an LLM Query based on its routed context C_{t}^{i} : LLM\_output^{i}_{t}=LLM(\text{Prompt}(C_{t}^{i})), (1) The global objective of the system is to maximize collaborative task success while minimizing cumulative token consumption across all agents and rounds: \max_{\pi_{\text{route}}}\ \mathbb{E}\left[\text{TaskSuccess}-\lambda\cdot\sum_{t=1}^{T}\sum_{i=1}^{N}\text{TokenCost}(C_{t}^{i})\right], (2) where \lambda is a tunable hyperparameter balancing task performance and efficiency. This formulation enables RCR-router to perform adaptive, role-aware, and resource-efficient context routing, which we show in Section Experiments leads to significant improvements in multi-agent LLM system performance. RCR-router: Role-Aware Context Routing with Semantic Abstraction Context Routing Framework. We name our architecture RCR-router to highlight its role-aware and modular context routing mechanism that governs how information is dynamically delivered to agents and how agent outputs contribute to shared memory. While we do not define a standalone protocol specification, RCR-router embodies a structured

Read the complete text