JADE: Bridging the Strategic-Operational Gap in Dynamic Agentic RAG

Yiqun Chen, Erhan Zhang, Tianyi Hu, Shijie Wang, Zixuan Yang, Meizhi Zhong, Xiaochi Wei, Yan Gao, Yi Wu, Yao Hu, Jiaxin Mao · 2026

Read JADE: Bridging the Strategic-Operational Gap in Dynamic Agentic RAG by Yiqun Chen, Erhan Zhang, Tianyi Hu, Shijie Wang, Zixuan Yang, Meizhi Zhong, Xiaochi Wei, Yan Gao, Yi Wu, Yao Hu, Jiaxin Mao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21916.txt.

Introduction

Yiqun Chen and co-authors work on retrieval-augmented generation, where a language model answers using documents it fetches. Modern systems use a central planner that directs multi-step searches. The field is split, though, between two flawed designs.

Some systems train all modules together inside a rigid, fixed graph. Others let the planner roam freely but treat the executing tools as frozen black boxes. The team's 2026 preprint, JADE, aims to bridge that strategic and operational gap in dynamic agentic retrieval. Systems that plan flexibly and still improve their own tools could answer harder questions over larger collections, a need in research, law, and enterprise search.

Catalog record

CREATORYiqun Chen, Erhan Zhang, Tianyi Hu, Shijie Wang, Zixuan Yang, Meizhi Zhong, Xiaochi Wei, Yan Gao, Yi Wu, Yao Hu, Jiaxin Mao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21916

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

JADE: Bridging the Strategic-Operational Gap in Dynamic Agentic RAG Yiqun Chen, Erhan Zhang, Tianyi Hu, Shijie Wang, Zixuan Yang, Meizhi Zhong, Xiaochi Wei, Yan Gao, Yi Wu, Yao Hu, Jiaxin Mao Abstract The evolution of Retrieval-Augmented Generation (RAG) has shifted from static retrieval pipelines to dynamic, agentic workflows where a central planner orchestrates multi-turn reasoning. However, existing paradigms face a critical dichotomy: they either optimize modules jointly within rigid, fixed-graph architectures, or empower dynamic planning while treating executors as frozen, black-box tools. We identify that this decoupled optimization creates a “strategic-operational mismatch,” where sophisticated planning strategies fail to materialize due to unadapted local executors, often leading to negative performance gains despite increased system complexity. In this paper, we propose JADE ( J oint A gentic D ynamic E xecution), a unified framework for the joint optimization of planning and execution within dynamic, multi-turn workflows. By modeling the system as a cooperative multi-agent team unified under a single shared backbone, JADE enables end-to-end learning driven by outcome-based rewards. This approach facilitates co-adaptation : the planner learns to operate within the capability boundaries of the executors, while the executors evolve to align with high-level strategic intent. Empirical results demonstrate that JADE transforms disjoint modules into a synergistic system, yielding remarkable performance improvements via joint optimization and enabling a flexible balance between efficiency and effectiveness through dynamic workflow orchestration. † † affiliationnotice: Equal contribution 1 Introduction Figure 1: Different Paradigms of Agentic RAG The integration of Large Language Models (LLMs) with external knowledge bases has catalyzed a shift from simple Retrieval-Augmented Generation (RAG) to autonomous Agentic RAG ( 24 ) systems. These systems aim to solve knowledge-intensive tasks not merely by retrieving documents, but by actively planning and executing multi-step reasoning trajectories. Despite rapid progress, current approaches struggle to balance architectural flexibility with optimization stability. As illustrated in Figure 1 , existing paradigms comprise three distinct classes, each facing critical limitations that necessitate a new modeling perspective. The first paradigm, Static Joint Optimization (Figure 1 (a)), characterizes early modular RAG systems ( 3 ) . These architectures define a fixed computational graph—typically a linear sequence of Query Rewriting, Document Selection, and Answer Generation. While these modules are optimized jointly to maximize system performance, the rigid topology restricts the agent to a “one-size-fits-all” workflow. Consequently, such systems lack the adaptivity required to decompose complex, multi-hop queries that demand variable reasoning paths. To address this rigidity, the field advanced toward Dynamic Decoupled Optimization (Figure 1 (b)). These methods ( 5 ; 10 ; 19 ) introduce a centralized Planner to dynamically orchestrate workflows. However, these systems adopt a decoupled training strategy: the Planner is optimized to generate high-level plans, while the Executors (e.g., retrievers, readers) are treated as frozen black-box tools. We identify this separation as a source of strategic-operational mismatch . As depicted in Figure 1 (b), the Planner may devise sophisticated strategies that disjoint Executors are ill-equipped to realize, leading to execution failures and suboptimal global performance despite theoretically sound planning. Most recently, unstructured reasoning models like Search-R1 (Figure 1 (c)) have emerged, attempting to fuse planning, search, and answer generation into a single end-to-end stream ( 12 ; 25 ; 26 ; 36 ) . While this removes the constraints of modular architectures, it introduces training instability ( 6 ; 4 ) . The model must simultaneously learn to reason, query noisy search engines, and filter information within a massive context window. Lacking structural priors, the optimization landscape becomes perilous; the agent often struggles to converge, burdened by the cognitive load of managing the entire process of the agentic search implicitly. In this paper, we propose JADE ( J oint A gentic D ynamic E xecution), a unified framework designed to harmonize flexibility and stability. As shown in Figure 1 (d), JADE retains the modular clarity of planner-executors architectures but fundamentally redefines their interaction as a cooperative multi-agent collaboration . Unlike decoupled approaches (Figure 1 (b)), JADE optimizes the Planner and Executors simultaneously via shared parameters within a single LLM backbone driven by sparse global rewards. This Joint Dynamic Optimization fosters co-adaptation: the Planner learns to orchestrate workflows that respect the functional boundaries of the Executors, while the Executors evolve to align with the Planner’s high-level strategic intent. By transforming disjoint modules into a synergistic team, JADE combines the adaptive power of dynamic planning with the convergence stability of joint optimization. Our contributions are summarized as follows: • We introduce JADE 1 1 1 The source code for JADE is available at https://github.com/chenyiqun/JADE. , a novel framework that formulates multi-turn information seeking as a cooperative multi-agent game. By enabling end-to-end gradient flow across the Planner and Executors, JADE bridges the gap between high-level reasoning and low-level execution. • Empirical evaluations demonstrate that JADE establishes a new SOTA on seven benchmarks, effectively balancing computational cost with task effectiveness. Notably, our jointly optimized 7B model outperforms GPT-4o-based decoupled systems, demonstrating that collaborative synergy is more critical than raw model scale for complex reasoning. 2 Related Work From Static RAG to Dynamic RAG. Early Retrieval-Augmented Generation systems typically relied on static retrieval pipelines , where retrieval and generation occur in a fixed, pre-defined sequence. Representative works such as RALM ( 32 ) , LongRAG ( 35 ) , INSTRUCTRAG ( 31 ) , RRR ( 17 ) , and BGM ( 14 ) focus on enhancing specific modules within this static paradigm but lack the flexibility to adjust the retrieval strategy based on query complexity. To address multi-hop reasoning, iterative frameworks introduced interleaved retrieval and generation steps. Approaches like IRCoT ( 29 ) , Self-RAG ( 1 ) , Adaptive RAG ( 9 ) , and ReSP ( 11 ) allow for dynamic loop control or self-reflection. However, these methods primarily rely on heuristic control flows or supervised fine-tuning without employing end-to-end reinforcement learning, limiting their ability to discover globally optimal strategies in complex environments. Optimization Paradigms for Agentic Search Systems. Recent advancements in Agentic Search have adopted Reinforcement Learning (RL) to enhance decision-making, though different paradigms exhibit distinct trade-offs. One dominant approach focuses on decoupled planner optimization . Frameworks such as MAO-ARAG ( 5 ) , S3 ( 10 ) , and AI-SEARCHPLANNER ( 19 ) utilize RL to train a specialized Planner to orchestrate dynamic workflows. By tailoring the reasoning path to the query complexity, these methods allow for an adaptive trade-off between effectiveness and efficiency. However, they treat executors as frozen black boxes, leading to strategic-operational misalignment. Conversely, MMOA-RAG ( 3 ) achieves joint optimization by simultaneously training the Query Rewriter, Document Selector, and Generator using RL. While synergistic, MMOA-RAG is constrained to a fixed, single-turn workflow, restricting its applicability to long-horizon tasks. A third paradigm, exemplified by Search-R1 ( 12 ) and similar methods ( 36 ; 25 ; 26 ) , employs monolithic RL to generate entire reasoning chains and search actions end-to-end. While this reasoning-enhanced, iterative paradigm is highly flexible, the confluence of long-horizon generation, sparse reward signals, and noise introduced by external search engines significantly complicates the optimization landscape of RL training. Consequently, these models often suffer from severe training instability and convergence to suboptimal solutions ( 6 ; 4 ) . JADE synthesizes these approaches by applying

Read the complete text