SEMA-RAG: A Self-Evolving Multi-Agent Retrieval-Augmented Generation Framework for Medical Reasoning

Yongfeng Huang, Ruiying Chen, James Cheng · 2026

Read SEMA-RAG: A Self-Evolving Multi-Agent Retrieval-Augmented Generation Framework for Medical Reasoning by Yongfeng Huang, Ruiying Chen, James Cheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17101.txt.

Introduction

Huang, Chen and Cheng rebuild medical question answering around three specialist agents instead of one overloaded chain. An interpreter reads the clinical question, an explorer gathers evidence in rounds until it is enough, and an arbiter weighs the evidence and picks the answer. Splitting the jobs fixes weak question reading and one-shot retrieval. Across five test sets and five language models, the system beats the best baseline by over six points on average.

Catalog record

CREATORYongfeng Huang, Ruiying Chen, James Cheng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54067
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17101

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SEMA-RAG: A Self-Evolving Multi-Agent Retrieval-Augmented Generation Framework for Medical Reasoning Yongfeng Huang, Ruiying Chen, James Cheng Abstract Retrieval-Augmented Generation (RAG) is widely employed to mitigate risks such as hallucinations and knowledge obsolescence in medical question answering, yet its predominantly single-round, static retrieval paradigm misaligns with the multi-stage process of clinical reasoning. This compressed workflow induces two structural deficiencies: question-to-query translation often lacks clinically grounded semantic interpretation, and retrieval lacks iterative sufficiency feedback, making it difficult to form reliable evidence chains. We argue that both issues stem from a deeper cause—overloading a single reasoning chain with heterogeneous tasks of interpretation, exploration, and adjudication—and that the remedy is to reconstruct the workflow via task decoupling and dynamic multi-round exploration. To this end, we propose SEMA-RAG , a S elf- E volving M ulti- A gent RAG framework for medical question answering, which assigns these roles to three specialist agents: the Interpreter Agent for clinical schema interpretation, the Explorer Agent for sufficiency-driven self-evolving retrieval, and the Arbiter Agent for evidence adjudication and answer selection. Across five benchmarks and five LLM backbones, SEMA-RAG improves the strongest baseline by +6.46 accuracy points on average, measured per backbone. 1 Introduction In recent years, large language models (LLMs) have shown specific capabilities in understanding and reasoning about medical knowledge when applied in healthcare 21 ; 30 . However, they remain prone to hallucinations and outdated information in high-stakes clinical settings 31 ; 33 . Retrieval-Augmented Generation (RAG), which incorporates external authoritative evidence to support the generation process, has been widely adopted to mitigate these risks 22 . (%) 84.3 77.0 64.5 50.8 78.3 86.5 83.3 70.3 56.3 83.1 MMLU MedQA-US MedMCQA PubMedQA* BioASQ 50 60 70 80 90 Average Best Baseline SEMA-RAG Figure 1: Benchmark-level accuracy averaged over five LLM backbones. However, standard RAG frameworks typically treat retrieval as a static, single-round auxiliary step, misaligning with the multi-stage process of clinical reasoning: clinicians often first interpret patient narratives as searchable clinical questions, then progressively gather and verify information to address evidence gaps, and weigh and integrate redundant or contradictory evidence to ultimately form judgments based on relatively robust evidence 26 ; 52 . In contrast, single-round static RAG compresses this process into a single retrieval and generation step. This is akin to requiring clinicians to simultaneously analyze, retrieve, evaluate, and diagnose immediately upon receiving initial medical records, without adjusting their reasoning as new evidence emerges. This typically leads to two structural flaws: (i) the translation from question to query lacks clinical semantic interpretation , making implicit constraints difficult to articulate explicitly 36 ; and (ii) the retrieval process lacks mechanisms for sufficiency assessment and feedback , hindering self-evolving iterative convergence under insufficient evidence and thus weakening reliable evidence-chain formation 29 ; 34 . These shortcomings, we argue, are not independent issues but rather symptoms of a deeper problem: overloading heterogeneous tasks into a single reasoning chain . When question interpretation, evidence exploration, and answer adjudication are tightly coupled, the cognitive load increases and the steps become interdependent, making it hard for the model to promptly adjust retrieval and reasoning when evidence is insufficient or conflicting 44 ; 27 . Thus, the key is not to intensify single-round reasoning, but to restructure RAG to better match the phased clinical workflow by extending single-round queries into multi-round iterative exploration. After each retrieval round, the system evaluates whether the evidence covers key constraints and then chooses the next action: terminate exploration and proceed to decision integration if sufficient, or generate targeted follow-up queries to fill gaps if insufficient. This mechanism, which continuously updates the direction of queries and retrieval based on the evaluation results of each round, enables the system to adjust and converge as evidence accumulates progressively. In this sense, the process constitutes a form of intra-test-time self-evolution , in which the system adaptively updates its query and retrieval trajectory during task execution while remaining tightly coupled to the current problem instance 6 . For simplicity, we use the term "self-evolving" in the remainder of the paper to refer to this intra-test-time setting. To this end, we propose SEMA-RAG ( S elf- E volving M ulti- A gent RAG). This framework simulates clinical workflows through task decoupling and role specialization, decomposing complex clinical reasoning into three collaborative modules: Interpreter Agent (I-Agent) maps unstructured inputs to structured clinical semantics; Explorer Agent (E-Agent) implements self-evolving, evidence-sufficiency-driven retrieval for convergent exploration; Arbiter Agent (A-Agent) performs comprehensive adjudication based on closed-loop evidence. We evaluate SEMA-RAG on five medical question-answering benchmarks. As shown in Figure 1 , SEMA-RAG consistently outperforms representative baselines in terms of average accuracy on each benchmark when averaged over multiple underlying LLMs. Across five benchmarks and five LLM backbones, it improves the strongest baseline by an average of +6.46 accuracy points, validating convergent evidence-chain construction via task decoupling, role specialization, and evidence sufficiency-driven self-evolving retrieval. Our main contributions are as follows: • We propose SEMA-RAG , a multi-agent RAG framework for medical question answering, which models clinical reasoning processes via role division and collaboration. • We develop a self-evolving Explorer Agent that updates queries based on evidence gaps, steering retrieval toward medical reasoning objectives. • We validate SEMA-RAG on five medical Q&A benchmarks across multiple underlying LLMs, achieving consistent improvements over baselines. Figure 2: Overview of SEMA-RAG : (i) I-Agent structures the input question Q into a clinical schema tuple Q^{\prime} for retrieval; (ii) E-Agent conducts sufficiency-driven self-evolving multi-round retrieval to obtain a converged evidence set C^{*} ; (iii) A-Agent adjudicates evidence into a traceable report R and selects the final answer grounded in R . 2 Preliminaries 2.1 Task Formulation of Medical RAG Given a medical question Q , the system selects the final answer \tilde{y} from the discrete candidate set \mathcal{Y} ( y\in\mathcal{Y} ). Under question-only retrieval conditions, the system may only retrieve evidence from the medical corpus \mathcal{C} . The core RAG consists of a retrieval operator \mathrm{Ret}(\cdot) and a generation operator: C=\mathrm{Ret}(Q) , and predicts accordingly: \tilde{y}=\arg\max_{y\in\mathcal{Y}}p(y\mid Q,C). 2.2 Multi-Agent Roles and Abstraction We employ role-based division of labor, with three agents collaborating to complete the medical question answering process: I-Agent handles question interpretation, E-Agent manages evidence exploration, and A-Agent oversees answer adjudication. Three agents share the same underlying language model, differentiated solely by role-specific prompts. We denote the output of the shared LLM conditioned on a role prompt Pmt_{r} and an input X as \mathrm{Agent}_{r}(Pmt_{r},X) , where X may be a set containing multiple elements. 3 Method Figure 2 illustrates the overall SEMA-RAG framework, which comprises three role-based agents with responsibilities described below. 3.1 I-Agent as a Question Interpreter I-Agent does not merely rephrase the input medical question Q ; instead, it semantically structures Q and projects it onto an explicit Clinical Schema . This process externalizes latent clinical intent and key constraints, providing stable anchors for subsequent retrieval and reasoning. Specifically, I-Agent produces a clinical schema tuple Q^{\prime} with four components: (i) clinical intent o_{\mathrm{int}} , describing the implied task type (e.g., diagnosis, treatment, dosage); (ii) medical entities o_{\mathrm{ent}} , identifying core medical objects (e.g., diseases, drugs); (iii) clinical constraints o_{\mathrm{cons}} , specifying applicability conditions (e.g., pregnant, renal impairment, adult); and (iv) an initial retrieval query q_{\mathrm{init}} , a concise, search-oriented question distilled from

Read the complete text