GSEM: Graph-based Self-Evolving Memory for Experience Augmented Clinical Reasoning
Xiao Han, Yuzheng Fan, Sendong Zhao, Haochun Wang, Bing QinResearch Center for Social Computing and Interactive Robotics,Harbin Institute of Technology, China {xhan, yzfan, sdzhao}@ir.hit.edu.cn · 2026
Read GSEM: Graph-based Self-Evolving Memory for Experience Augmented Clinical Reasoning by Xiao Han, Yuzheng Fan, Sendong Zhao, Haochun Wang, Bing QinResearch Center for Social Computing and Interactive Robotics,Harbin Institute of Technology, China {xhan, yzfan, sdzhao}@ir.hit.edu.cn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22096.txt.
Introduction
Han and co-authors propose GSEM, a memory system that helps clinical agents reuse past decisions. Many memory methods store each case as a lone record. GSEM instead arranges cases in a two-layer graph. The graph captures the structure inside each case and the links between cases. Retrieval checks whether a stored case fits the new one. Feedback then recalibrates node quality and edge weights online. On two medical benchmarks, the authors report the best average accuracy among all baselines.
Catalog record
| CREATOR | Xiao Han, Yuzheng Fan, Sendong Zhao, Haochun Wang, Bing QinResearch Center for Social Computing and Interactive Robotics,Harbin Institute of Technology, China {xhan, yzfan, sdzhao}@ir.hit.edu.cn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66670 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22096
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GSEM: Graph-based Self-Evolving Memory for Experience Augmented Clinical Reasoning Xiao Han, Yuzheng Fan, Sendong Zhao, Haochun Wang, Bing QinResearch Center for Social Computing and Interactive Robotics,Harbin Institute of Technology, China {xhan, yzfan, sdzhao}@ir.hit.edu.cn Abstract Clinical decision-making agents can benefit from reusing prior decision experience. However, many memory-augmented methods store experiences as independent records without explicit relational structure, which may introduce noisy retrieval, unreliable reuse, and in some cases even hurt performance compared to direct LLM inference. We propose GSEM ( G raph-based S elf- E volving M emory), a clinical memory framework that organizes clinical experiences into a dual-layer memory graph, capturing both the decision structure within each experience and the relational dependencies across experiences, and supporting applicability-aware retrieval and online feedback-driven calibration of node quality and edge weights. Across MedR-Bench and MedAgentsBench with two LLM backbones, GSEM achieves the highest average accuracy among all baselines, reaching 70.90% and 69.24% with DeepSeek-V3.2 and Qwen3.5-35B, respectively. Code is available at https://github.com/xhan1022/gsem . 2 2 footnotetext: Equal contribution. 1 1 footnotetext: Corresponding author. 1 Introduction LLM agents have demonstrated strong capabilities in medical decision-making, from diagnostic reasoning to multi-step problem solving ( 23 ; 12 ) . Yet real-world clinical deployment involves a continuous stream of high-stakes cases with incomplete information, strong condition dependence, and substantial uncertainty ( 14 ) . In such settings, relying solely on parametric knowledge can be insufficient for adapting to the diverse and condition-specific patterns that emerge across cases. This motivates an explicit experience memory that accumulates prior decision knowledge and supports future cases through targeted retrieval and reuse. Figure 1: Two motivating failure cases of experience-augmented clinical reasoning. Boundary Failure (top): an experience is retrieved based on partial condition match, while critical boundary conditions are ignored. Collaboration Failure (bottom): conflicting experiences without joint-use value are co-retrieved, leading to incoherent guidance for the final decision. A detailed clinical case study is provided in Appendix F . Despite growing interest in agent memory, building experience memory that is both structurally organized and reliably applicable remains challenging. Figure 1 motivates two key challenges for effective experience memory: (i) boundary-aware applicability checking and (ii) relation-aware composition when multiple experiences are used together. Yet many retrieval-augmented pipelines treat applicability implicitly and rely primarily on similarity-based top- k retrieval, leaving applicability boundaries hard to verify ( 2 ; 8 ) . Meanwhile, memory-augmented methods usually store experiences as independent entries ( 26 ) without explicit representations of inter-experience relations, making it difficult to resolve conflicts and identify valid co-use combinations. Moreover, as an agent accumulates experience through deployment, memory reliability and relational structure need to be continuously refined to reflect actual performance; yet modifying experience content risks destabilizing previously validated knowledge, motivating a weight-based calibration mechanism that adapts to deployment outcomes without altering what has been learned. To address these challenges, we propose GSEM , a clinical memory framework that formalizes experiences as indications and contraindications , with Experience Reliability Validation (ERV) calibrating initial quality Q before deployment, and organizes them into a dual-layer memory graph encoding decision structure within each experience and relational dependencies across experiences, with edge weights W quantifying inter-experience association strength. We further propose an applicability-aware retrieval mechanism combining hybrid seed recall with Q and W guided multi-seed graph traversal, recalling experience combinations that satisfy boundary conditions and exhibit coherent joint-use value. After each task, GSEM self-evolves by updating node quality Q and edge weights W based on outcome feedback, refining memory reliability and relational structure without modifying experience content. Experiments with two backbone LLMs show that GSEM consistently outperforms three categories of strong baselines, achieving 70.90% and 69.24% average accuracy with DeepSeek-V3.2 and Qwen3.5-35B respectively, with especially pronounced gains on treatment planning where boundary awareness and multi-step composition matter most. Our contributions can be summarized as follows: (1) We propose GSEM, a graph-based self-evolving memory framework that formalizes clinical experiences as indications and contraindications, organizing them into a dual-layer memory graph capturing both internal decision structure and inter-experience relations. (2) We design an applicability-aware retrieval mechanism combining hybrid seed recall with LLM-guided multi-seed graph traversal, facilitating boundary-aware selection and relation-aware composition of retrieved experiences. (3) We develop a feedback-driven online calibration method that jointly updates experience quality and relational structure over time, and demonstrate consistent improvements on MedR-Bench and MedAgentsBench under two backbone LLMs. 2 Related Work 2.1 Agent Memory Early work treats memory as a managed system resource, paging information between in-context and external memory ( 17 ; 10 ) . MemoryBank ( 31 ) applies an Ebbinghaus forgetting-curve mechanism to selectively reinforce memories, and Mem0 ( 6 ) dynamically extracts and consolidates key facts to support scalable conversational coherence. ExpeL and AWM ( 30 ; 24 ) further enable cross-task insight extraction and workflow-level memory without parameter updates. However, most approaches treat memory items as independent entries, leaving relational structure across experiences largely unmodeled. 2.2 Graph-based Agent Memory Several works build graph-based memory representations via knowledge graphs or episodic edges ( 1 ; 20 ; 15 ) . Others focus on graph-enhanced retrieval using dynamic linking or sentence-level structures ( 26 ; 25 ) . Mem0 g ( 6 ) shows graph augmentation yields particular advantages for temporally grounded and multi-hop queries. G-Memory ( 27 ) introduces hierarchical graph tracing to support simultaneous access to strategic and interaction-level memory. However, these systems offer limited modeling of experience applicability boundaries or inter-experience conflicts. 2.3 Self-Evolving Memory Self-evolving memory enables agents to form and refine memories dynamically from task feedback. Reflexion ( 21 ) established the foundational paradigm of verbal reflection stored in an episodic buffer to induce better decision-making without weight updates. Building on this, a line of work distills reusable strategies from task trajectories in a closed learning loop ( 16 ; 4 ; 3 ) . MemRL ( 29 ) further frames memory evolution as non-parametric reinforcement learning, refining utility estimates over retrieved memories through environmental feedback. MemGen ( 28 ) takes a generative approach, producing latent memories tightly coupled with reasoning. In the medical domain, HealthFlow ( 32 ) applies self-evolving memory to healthcare agents for meta-level strategic planning. Despite these advances, most existing systems operate on flat memory banks without explicit modeling of relationships across experiences. GSEM bridges this gap by jointly proposing graph-organized experience memory, applicability-aware retrieval, and online structural evolution for clinical reasoning. 3 Preliminary 3.1 Task Definition We consider a clinical reasoning agent operating over a sequence of tasks. For each task T_{t} , the agent observes a clinical context x_{t}\in\mathcal{X} , and produces a decision y_{t}\in\mathcal{Y} . The decision function of agent is: y_{t}=\pi(x_{t},\ \mathcal{R}_{t};\,\Theta) (1) where \pi(\cdot;\Theta) is parameterized by \Theta , and \mathcal{R}_{t} is a small set of experiences retrieved from the current memory state \mathcal{M}_{t} that are relevant to x_{t} . After each task, the agent receives a scalar feedback signal and updates \mathcal{M}_{t} to improve future retrieval. 3.2 Experience Definition The atomic unit stored in memory is an experience e_{i} , which encodes reusable decision knowledge. Each experience is formally represented as a tuple: e_{i}=(c_{i},\ s_{i},\ z_{i},\ Q_{i}) (2) where c_{i}\in\mathcal{X}_{c} denotes the applicable condition context of the experience, s_{i}\in\mathcal{X}_{s} denotes the corresponding decision strategy content , z_{i}\in\{\oplus,\ominus\} is a polarity label indicating whether