TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning

Junkai Li, Yunghwei Lai, Tianyi Zhu, Zheng Long Lee, Weizhi Ma, Yang Liu · 2026

Read TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning by Junkai Li, Yunghwei Lai, Tianyi Zhu, Zheng Long Lee, Weizhi Ma, Yang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05963.txt.

Introduction

Junkai Li and five co-authors present an agent system for drafting medical treatment plans. Large language models often answer in one shot, with no check step, which can leave plans rough, incomplete, or unsafe. Real clinicians instead draft, judge, and revise their plans in rounds.

TheraAgent copies that loop with a generate, judge, and refine pipeline. A special judge module, TheraJudge, sits inside the loop and enforces clinical standards on each draft. The authors report top results on the HealthBench benchmark for accuracy and completeness. In expert evaluations, its plans won against physicians in 86 percent of comparisons, with strong marks for targeting and harm control.

Catalog record

CREATORJunkai Li, Yunghwei Lai, Tianyi Zhu, Zheng Long Lee, Weizhi Ma, Yang Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05963

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning Junkai Li, Yunghwei Lai, Tianyi Zhu, Zheng Long Lee, Weizhi Ma, Yang Liu Abstract Formulating a treatment plan is inherently a complex reasoning and refinement task rather than a simple generation problem. However, existing large language models (LLMs) mainly rely on one-shot output without explicit verification, which may result in rough, incomplete, and potentially unsafe treatment plans. To address these limitations, we propose TheraAgent , an agentic framework that replaces one-shot generation with an iterative generate-reflect-refine pipeline. Inspired by the iterative revision patterns commonly observed in expert clinical practice, our framework progressively reflects on clinical criteria and transforms coarse drafts into precise, comprehensive and safer therapeutic regimens. To facilitate the critical reflection component, we introduce TheraJudge , a treatment-specific evaluation module integrated into the inference loop. Experiments show TheraAgent achieves state-of-the-art results on HealthBench in treatment planning task, leading in Accuracy and Completeness. In expert evaluations, it attains an 86% win rate against physicians, with superior Targeting and Harm Control. Moreover, the high consistency between TheraJudge and HealthBench evaluation indicates the reliability of our framework. 1 Introduction Figure 1: Comparison of treatment plan generation scenarios. (a) General-purpose models frequently produce suboptimal treatment plans, characterized by imprecise information, omitted key components, and potential safety risks. (b) TheraAgent mitigates these limitations by generating more accurate, comprehensive, and clinically reliable plans, with expert-validated annotations. Treatment planning is a critical part in real-world medical decision-making, where physicians translate diagnostic conclusions into concrete therapeutic actions to optimize patient outcomes 26 . It is inherently challenging, as we hypothesize that, rather than relying solely on one-shot generation, effective treatment planning benefits from iterative reasoning and structured refinement, including precise medication selection and dosing, comprehensive therapeutic coverage, and principled harm control 3 . With recent advances in large language models (LLMs), there is growing interest in their potential to support medical tasks, driven by their strong capabilities to incorporate relevant context, perform language comprehension, generate coherent text 28 ; 18 ; 20 ; 33 . However, directly applying general-purpose or even medically fine-tuned LLMs to treatment planning remains challenging 17 . As illustrated in Figure 1 , existing models tend to generate rough, incomplete, and potentially unsafe plans due to their one-shot mechanism without explicit verification. Despite the question, existing research for treatment planning remains limited. Many existing efforts are tailored to specific diseases and thus fail to generalize across clinical departments 16 ; 12 ; 40 ; 21 , while more general approaches often struggle to ensure precision and completeness due to the absence of iterative refinement mechanisms 14 ; 38 . Furthermore, the evaluation of treatment plans frequently rely on oversimplified metrics (e.g., BLEU) or vanilla LLM-based scores that overlook critical dimensions 10 ; 11 . To bridge these gaps, we propose TheraAgent , an agentic framework that regards treatment planning as an iterative generate–reflect–refine process. Inspired by the iterative revision patterns commonly observed in expert clinical practice, TheraAgent enables continuous self-correction and progressive improvement, leading to more precise, complete, and safer treatment plans. To support this process without costly human intervention, we introduce TheraJudge , a treatment-specific evaluation module, which aligns automated feedback with clinical criteria by assessing plans on dimensions including accuracy, targeting, completeness, and safety. We evaluate TheraAgent on treatment-related cases in HealthBench 2 , achieving a state-of-the-art overall score and obtains the highest scores on Accuracy and Completeness, exceeding the second-best model by 2.91 points and 4.43 points. Its effectiveness is further shown in blinded medical expert evaluations on real-world clinical cases, where TheraAgent achieves an 86% win rate against human physicians, with marked win rate of 69% in Targeting, 71% in Completeness, and 51% in Harm Control. We further conduct an agreement analysis between TheraJudge and HealthBench evaluation, where TheraJudge achieves a Pearson correlation of 0.71, substantially outperforming other automatic metrics. Our contributions are summarized as follows: • We propose TheraAgent , an agentic framework that considers treatment planning as an iterative reasoning process. Its generate–reflect–refine pipeline enables effective self-improvement, yielding more precise, comprehensive, and safer treatment plans. • We introduce TheraJudge , a clinically aligned internal critic within TheraAgent that assesses treatment plans along dimensions such as Accuracy and Completeness . It also shows strong potential as a standalone evaluator for treatment planning, as reflected by its high level of agreement with HealthBench evaluation. • Extensive experiments show that TheraAgent achieves state-of-the-art performance on treatment-related HealthBench cases and attains a dominant 86% win rate against physicians in blinded expert evaluations on real-world cases. Figure 2: Overview of the TheraAgent framework. TheraAgent performs treatment planning through a self-improving inference pipeline. Given a patient case P , the Planner generates a therapeutic regimen T_{k} at iteration k , which is subsequently assessed by TheraJudge that gives multi-dimensional scores using RAG and Few-shots. The generated schedule and its evaluation are incorporated into the Memorizer to form M^{k} , which enables improved retrieval for the Planner in subsequent iterations and guides refined schedules ( T_{k+1} ) through in-context learning. 2 Related Works Treatment Planning Generation Compared to diagnosis-related tasks, research on LLM-based treatment planning remains limited. Existing work includes agent-based or staged generation frameworks aligned with clinical workflows named MedPlan 14 , treatment-specific fine-tuning approaches for therapeutic reasoning named TxAgent 10 , and general medical post-training or test-time optimization methods that improve overall clinical reasoning without explicitly targeting treatment planning named MedCritical 30 and FineMedLM-o1 13 . Prior studies have also examined the evaluation of medical LLMs, typically relying on task-level accuracy or coarse LLM-based scores 29 . Despite these efforts, existing approaches often struggle to produce accurate, complete, and safety-aware treatment regimens, while current evaluation methods remain overly simplified and may fail to capture the multi-dimensional clinical quality required for real-world treatment planning. Self-improving Agent Recent work has demonstrated that agentic and self-improving approaches can improve LLM output quality by enabling iterative refinement. General agent frameworks show that incorporating planning, memory, or reflection leads to more robust and coherent outputs 15 ; 19 ; 34 ; 36 ; 39 . In the medical domain, agent-based systems similarly improve reliability and quality through feedback-guided workflows, primarily for diagnosis tasks 27 ; 8 . Complementary studies on multi-agent evaluation further support iterative refinement as an effective mechanism for assessing and improving reasoning quality 42 . However, these methods are largely designed for general-purpose reasoning or diagnosis tasks, and have not been adapted to the treatment planning setting. Consequently, the application of self-improving agents to generating and refining precise and complete treatment plans remains underexplored. 3 Problem Formulation Given a patient case \mathbf{P}=(\mathbf{d},\mathbf{s},\mathbf{y}), where \mathbf{d} denotes basic clinical information, \mathbf{s} denotes symptoms and clinical findings, and \mathbf{y} denotes the confirmed diagnosis, the goal of treatment planning is to generate a treatment plan \mathbf{T} along with an explicit reasoning trace \mathbf{c}, such that the resulting plan is clinically interpretable. Unlike closed-form prediction tasks, treatment planning operates over an open-ended and combinatorial action space, where valid solutions must simultaneously satisfy multiple clinical requirements. We characterize the quality of a treatment plan as a multi-dimensional function: Q(\mathbf{T}\mid\mathbf{P})=\sum_{i=1}^{N}q_{i}(\mathbf{T}\mid\mathbf{P}), (1) where each q_{i} corresponds to a clinical dimension, such as Accuracy, Targeting, Completeness, and Harm Control. This formulation highlights the

Read the complete text