An AI agent for treatment reasoning over a biomedical tool universe

Shanghua Gao 1, Ayush Noori 1,2,3, Richard Zhu 1, Curtis Ginder 1,4, Zhenglun Kong 1, Xiaorui Su 1, Justin Kauffman 5, Benjamin S. Glicksberg 5,6,7, Joshua Lampert 5,6,8, Ankit Sakhuja 5,9,10, Ashwin Sawant 5,9,11, ATHENA-R1 Evaluation Consortium 12, David A. Clifton 2,13, Noa Dagan 3,14,15, Ran Balicer 3,14,16, Marinka Zitnik 1,3,17,18,19,† 1 Department of Biomedical Informatics, Harvard Medical School, Boston, MA 2 Department of Engineering Science, University of Oxford, Oxford, UK 3 The Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard Medical School and Clalit Research Institute, Boston, MA, USA 4 Cardiovascular Division, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 5 The Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA 6 The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai and Mount Sinai Health System, New York City, NY, USA 7 Mindich Child Health and Development Institute and the Departments of Pediatrics and Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA 8 Mount Sinai Fuster Heart Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA 9 Mount Sinai AI Assurance Lab, Mount Sinai Health System, New York, NY, USA 10 Institute for Critical Care Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 11 Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 12 ATHENA-R1 Evaluation Group (the list of members and their affiliations appears in the Supplementary Information) 13 Oxford Suzhou Centre for Advanced Research, University of Oxford, Suzhou, Jiangsu, China 14 Clalit Research Institute, Innovation Division, Clalit Health Services, Ramat Gan, Israel 15 Faculty of Computer and Information Science, Ben Gurion University of the Negev, Be’er Sheva, Israel 16 Faculty of Health Sciences, School of Public Health, Ben Gurion University of the Negev, Be’er Sheva, Israel 17 Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA 18 Broad Institute of MIT and Harvard, Cambridge, MA 19 Harvard Data Science Initiative, Cambridge, MA † Correspondence: [email protected] · 2026

Read An AI agent for treatment reasoning over a biomedical tool universe by Shanghua Gao 1, Ayush Noori 1,2,3, Richard Zhu 1, Curtis Ginder 1,4, Zhenglun Kong 1, Xiaorui Su 1, Justin Kauffman 5, Benjamin S. Glicksberg 5,6,7, Joshua Lampert 5,6,8, Ankit Sakhuja 5,9,10, Ashwin Sawant 5,9,11, ATHENA-R1 Evaluation Consortium 12, David A. Clifton 2,13, Noa Dagan 3,14,15, Ran Balicer 3,14,16, Marinka Zitnik 1,3,17,18,19,† 1 Department of Biomedical Informatics, Harvard Medical School, Boston, MA 2 Department of Engineering Science, University of Oxford, Oxford, UK 3 The Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard Medical School and Clalit Research Institute, Boston, MA, USA 4 Cardiovascular Division, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 5 The Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA 6 The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai and Mount Sinai Health System, New York City, NY, USA 7 Mindich Child Health and Development Institute and the Departments of Pediatrics and Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA 8 Mount Sinai Fuster Heart Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA 9 Mount Sinai AI Assurance Lab, Mount Sinai Health System, New York, NY, USA 10 Institute for Critical Care Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 11 Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 12 ATHENA-R1 Evaluation Group (the list of members and their affiliations appears in the Supplementary Information) 13 Oxford Suzhou Centre for Advanced Research, University of Oxford, Suzhou, Jiangsu, China 14 Clalit Research Institute, Innovation Division, Clalit Health Services, Ramat Gan, Israel 15 Faculty of Computer and Information Science, Ben Gurion University of the Negev, Be’er Sheva, Israel 16 Faculty of Health Sciences, School of Public Health, Ben Gurion University of the Negev, Be’er Sheva, Israel 17 Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA 18 Broad Institute of MIT and Harvard, Cambridge, MA 19 Harvard Data Science Initiative, Cambridge, MA † Correspondence: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28692.txt.

Introduction

Shanghua Gao, Ayush Noori, Richard Zhu, and colleagues, together with the ATHENA-R1 Evaluation Consortium, built an artificial intelligence agent. It reasons about treatments the way a careful clinician must: by gathering evidence before concluding. Choosing a therapy means integrating disease context, other conditions, current medications, contraindications, and fast-moving biomedical knowledge, then revising as facts arrive.

Their agent works over a universe of two hundred twelve biomedical tools covering every drug the United States has approved since 1939. A two-level self-learning scheme first has multi-agent systems manufacture tools, tasks, and reasoning traces for supervised training. Then reinforcement learning with scientific feedback rewards good evidence gathering and non-redundant logic. Across thousands of drug reasoning tasks it reached accuracy in the mid-nineties, beating a leading frontier model by wide margins, and physicians rated it favorably on complex hospital cases.

Catalog record

CREATORShanghua Gao 1, Ayush Noori 1,2,3, Richard Zhu 1, Curtis Ginder 1,4, Zhenglun Kong 1, Xiaorui Su 1, Justin Kauffman 5, Benjamin S. Glicksberg 5,6,7, Joshua Lampert 5,6,8, Ankit Sakhuja 5,9,10, Ashwin Sawant 5,9,11, ATHENA-R1 Evaluation Consortium 12, David A. Clifton 2,13, Noa Dagan 3,14,15, Ran Balicer 3,14,16, Marinka Zitnik 1,3,17,18,19,† 1 Department of Biomedical Informatics, Harvard Medical School, Boston, MA 2 Department of Engineering Science, University of Oxford, Oxford, UK 3 The Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard Medical School and Clalit Research Institute, Boston, MA, USA 4 Cardiovascular Division, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 5 The Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA 6 The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai and Mount Sinai Health System, New York City, NY, USA 7 Mindich Child Health and Development Institute and the Departments of Pediatrics and Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA 8 Mount Sinai Fuster Heart Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA 9 Mount Sinai AI Assurance Lab, Mount Sinai Health System, New York, NY, USA 10 Institute for Critical Care Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 11 Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 12 ATHENA-R1 Evaluation Group (the list of members and their affiliations appears in the Supplementary Information) 13 Oxford Suzhou Centre for Advanced Research, University of Oxford, Suzhou, Jiangsu, China 14 Clalit Research Institute, Innovation Division, Clalit Health Services, Ramat Gan, Israel 15 Faculty of Computer and Information Science, Ben Gurion University of the Negev, Be’er Sheva, Israel 16 Faculty of Health Sciences, School of Public Health, Ben Gurion University of the Negev, Be’er Sheva, Israel 17 Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA 18 Broad Institute of MIT and Harvard, Cambridge, MA 19 Harvard Data Science Initiative, Cambridge, MA † Correspondence: [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.28692

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An AI agent for treatment reasoning over a biomedical tool universe Shanghua Gao 1, Ayush Noori 1,2,3, Richard Zhu 1, Curtis Ginder 1,4, Zhenglun Kong 1, Xiaorui Su 1, Justin Kauffman 5, Benjamin S. Glicksberg 5,6,7, Joshua Lampert 5,6,8, Ankit Sakhuja 5,9,10, Ashwin Sawant 5,9,11, ATHENA-R1 Evaluation Consortium 12, David A. Clifton 2,13, Noa Dagan 3,14,15, Ran Balicer 3,14,16, Marinka Zitnik 1,3,17,18,19,† 1 Department of Biomedical Informatics, Harvard Medical School, Boston, MA 2 Department of Engineering Science, University of Oxford, Oxford, UK 3 The Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard Medical School and Clalit Research Institute, Boston, MA, USA 4 Cardiovascular Division, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 5 The Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA 6 The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai and Mount Sinai Health System, New York City, NY, USA 7 Mindich Child Health and Development Institute and the Departments of Pediatrics and Genetics & Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA 8 Mount Sinai Fuster Heart Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA 9 Mount Sinai AI Assurance Lab, Mount Sinai Health System, New York, NY, USA 10 Institute for Critical Care Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 11 Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA 12 ATHENA-R1 Evaluation Group (the list of members and their affiliations appears in the Supplementary Information) 13 Oxford Suzhou Centre for Advanced Research, University of Oxford, Suzhou, Jiangsu, China 14 Clalit Research Institute, Innovation Division, Clalit Health Services, Ramat Gan, Israel 15 Faculty of Computer and Information Science, Ben Gurion University of the Negev, Be’er Sheva, Israel 16 Faculty of Health Sciences, School of Public Health, Ben Gurion University of the Negev, Be’er Sheva, Israel 17 Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA 18 Broad Institute of MIT and Harvard, Cambridge, MA 19 Harvard Data Science Initiative, Cambridge, MA † Correspondence: [email protected] Abstract Abstract Treatment reasoning underpins every therapeutic decision in medicine, requiring the integration of disease context, comorbidities, concurrent medications, contraindications, and evolving biomedical knowledge to arrive at a therapy appropriate for an individual patient. This process is inherently iterative, as candidate treatments must be evaluated against multiple constraints, revised as new evidence emerges, and grounded in sources that can be inspected and verified. Here we introduce I agent for treatment reasoning across all FDA approved drugs since 1939, trained through reinforcement learning over a universe of 212 biomedical tools. At each reasoning step, tifies missing information, selects and executes relevant tools, and incorporates the retrieved evidence before proceeding. To train out human-annotated reasoning traces, we develop a two-level self-learning framework in which multi-agent systems construct tools, treatment tasks, and reasoning trajectories for supervised fine-tuning, followed by reinforcement learning with scientific feedback using rewards for reasoning quality, including evidence gathering, grounded tool use, and logical non-redundancy, to refine idence-seeking strategy. Across five benchmarks spanning 3,168 drug reasoning tasks and 456 patient treatment cases, erforms language models and tool-use systems. eves 94.7% accuracy on open-ended drug reasoning and 82.9% accuracy on treatment reasoning, exceeding GPT-5 by 17.8 and 10.7 percentage points, respectively. In blinded evaluations involving experts from 28 rare disease organizations, eferred over reference models across all evaluation criteria. Physicians rated rably on complex hospitalized patient cases spanning cardiovascular management and infectious disease. Adverse event hypotheses generated by tested in electronic health records from 5.4 million patients, with predicted associations reaching adjusted odds ratios of 1.48–1.84 and negative controls showing no elevation. These results establish that treatment reasoning, long considered difficult for AI because it requires knowing what evidence to seek before a conclusion can be formed, can be reframed as a learnable process of iterative evidence gathering, and that reinforcement learning can train AI to perform it. Project page | Code | Online Methods | Supplementary Information Main Treatment reasoning is among the most demanding tasks in medicine, where selecting a therapy for an individual patient requires weighing disease context, patient characteristics, concurrent medications, safety constraints, and evolving evidence [ 1 , 2 ] . Unlike fact retrieval or pattern recognition, treatment reasoning is an iterative process in which candidate strategies must be gathered, evaluated against multiple constraints, and revised until the evidence supports a decision. Large language models (LLMs) access medical knowledge through pretraining [ 3 ] , biomedical alignment [ 4 , 5 , 6 , 7 ] , and agentic frameworks [ 8 , 9 ] . These models generate fluent responses and capture broad clinical patterns, but they rely on parametric knowledge stored in model weights, lack access to updated and vetted medical information, and can produce recommendations that fail to account for relevant contraindications, interactions or patient-specific constraints. Retrieval augmented generation [ 10 ] and tool-augmented LLMs [ 11 , 12 , 13 ] can give LLMs access to information outside their model weights, such as medical documents, biomedical databases and software tools, at inference time. However, access to biomedical tools does not by itself produce treatment reasoning. A model must determine what evidence is needed, select the appropriate source, interpret the result in the context of accumulated evidence, and revise its analysis when evidence is incomplete or conflicting. This capacity cannot be assumed from tool access alone and must be learned. We introduce I agent for treatment reasoning that combines multi-step analysis with direct access to medical evidence. Rather than producing answers in a single step, rmines what information is needed, retrieves relevant evidence, and uses that evidence to update its analysis. In each reasoning step, cts from a library of 212 biomedical tools, retrieves information about drugs, diseases and patient populations, interprets the returned evidence, and incorporates it into subsequent reasoning steps. This allows aluate candidate treatments through iterative evidence gathering and analysis rather than relying solely on knowledge stored in model weights. Generating multi-step treatment-reasoning traces at the scale and diversity required for training cannot feasibly be done by human annotators, as each trace must specify what evidence is needed, which tools to call and how retrieved information should be interpreted across hundreds of tools and diverse drug, disease and patient contexts. We therefore train ugh two sequential stages. First, a multi-agent system automatically constructs biomedical tools, treatment tasks and reasoning traces, yielding ATHENA-R1-Instruct , a dataset of 378,027 instruction-tuning samples derived from 85,340 reasoning traces, comprising 177,626 reasoning steps and 281,695 tool calls grounded in all US FDA approved drugs since 1939. After supervised fine-tuning on ATHENA-R1-Instruct , fined through reinforcement learning in a live 212-tool environment, receiving rule-based scientific feedback across six dimensions of reasoning quality, including answer correctness, evidence gathering, multi-step reasoning and tool-use validity. We evaluate ve datasets spanning drug reasoning and patient treatment cases. DrugPC contains 3,168 treatment cases covering 11 treatment tasks, including indications, dosing, safety and pharmacology. BrandPC and GenericPC replace drug names with brand and generic variants, and DescriptionPC replaces names with textual descriptions. TreatmentPC contains 456

Read the complete text