Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent
Humza Nusrat, Luke Francisco, Bing Luo, Hassan Bagher-Ebadian, Joshua Kim, Karen Chin-Snyder, Salim Siddiqui, Mira Shah, Eric Mellon, Mohammad Ghassemi, Anthony Doemer, Benjamin Movsas, Kundan Thind · 2025
Read Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent by Humza Nusrat, Luke Francisco, Bing Luo, Hassan Bagher-Ebadian, Joshua Kim, Karen Chin-Snyder, Salim Siddiqui, Mira Shah, Eric Mellon, Mohammad Ghassemi, Anthony Doemer, Benjamin Movsas, Kundan Thind (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20586.txt.
Introduction
Humza Nusrat and a clinical team test whether reasoning makes an AI planner safer for brain radiosurgery. Stereotactic radiosurgery sculpts dose tightly around metastases while sparing structures like the cochlea. Black-box automation has stalled clinically because planners cannot audit it. Their agent, SAGE, plans with a language model in the loop.
Forty-one patients with brain metastases, each treated with a single eighteen-gray fraction, were replanned by reasoning and non-reasoning variants. The reasoning planner matched human dosimetry on coverage, maximum dose, and conformity, while lowering cochlear dose below human benchmarks. Its traces show hundreds of prospective constraint checks and trade-off deliberations, behaviours absent in the standard model. Auditable reasoning, the authors argue, is the road to clinical trust.
Catalog record
| CREATOR | Humza Nusrat, Luke Francisco, Bing Luo, Hassan Bagher-Ebadian, Joshua Kim, Karen Chin-Snyder, Salim Siddiqui, Mira Shah, Eric Mellon, Mohammad Ghassemi, Anthony Doemer, Benjamin Movsas, Kundan Thind |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-20586
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent Humza Nusrat, Luke Francisco, Bing Luo, Hassan Bagher-Ebadian, Joshua Kim, Karen Chin-Snyder, Salim Siddiqui, Mira Shah, Eric Mellon, Mohammad Ghassemi, Anthony Doemer, Benjamin Movsas, Kundan Thind Abstract Stereotactic radiosurgery (SRS) demands precise dose shaping around critical structures, yet black-box AI systems have limited clinical adoption due to opacity concerns. We tested whether chain-of-thought reasoning improves agentic planning in a retrospective cohort of 41 patients with brain metastases treated with 18 Gy single-fraction SRS. We developed SAGE (Secure Agent for Generative Dose Expertise), an LLM-based planning agent for automated SRS treatment planning. Two variants generated plans for each case: one using a non-reasoning model, one using a reasoning model. The reasoning variant showed comparable plan dosimetry relative to human planners on primary endpoints (PTV coverage, maximum dose, conformity index, gradient index; all p p > 0.21) while reducing cochlear dose below human baselines ( p p = 0.022). When prompted to improve conformity, the reasoning model demonstrated systematic planning behaviors including prospective constraint verification (457 instances) and trade-off deliberation (609 instances), while the standard model exhibited none of these deliberative processes (0 and 7 instances, respectively). Content analysis revealed that constraint verification and causal explanation concentrated in the reasoning agent. The optimization traces serve as auditable logs, offering a path toward transparent automated planning. keywords Reasoning model, Radiotherapy planning, Agentic AI 1 Introduction Treatment planning in radiation oncology has grown increasingly complex. A treatment plan consists of a set of instructions generated within a treatment planning system (TPS) that directs the linear accelerator during dose delivery. This task, performed by dosimetrists and medical physicists, requires specialized expertise, substantial time investment, and is subject to variability based on individual planner skill. The degree of complexity varies considerably by tumor site and treatment technique. For conventionally fractionated treatments of anatomically stable sites such as prostate cancer, target volumes are relatively homogeneous and organs at risk occupy predictable positions, facilitating more standardized planning approaches r1 ; r2 . In contrast to this, stereotactic radiosurgery (SRS) for brain metastases represents the opposite end of this spectrum. SRS delivers a large radiation dose to intracranial tumors in a single treatment fraction r3 . The targets are typically brain metastases, which often present with clinical urgency and compressed treatment timelines. Several factors contribute to the technical difficulty of SRS planning: critical OARs in close proximity to targets, the need for steep dose gradients to minimize normal brain exposure, and the extra precision required when the entire prescribed dose is delivered in one session. Given the current shortage of qualified treatment planners r4 ; r5 and the specialized nature of SRS, these treatments are largely confined to large academic medical centers r6 ; r7 . Automated treatment planning using artificial intelligence (AI) offers a potential solution to improve access and reduce workforce burden. Prior work in AI-driven treatment planning has largely relied on neural networks trained on institutional retrospective data for specific tumor sites. Several groups have reported successful implementations of this approach r8 ; r9 ; r10 . However, these methods have notable limitations. They are constrained to the anatomical site and treatment technique represented in the training data. Such systems function as black boxes that offer limited transparency or explainability regarding their optimization decisions r11 ; r12 ; r13 ; r14 ; r15 ; r16 ; r17 ; r18 ; r19 ; r20 ; r21 ; r22 ; r23 . This approach does not scale well across institutions because each implementation remains siloed to the center that performed the development and training. Regulatory frameworks for AI-based medical devices increasingly emphasize interpretability and transparency r24 ; r25 ; r26 ; r27 ; r28 , while surveys of radiation oncology professionals identify explainability as a key determinant of clinical acceptance r29 ; r30 ; r31 . These concerns around model opacity represent substantial barriers to widespread adoption. The application of large language models (LLMs) to radiation oncology is an emerging area of investigation. Published work has primarily focused on retrieval-augmented generation (RAG) for clinical question answering, protocol compliance verification, and knowledge-grounded decision support r32 ; r33 ; r34 . These applications leverage LLMs’ ability to retrieve and synthesize information from clinical guidelines. By contrast, the present work employs LLMs for iterative, reasoning-driven treatment plan optimization, a fundamentally different task requiring spatial reasoning, constraint satisfaction, and forward simulation of dosimetric consequences. This distinction is critical: retrieval-based systems improve reliability by grounding responses in validated knowledge sources, whereas reasoning-based planning requires the model to perform multi-step logical inference over complex geometric and dosimetric trade-offs. To date, all reported LLM-based planning studies have employed non-reasoning models without explicit reasoning capabilities, and none have addressed the geometric complexity of SRS planning where transparent, stepwise reasoning is essential. The present work addresses these gaps. We employ SAGE, a general agentic framework previously validated for prostate cancer planning r35 , and apply it to SRS. We directly compare a reasoning LLM against a non-reasoning LLM within the same planning framework and tasks. We include a mechanistic dialogue analysis that connects model behavior to planning outcomes, providing insight into how reasoning architecture influences optimization strategy. Recent LLM development has produced models optimized for different computational behaviors. While all LLMs fundamentally operate through next-token prediction, some models are specifically trained to generate extended intermediate reasoning steps during inference before producing final outputs. For practical purposes, we refer to these as ”reasoning models” versus ”non-reasoning models,” recognizing this as a behavioral distinction rather than a fundamental architectural dichotomy r36 ; r37 ; r38 . This behavioral difference, at a functional level, resembles Kahneman’s distinction between System 1 (fast, automatic) and System 2 (slow, deliberative) thinking r39 . We stress that this is an analogy drawn from observable behavior; it is not a claim of cognitive equivalence between artificial and human intelligence. Dual-process theory has shaped how clinical medicine understands complex decision-making. System 2 thinking, with its explicit hypothesis testing, constraint checking, and iterative refinement, appears essential for diagnostic and therapeutic tasks that resist pattern-based shortcuts r40 ; r41 ; r42 ; r43 ; r44 ; r45 . SRS planning shares several characteristics with tasks that empirically benefit from deliberative processing: tightly coupled geometric constraints, competing objectives, three-dimensional spatial reasoning. These properties set SRS apart from more stereotyped planning workflows. We hypothesized, given these task characteristics, that SRS planning would particularly benefit from LLM architectures exhibiting deliberative, multi-step reasoning behavior. A second hypothesis followed from the first. Intermediate reasoning traces would serve a dual purpose: improving the model’s spatial reasoning through self-prompting mechanisms documented in 3D reasoning tasks and constituting an auditable decision log. This log, a structured record of constraint verification, trade-off evaluation, and iterative refinement, can be reviewed by human planners, incorporated into quality assurance documentation, and examined in the event of adverse outcomes. 2 Methods 2.1 SAGE architecture The software architecture of SAGE is shown in Figure 1. Upon initialization, the agent receives the clinical scenario (patient anatomy, target volume location and size, spatial relationship between PTV and organs at risk), prescription dose (18 Gy to the PTV in a single fraction), and current state of the optimizer including all dosimetric parameters (DVH