Knowledgeable Language Models as Black-Box Optimizers for Personalized Medicine
Michael S Yao, Osbert Bastani, Alma Andersson, Tommaso Biancalani, Aïcha Bentaieb, Claudia Iriondo · 2025
Read Knowledgeable Language Models as Black-Box Optimizers for Personalized Medicine by Michael S Yao, Osbert Bastani, Alma Andersson, Tommaso Biancalani, Aïcha Bentaieb, Claudia Iriondo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20975.txt.
Introduction
Choosing a treatment for one patient is a search problem where most candidate regimens can never be tested directly. Michael Yao and five co-authors use knowledgeable language models as optimizers for that search in a 2025 paper accepted for ICLR 2026. Surrogate computer models of treatment response often fail on unseen patient-treatment pairs.
The authors hypothesize that domain knowledge, from medical textbooks and biomedical knowledge graphs, gives a better signal of a treatment's promise. Their language-model optimizer proposes and refines regimens using that knowledge as guidance. The model's prior understanding substitutes for blind exploration of a faulty surrogate. At sixty-three pages, the paper develops the method in depth. The aim is personalized medicine that respects both data and established medical knowledge.
Catalog record
| CREATOR | Michael S Yao, Osbert Bastani, Alma Andersson, Tommaso Biancalani, Aïcha Bentaieb, Claudia Iriondo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20975
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Knowledgeable Language Models as Black-Box Optimizers for Personalized Medicine Michael S Yao, Osbert Bastani, Alma Andersson, Tommaso Biancalani, Aïcha Bentaieb, Claudia Iriondo Abstract The goal of personalized medicine is to discover a treatment regimen that optimizes a patient’s clinical outcome based on their personal genetic and environmental factors. However, candidate treatments cannot be arbitrarily administered to the patient to assess their efficacy; we often instead have access to an in silico surrogate model that approximates the true fitness of a proposed treatment. Unfortunately, such surrogate models have been shown to fail to generalize to previously unseen patient-treatment combinations. We hypothesize that domain-specific prior knowledge—such as medical textbooks and biomedical knowledge graphs—can provide a meaningful alternative signal of the fitness of proposed treatments. To this end, we introduce L LM-based E ntropy-guided O ptimization with k N owledgeable priors ( LEON ), a mathematically principled approach to leverage large language models (LLMs) as black-box optimizers without any task-specific fine-tuning, taking advantage of their ability to contextualize unstructured domain knowledge to propose personalized treatment plans in natural language. In practice, we implement LEON via ‘optimization by prompting,’ which uses LLMs as stochastic engines for proposing treatment designs. Experiments on real-world optimization tasks show LEON outperforms both traditional and LLM-based methods in proposing individualized treatments for patients. 1 Introduction Personalized medicine is a clinical strategy that seeks to individualize treatment strategies based on a patient’s unique genetic and environmental features ( biomed-opt-1 ; biomed-opt-2 ; trews ; iwpc ) . Through reasoning about a patient, previously observed patients, and existing medical knowledge and literature, clinicians seek to determine an optimal treatment ( er-reason ) . Such a task can be framed as a conditional optimization problem , where the goal is to design a treatment regimen—conditioned on the patient’s unique features—that optimizes their clinical outcome. However, applying traditional optimization methods in this setting presents significant challenges. First, ground-truth design evaluations are costly ; it is infeasible to assess the efficacy of novel treatment options directly in human subjects. Evaluating newly proposed treatment regimens may therefore be difficult or even impossible. To overcome this limitation, a common approach is to instead leverage feedback from a surrogate for the ground-truth objective, such as a machine learning model or digital twin, to estimate the quality of a proposed treatment for the patient ( digital-twin-3 ; digital-twin-1 ) . However, such surrogate models are frequently imperfect and used on out-of-distribution patients ( digital-twin-2 ) . Certain populations are systematically under-enrolled in clinical studies ( enrollment-1 ; enrollment-2 ; enrollment-3 ; enrollment-4 ; enrollment-5 ) , and so black-box surrogate functions often fail to accurately predict design fitness for different patient populations ( outcomes-1 ; outcomes-2 ; outcomes-3 ; outcomes-5 ) . A natural question is whether designing better surrogate models can overcome these limitations, with the hope that more accurate proxies of the ground-truth objective will yield better optimized therapeutic proposals. For example, digital-twin-3 enforce a physics-based prior on a learned digital twin model, and roma assume the objective is locally smooth over the design space. However, in many real-world applications we cannot specify the surrogate model—the underlying mechanisms behind patient responses to treatment may be under-specified or even entirely unknown ( digital-twin-3 ) , and building accurate digital twin models is often limited by the availability of real patient data and patient privacy concerns ( digital-twin-2 ) . In these settings, we may only think of both the surrogate and underlying ground-truth functions as black-box models . Recent work ( llm-opt-1 ; opro ; llm-opt-3 ; llm-opt-4 ; llm-opt-5 ; llm-opt-6 ) on large language models (LLMs) have explored their emerging capabilities in black-box optimization , where the goal is to propose a design x that maximizes a black-box objective function f(x) . In particular, modern LLMs have been shown to solve zero-shot optimization problems in domains such as mathematics ( nadkarni2021scientific ; alphaevolve ) and computer science ( llm-icl-1 ; llm-icl-2 ; llm-icl-3 ; eureka ) . However, in these settings the objective function is almost always evaluable with minimal cost (i.e., using a code interpreter or formal verification tools)—unlike in clinical patient-centered tasks. Figure 1: L LM-based E ntropy-guided O ptimization with k N owledgeable priors ( LEON ). We use LLMs as zero-shot conditional optimizers to propose personalized treatment designs at the patient level. (a) The LLM is prompted with prior knowledge and the history of previously proposed designs and their predicted scores to (b) propose a new batch of designs. (c) These candidates are evaluated using LEON , and then (d) cached as context to the LLM in subsequent iterations. In this work, we introduce a method to leverage LLMs as black-box optimizers in clinical medicine. Our core hypothesis is that by leveraging domain-specific prior knowledge, LLM-based optimizers can overcome the limitations associated with out-of-distribution surrogate model predictions during optimization. More explicitly, our contributions are as follows: 1. Formulating personalized medicine as a black-box optimization problem. We propose a mathematically principled approach to formulate personalized medicine as a conditional black-box optimization problem, where the goal is to find an optimal treatment strategy conditioned on a set of input patient covariates that optimizes a target outcome metric. 2. Constraining the optimization problem. Existing surrogate models are often imperfect proxies of costly ground-truth objectives in personalized medicine. To overcome this, we introduce a set of intuitive constraints to our initial black-box optimization problem. Our constraints limit the optimization trajectory to treatment designs that (1) are likely to have reliable predictions from the surrogate model; and (2) are consistently proposed by the LLM as high-quality treatments according to relevant domain knowledge. 3. Deriving a solution to the constrained optimization problem. We derive a computationally tractable solution to our proposed re-formulation of personalized medicine as a constrained black-box optimization problem. Our approach fundamentally relies on the statistical analysis of the distribution of proposed designs and the use of an adversarial source critic model during optimization. We refer to our method as L LM-based E ntropy-guided O ptimization with k N owledgeable priors ( LEON ) ( Fig. 1 ). We implement LEON via ‘optimization-by-prompting’ ( opro ) , using the LEON -defined objective to score candidate designs. In this setting, the LLM functions as a stochastic treatment recommendation system that seeks to iteratively propose higher scoring designs. 4. Using LEON to solve real-world personalized medicine tasks. We demonstrate how LEON can be used to solve conditional optimization problems over both discrete and continuous search spaces. Comparing with 10 other baseline methods, we find that LEON achieves an average rank of 1.2 on 5 representative treatment design problems. 2 Related Work LLMs as optimizers. A growing body of work has explored the ability of generalist LLMs to solve domain-specific optimization tasks ( llm-opt-1 ; vlm-opt ; opro ; llm-opt-4 ; llm-opt-6 ) . For instance, llm-opt-3 fine-tune language models for antibody protein design. However, unlike in medicine, accurate molecular dynamic simulations ( md-1 ; md-2 ) , state-of-the-art foundation models ( alphaevolve ; ai2bmd ) , and scalable experimental setups ( alde ; de-1 ; johnston2024 ) have made online optimization methods empirically effective in this domain. Similarly, methods like those introduced by llm-sr ; pie ;