Large Language Model–Derived Priors Can Improve Bayesian Survival Analyses: A Glioblastoma Application

Richard Evans, PhD, Max Felland, BA, Susanna Evans, BA, Lindsey Sloan, MD, PhD · 2025

Read Large Language Model–Derived Priors Can Improve Bayesian Survival Analyses: A Glioblastoma Application by Richard Evans, PhD, Max Felland, BA, Susanna Evans, BA, Lindsey Sloan, MD, PhD (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01778.txt.

Introduction

Richard Evans, Max Felland, Susanna Evans, and Lindsey Sloan test a shortcut in medical statistics: letting chatbots draft the prior distributions that Bayesian analysis needs. Priors are usually elicited from busy specialists, a slow and unreliable process. Here the test case is survival in glioblastoma, an aggressive brain cancer, comparing two therapies through their hazard ratio.

Three chatbots each proposed two alternative priors for a standard Bayesian survival model fitted to real data. A radiation oncologist evaluated the proposals, and the priors were then used in a sensitivity analysis to check how much the conclusions moved. For this analysis, the AI-generated priors looked sensible and held up as a preferred alternative to expert elicitation, suggesting generative AI can safely speed up a tedious step of trial analysis.

Catalog record

CREATORRichard Evans, PhD, Max Felland, BA, Susanna Evans, BA, Lindsey Sloan, MD, PhD
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE12 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Large Language Model–Derived Priors Can Improve Bayesian Survival Analyses: A Glioblastoma Application Richard Evans, PhD, Max Felland, BA, Susanna Evans, BA, Lindsey Sloan, MD, PhD Abstract This report describes an application of artificial intelligence (AI) to the Bayesian analysis of glioblastoma survival data. It has been suggested that AI can be used to construct prior distributions for parameters in Bayesian models rather than using the difficult, unreliable, and time-consuming process of eliciting expert opinion from radiation oncologists. Here, we show how generative AI can quickly propose sensible prior distributions of the hazard ratio comparing two glioblastoma therapies, for a standard Bayesian survival model on real data. Three Chatbots generated two alternative priors each which were evaluated by a radiation oncologist and then used in a sensitivity analysis to assess posterior stability. The results suggest that, for this cancer survival analysis, priors from generative AI are a preferred alternative method to expert elicitation. CCS CONCEPTS • Computing Methodologies • Artificial Intelligence • Natural language processing Keywords: Bayesian survival analysis, Prior specification, Large Language Models, Oncology 1 Introduction Glioblastoma (GBM) is the most aggressive and common primary malignant brain cancer in adults. Even with medical therapy, only six percent of patients survive to five years. US Senator and former presidential candidate John McCain lived for 13 months post diagnosis, which is consistent with the 12- to 15-month median survival time. It is aggressive and hard to treat. GBMs infiltrate normal brain tissue, precluding surgery, so that radiation and chemotherapy are the primary interventions. Radiation oncologists who treat GBM face an additional challenge—it is not a common cancer overall, so there are relatively few patients available for clinical trials. That means clinical studies are often underpowered in the classical statistical decision-making sense, so that only large effect sizes achieve statistical significance. Whether correct or not, it is common in the medical literature to disregard results with P>0.05 , regardless of the effect size, limiting doctors’ GBM-treating toolkit. A solution to the small sample size problem is a Bayesian analysis, which is different from the frequentist analysis in two ways. First, it asks a different question. The frequentist approach asks, under the null hypothesis of no treatment effects, what is the probability of observing a test statistic at least as extreme as the one observed? In contrast, the Bayesian analysis asks, what is the probability that one treatment is better than another? Second, the Bayesian analysis can readily incorporate information from sources other than the observed data. One common source of additional information is expert opinion, which, for example, might be elicited from a radiation oncologist who treats GBM. However, the challenges of eliciting sensible expert opinion from humans is well documented. There are three categories of reasons that make it difficult to elicit expert opinion. First, humans are often overconfident, overemphasize memorable research or patients, and are anchored in their initial training. Second, they find it hard to translate their knowledge into density parameters. Third, elicitation can be exceptionally time consuming, especially from medical experts, who apart from crowded schedules, need coaching in the language of probabilities and densities. Recently, there has been promising research in using large language models (LLMs) to use data to generate prior distributions. Selby et al. (2024) [ 5 ] evaluated the feasibility of eliciting priors directly from LLMs, showing that their “expert-like” priors can approximate human elicitation, but also exhibit overconfidence and bias. Arai et al. (2025) [ 1 ] demonstrated that LLM-derived priors in hierarchical Bayesian models for adverse event modeling in clinical trials can reduce required sample sizes while maintaining predictive accuracy, perhaps making trials more efficient. Gouk & Gao (2024) [ 2 ] proposed an automated system for Bayesian logistic regression that elicits priors by having an LLM generate synthetic data. Huang (2025) [ 3 ] introduced the LLMPrior framework, which couples an LLM with explicit probabilistic generators (e.g., Gaussian Mixture Models) to ensure mathematically valid priors. Finally, Riegler et al. (2025) [ 4 ] empirically tested ChatGPT-4o, Gemini 2.5, and Claude Opus having them suggest priors for real regression datasets, finding that all captured correct association directions, with Claude yielding balanced priors, while others alternated between over- and under-confidence. We follow this last approach but for a survival model on a small dataset. The main advantages of using LLMs is the speed of “elicitation”, minutes rather than weeks, and the ability of LLMs to (a) summarize medical research (so we know what information they are using) and then (b) to quickly combine medical research results and finally (c) provide them directly in terms of probabilistic objects, such as parametric densities. To say it another way, a LLM can take medical information (e.g., clinical studies) and immediately provide justifiable parameters for a Weibull distribution. A radiation oncologist cannot. The objective of this analysis is to demonstrate the application of LLMs to a Bayesian survival analysis comparing two therapies using real GBM data, and suggest this approach is both an efficient alternative to eliciting information from subject matter experts and provides a more useful method than frequentist analysis of small survival datasets. 2 The Data The data are 28 adult glioblastoma patients. Eight patients underwent conventional radiation therapy (CRT), and twenty underwent hypofractionated radiation therapy (HFRT). CRT is considered the reference therapy. The dataset has three variables: survival time in months (the time to event), a binary event variable, where 1 is death and 0 is a censored observation, and the grouping variable which has values CRT or HFRT. 3 The Model The model was a standard Bayesian Cox model. The setup is z_{i}\in\{0,1\}\text{ indicates group }(0=\text{CRT, }1=\text{HFRT}) t_{i}\text{ is the survival time and }\delta_{i}\in\{0,1\}\text{ is the event indicator.} The hazard is h_{i}(t)=h_{0}(t)\exp(\beta z_{i}). The hazard ration is \text{HR}=\exp(\beta) . Using those equations the partial likelihood is, R(t_{i})=\text{subjects at risk just before }t_{i}. L(\beta)=\prod_{i=1}^{n}\left[\frac{\exp(\beta z_{i})}{\sum_{j\in R(t_{i})}\exp(\beta z_{j})}\right]^{\delta_{i}} Finally, the posterior distribution of \beta is, p(\beta|D)\propto L(\beta)p(\beta), (1) where D is the data. Equation (1) was then evaluated using R (4.4.1) with brms (2.23.0), which fits Bayesian multi-level models using stan (2.37) on the backend. 4 The Priors Equation (1) is of primary interest because that is where the LLM-generated priors enter the model. We set \beta\sim N(\mu,\sigma^{2}) because frequentist estimates of \beta are asymptotically normal. Finally, \exp(\beta)\sim\text{LogNormal}(\mu,\sigma^{2}) The term \text{LogNormal}(\mu,\sigma^{2}) is shorthand for: “A random variable whose logarithm is \text{Normal}(\mu,\sigma^{2}) .” The Chatbot responses are summarized in Table 1 . Table 1: AI-Generated Priors for the HR Source Prior Type LogNormal (HR scale) Notes ChatGPT Informative HR \sim LogNormal( \mu=0.431 , \sigma=0.30 ) Median HR \approx 1.54, 95% HR \approx (0.85, 2.77) Non-informative HR \sim LogNormal( \mu=0 , \sigma=1 ) Median HR = 1.0, 95% HR \approx (0.14, 7.1) Gemini Informative HR \sim LogNormal( \mu=0.095 , \sigma=0.18 ) Median HR \approx 1.10, 95% HR \approx (0.77, 1.57) Non-informative HR \sim LogNormal( \mu=0 , \sigma=2 ) Median HR = 1.0, 95% HR \approx (0.02, 50.4) Grok Informative HR \sim LogNormal( \mu=0.068 , \sigma=0.093 ) Median HR \approx 1.07, 95% HR \approx (0.89, 1.28) Non-informative HR \sim LogNormal( \mu=0 , \sigma=31.62 ) Median HR = 1.0, diffuse Figure 1: LLM prior distributions for the HR. Blue curves are the informative priors, Reddish curves are the non-informative priors.

Read the complete text