FRESH: Information-Geometric Calibration of Patient-Level Models to Aggregate Evidence

F. Fuller, D. Bertolini, S. Liang, J. Christopher, A. Smith · 2026

Read FRESH: Information-Geometric Calibration of Patient-Level Models to Aggregate Evidence by F. Fuller, D. Bertolini, S. Liang, J. Christopher, A. Smith (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16246.txt.

Introduction

Fuller and four others present FRESH, a method that tunes patient-level models to pooled evidence such as trial notes and record data. The method retunes a model trained on patient-level data so its outputs match set stats for a target group. The retuning is a minimal tweak of the first joint spread in an information-shape sense. Uses include framing single-arm trials against current standard of care, mocking trial designs, and weighing on-market drugs.

Catalog record

CREATORF. Fuller, D. Bertolini, S. Liang, J. Christopher, A. Smith
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90451
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16246

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FRESH: Information-Geometric Calibration of Patient-Level Models to Aggregate Evidence F. Fuller, D. Bertolini, S. Liang, J. Christopher, A. Smith Abstract This note introduces FRESH (Fusion of Recent Evidence and Subject Histories), a method for incorporating population-level summary results — published clinical trials, registry summaries, prior natural-history studies, and peer-reviewed indirect comparisons — into predictive models trained on patient-level data. This method provides a principled means of combining both patient-level and aggregate-level data types into a unified data-efficient model for clinical decision making. FRESH assumes access to a generative model trained on patient-level data sources (e.g. clinical trial or real-world data). The method produces patient-level predictions from a re-calibrated model that matches a set of specified aggregate statistics for a target population. This can be understood as a patient-level recapitulation of the aggregate source — with the key property that the recalibration is a minimal perturbation of the original joint distribution in a specific information-geometric sense. The resulting samples can be analyzed directly or combined into a post-training procedure to update the original generative model. This approach enables several applications where rigorously incorporating patient level data with summary information is valuable, including: • contextualizing single arm trial results with respect to recent standard-of-care, • clinical trial simulations for design and probability-of-technical success estimation, • comparative effectiveness analyses of on-market therapies. This document first develops the theory and details of the FRESH algorithm. It then demonstrates a key application in simulating a head-to-head comparison in metastatic pancreatic cancer — comparing two first-line standards of care with overlapping labels but no existing randomized head-to-head clinical trial. Here FRESH is used to decompose the published cross-trial overall-survival differences into patient baseline versus treatment-effect contributions, elucidating how much the observed gap is attributable to the patient population differences versus the different therapies themselves. 1 Introduction and motivation Many decision in clinical science and epidemiology — estimating probability of technical success for a clinical trial, assessing comparative effectiveness of two therapies, imputing a placebo effect onto natural history data — rely on combining sources of information about a clinical cohort that comes from different kinds of studies. Specifically we contrast patient-level sources that provide granular pictures of individual disease course (clinical trial, registries, or electronic health records) with aggregate sources such as published clinical trial results and the TFLs (tables figures and listings). One strategy for combining aggregate with patient-level data sources is to bring each into a common format for a unified analysis. If one wants to maintain the analytic flexibility of patient-level data, then a natural solution is to convert the aggregate data information into a simulated patient-level dataset that recapitulate those aggregate statistics. This is an under-determined inverse problem in that there are many such datasets, and it cannot be well specified without further constraints. FRESH (Fusion of Recent Evidence with Subject Histories) provides a well-defined method for solving this problem, and therefore providing maximal analytic flexibility. The approach frames the problem of combining patient-level data with aggregate results as a model calibration procedure. The patient-level source data is represented as a generative model that summarizes the dataset. The aggregate information is then incorporated as a calibration that adapts the model to respect the aggregate constraints according to a minimal perturbation from the original model. Among its strengths, FRESH is highly flexible and imposes few requirements on the generative model and aggregate constraint inputs. The only modeling input FRESH requires is a generative model of the joint distribution of baseline covariates X and outcomes Y — that is, a mechanism for drawing samples (X,Y)\sim p(X)\,p(Y\mathchoice{\,|\,}{\,|\,}{\,|\,}{\,|\,}X) from the joint distribution, together with the ability to evaluate the conditional density p(y\mathchoice{\,|\,}{\,|\,}{\,|\,}{\,|\,}x) . The form and provenance of that generative model are unconstrained: it could be a parametric survival model, a graphical model, or a neural simulator. The aggregate evidence source is generic; it is most often a published randomized controlled trial, but the construction depends only on (a) a description of the target population (eligibility criteria and a table of baseline characteristics) and (b) a list of outcome summary statistics under the regimen of interest. We will refer to “the source” below without committing to its provenance. FRESH comprises two stages, both of which are information projections (§ 3 ) in the sense of Csiszár [ 6 , 7 ] and more specifically versions of entropy balancing (§ 6.1 ) [ 13 , 35 , 34 , 3 ] . Stage 1 constructs a baseline distribution Q^{\ast}(x) — a surrogate for the inaccessible true source baseline marginal — as a weighted empirical measure on samples from the generative model, by entropy balancing against the eligibility set and the source’s reported baseline statistics. Each baseline statistic can be enforced as either a hard constraint (exact matching) or a soft constraint (approximate matching under penalty). Stage 2 perturbs the conditional kernel to K^{\ast}(y\mathchoice{\,|\,}{\,|\,}{\,|\,}{\,|\,}x) , the conditional surrogate, so that the induced outcome marginal under Q^{\ast} matches the source’s outcome statistics. The two stages compose: Stage 1’s weights are passed to Stage 2 unchanged. The contributions of this note are as follows. First, we precisely define both stages of FRESH as I -projections. Second, we present closed-form characterizations of the solutions to the I -projections. Third, we show how to exploit the algebraic structure of the projection in Stage 2 to build a Markov Chain Monte Carlo (MCMC) sampler that never evaluates the reference density. and explore its requirements, advantages and limitations. And fourth, demonstrate the utility of FRESH by simulating a head-to-head comparison of two first-line therapy regimens in metastatic pancreatic cancer. Note that this simulation is intended as a methods demonstration on a real and clinically relevant question, not a fully credentialed ITC of the two therapy regimens. A complete comparative effectiveness analysis would require a fuller exposition of the underlying generative model — training corpus, architecture, goodness-of-fit — which we leave to a separate publication. This note is organized as follows. In § 2 we precisely define the problem FRESH solves. In § 3 and § 4 we describe FRESH using the mathematics of information projections, and in § 5 show that the solutions to the projections introduce an exponential tilt factor to the generative distribution. In § 6 we reformulate the problem and solution in terms of empirical samples from the generative model, MCMC sampling from K^{\ast} without evaluating the model, and Lagrange multipliers. In § 7 we provide concrete examples of constraints to meet typical needs, and summarize the combined algorithm in § 8 .The procedure is then exercised in § 9 demonstrating a head-to-head simulation of two first-line therapy regimens in metastatic pancreatic cancer. These therapies were established individually in separate pivotal Phase III trials, but there is no direct head-to-head trial comparing them on common populations. Here FRESH is used to produce patient-level simulations of each arm, and then — by another application of entropy balancing — to decompose the published naive treatment effect between the two regimens into a baseline-adjustment component and a residual treatment-effect component. This serves to elucidate the comparative effectiveness of one therapy regimen over the other, a thorny problem given the mismatched baseline distributions of these two trials. And we conclude our note with a discussion

Read the complete text