Generalized Power Priors for Improved Bayesian Inference with Historical Data

Masanari Kimura and Howard Bondell · 2025

Read Generalized Power Priors for Improved Bayesian Inference with Historical Data by Masanari Kimura and Howard Bondell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16244.txt.

Introduction

Masanari Kimura and Howard Bondell wrote this 2025 arXiv paper on borrowing strength from old data in Bayesian statistics. Trials and studies often sit beside earlier, similar data that could sharpen the analysis, if weighted with care. The power prior does this with a dial that sets how much the history counts, and its result can be seen as a compromise between ignoring the past and swallowing it whole.

The authors generalize that compromise. Instead of the standard distance between probability curves, they use a broader family of distances with its own tunable parameter, letting the data itself steer the choice. They prove the theory behind the new posterior, including a geometric reading: it travels along a shortest path between the past-blind and past-full views. The promise is historical borrowing that adapts its trust to how well old and new data actually agree.

Catalog record

CREATORMasanari Kimura and Howard Bondell
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE112 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16244

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generalized Power Priors for Improved Bayesian Inference with Historical Data Masanari Kimura and Howard Bondell Abstract The power prior is a class of informative priors designed to incorporate historical data alongside current data in a Bayesian framework. It includes a power parameter that controls the influence of historical data, providing flexibility and adaptability. A key property of the power prior is that the resulting posterior minimizes a linear combination of KL divergences between two pseudo-posterior distributions: one ignoring historical data and the other fully incorporating it. We extend this framework by identifying the posterior distribution as the minimizer of a linear combination of Amari’s α \alpha -divergence, a generalization of KL divergence. We show that this generalization can lead to improved performance by allowing for the data to adapt to appropriate choices of the α \alpha parameter. Theoretical properties of this generalized power posterior are established, including behavior as a generalized geodesic on the Riemannian manifold of probability distributions, offering novel insights into its geometric interpretation. Keywords: Power prior, Bayesian analysis, divergence 1 Introduction Scientific investigations in areas such as early-phase clinical trials, rare-disease studies and high-dimensional omics often suffer from data that are sparse, noisy or otherwise unrepresentative of the target population. Concurrently, investigators typically possess an expanding archive of historical trials, registries and real-world evidence that can stabilize estimation and sharpen decision making. The methodological challenge is therefore not whether to borrow information, but how much to borrow and how to calibrate that borrowing so that efficiency gains are not paid for with excessive sensitivity to model–data conflict. A widely adopted solution is the power prior of Ibrahim & Chen (2000) , which raises the historical likelihood to a scalar weight \xi\in[0,1] before combining it with a baseline prior. Its conceptual clarity and conjugate structure have spurred numerous extensions including joint and normalised forms ( Chen et al., 2000 ; Duan et al., 2006 ) , commensurate and location-adaptive variants ( Hobbs et al., 2011 ) , effective sample size rules ( Ollier et al., 2020 ) , and scale-transformed approaches for discordant endpoints ( Alt et al., 2023 ) . The theoretical underpinning is elegant: Ibrahim et al. (2003) showed that the power-prior posterior minimizes a convex combination of two Kullback–Leibler (KL) divergences, one anchored at the no-borrowing and the other at the full-borrowing posterior. Despite this progress, existing variants inherit the KL foundation of the original power prior. While KL optimality is attractive for well-specified models, its heavy tail and asymmetric penalty make the resulting posterior sensitive to outliers, prior–data conflict and model misspecification issues that are accentuated when historical studies differ systematically from contemporaneous trials. This paper closes that gap by lifting the KL criterion to Amari’s \alpha -divergence ( Amari, 2009 ) which is a one-parameter family that interpolates smoothly between the forward and reverse KL limits and encompasses a broad spectrum of robust divergences. The resulting posterior is shown to be the unique minimizer of a weighted sum of \alpha -divergences to the no- and full-borrowing pseudo–posteriors, and retaining the optimization strategy of the classical power prior while injecting a tunable robustness parameter \alpha . Moreover, the solution lies on the \alpha -geodesic connecting the two pseudo-posteriors on the statistical manifold, exposing an information-geometric structure not apparent in previous formulations. Contributions. Our main contributions are summarized as follows. • Divergence-optimal characterization. We generalize existing power prior and prove that the resulting posterior is a minimizer of a weighted sum of \alpha –divergences. • Theoretical guarantees. We establish (i) global prior–data robustness bounds under Huber-type contamination, (ii) shape theorems showing how \alpha controls uni- versus multi-modality, and (iii) consistency and higher-order asymptotics whose leading variance term coincides with that of standard weighted likelihood but whose O(n^{-2}) correction depends on (\alpha,\xi) . • Information-geometric insight. We show that the new posterior traces an \alpha -geodesic between two distributions on the statistical manifold. • Worked examples and case study. We provide fully-worked Bayesian survival analysis of two ECOG melanoma trials that demonstrates practical gains in hazard-ratio estimation and predictive concordance. Organization of the paper Section 2 summarizes the conventional power–prior framework and its KL–optimality result. Section 3 presents the generalized power prior and corresponding posterior construction, proves its divergence‐optimality. Section 4 works out closed-form posteriors for Gaussian, Beta–Bernoulli and Dirichlet–multinomial models that illustrate how the new parameter \alpha modulates borrowing. Section 5 develops robustness bounds, shape theorems, consistency, higher-order asymptotics and an information-geometric interpretation. Practical implications are demonstrated in Section 6 through a survival analysis of the ECOG E1684 / E1690 melanoma trials. Section 7 concludes with a discussion of possible extensions. Technical proofs and additional derivations are collected in the supplementary material. 2 Backgroud In Bayesian analysis, it is often the case that one can access historical data D_{0} in addition to the current data D . The power prior, which is useful in such cases, is a class of informative prior distributions first developed by Ibrahim & Chen (2000) . Definition 1 (Power prior ( Ibrahim & Chen, 2000 ) ) . Let the data for the current study be denoted by D , and denote the corresponding likelihood function by L(\bm{\theta}\mid D) , where \bm{\theta}\in\Theta is a vector of parameters in the parameter space \Theta . Suppose we have historical data D_{0} from a similar previous study, and let L(\bm{\theta}\mid D_{0}) be the corresponding likelihood function. Then, the power prior is defined as \pi(\bm{\theta}\mid D_{0},\xi)\propto L(\bm{\theta}\mid D_{0})^{\xi}\pi_{0}(\bm{\theta}) , where 0\leq\xi\leq 1 is a scalar parameter and \pi_{0} is the initial prior for \bm{\theta} before the historical data D_{0} is observed. Using the power prior in Definition 1 , the corresponding posterior distribution of \bm{\theta} is given by \pi(\bm{\theta}\mid D,D_{0},\xi)\propto L(\bm{\theta}\mid D)L(\bm{\theta}\mid D_{0})^{\xi}\pi_{0}(\bm{\theta}) . One can see that \xi weights the historical data relative to the likelihood of the current study, and thus \xi controls the influence of the historical data. Considering two extreme cases, we can see that • \xi=0 : ignore the historical data D_{0} as \pi(\bm{\theta}\mid D,D_{0},\xi=0)\propto L(\bm{\theta}\mid D)\pi_{0}(\bm{\theta}) , and • \xi=1 : give equal importance to D_{0} and D , relative to their sample sizes, as \pi(\bm{\theta}\mid D,D_{0},\xi=1)\propto L(\bm{\theta}\mid D)L(\bm{\theta}\mid D_{0})\pi_{0}(\bm{\theta}) . Since the power prior is a likelihood function raised to a power, it shares all of the properties of likelihood functions, and therefore has several advantages over other priors. For example, it can be shown that for many classes of models, \displaystyle\pi(\bm{\theta}\mid D_{0},\xi)\approx\mathcal{N}\left(\hat{\bm{\theta}}_{0},\xi^{-1}H^{-1}(\hat{\bm{\theta}})\right), where \hat{\bm{\theta}}_{0} is the mode of the power prior and \displaystyle H^{-1}(\bm{\theta})=-\frac{\partial^{2}}{\partial\bm{\theta}\partial\bm{\theta}^{\top}}\ln\left(\pi(\bm{\theta}\mid D_{0},\xi)\right). The power prior has been applied in many fields as the useful informative prior, including survival analysis for clinical trials ( Chen et al., 1999 ; Chen et al., 2002 ; Ibrahim et al., 2012 ) , non-inferiority trials for anti-infective products ( Gamalo et al., 2014 ) , anxiety and depression scale in psychology ( Matteucci & Veldkamp, 2014 ) , benchmark dose estimation in toxicology ( Shao, 2011 ) , randomized therapeutic trials ( Rietbergen et al., 2011 ) , pediatric quality of care ( Neelon & O’Malley, 2010 ) and evaluating water quality in environmental science ( Duan et al., 2006 ) . Moreover, many variants of the power prior have been proposed due to its simplicity of

Read the complete text