Simulation-based Bayesian inference with ameliorative learned summary statistics – Part I

Getachew K. Befekadu · 2026

Read Simulation-based Bayesian inference with ameliorative learned summary statistics – Part I by Getachew K. Befekadu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22441.txt.

Introduction

Getachew Befekadu opens a two-part study on inference when the true likelihood is out of reach. In such cases, teams simulate data and compare it to real data through summary scores. His 2026 preprint lets a learned score act as a stand-in likelihood, with a bonus: it can improve the inference as it goes.

The frame is Bayesian, so it yields full ranges of doubt, not just point calls. Learned scores can adapt to the model at hand. The work aims at fields where simulators rule, from epidemics to climate. Part one lays the base; part two builds on it.

Catalog record

CREATORGetachew K. Befekadu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22441

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Simulation-based Bayesian inference with ameliorative learned summary statistics – Part I Getachew K. Befekadu Abstract This paper, which is Part 1 of a two-part paper series, considers a simulation-based inference with learned summary statistics, in which such a learned summary statistic serves as an empirical-likelihood with ameliorative effects in the Bayesian setting, when the exact likelihood function associated with the observation data and the simulation model is difficult to obtain in a closed form or computationally intractable. In particular, a transformation technique which leverages the Cressie-Read discrepancy criterion under moment restrictions is used for summarizing the learned statistics between the observation data and the simulation outputs, while preserving the statistical power of the inference. Here, such a transformation of data-to-learned summary statistics also allows the simulation outputs to be conditioned on the observation data, so that the inference task can be performed over certain sample sets of the observation data that are considered as an empirical relevance or believed to be particular importance. Moreover, the simulation-based inference framework discussed in this paper can be extended further, and thus handling weakly dependent observation data. Finally, we remark that such an inference framework is suitable for implementation in distributed computing, i.e., computational tasks involving both the data-to-learned summary statistics and the Bayesian inferencing problem can be posed as a unified distributed inference problem that will exploit distributed optimization and MCMC algorithms for supporting large datasets associated with complex simulation models. keywords Cressie-Read discrepancy measure, learned summary statistics, distributed computing, empirical-likelihood, optimization, simulation-based Bayesian inference. 1 Introduction In this paper, which is Part 1 of a two-part paper series, we considers a simulation-based inference with learned summary statistics, in which such a learned summary statistic serves as an empirical-likelihood with ameliorative effects in the Bayesian setting, when the exact likelihood function associated with the observation data and the simulation model is difficult to obtain in a closed form or computationally intractable. In particular, we use a transformation technique that leverages the Cressie-Read discrepancy measures under moment (and also conditional) restrictions for summarizing the learned statistics between the observation data and the simulation outputs, while preserving the statistical power of the inference. Moreover, such a transformation of data-to-learned summary statistics allows the simulation outputs to be conditioned on the observation data, so that the inference task can be performed over certain sample sets of the observation data that are considered as an empirical relevance or believed to be particular importance. In this paper, our intent is to provide a formal problem statement along with step-by-step coherent mathematical arguments that are necessary for the exposition of simulation-based inference with learned summary statistics, rather than considering any specific numerical problem. Some numerical works using the proposed computational frameworks have been done and detailed results will be presented elsewhere (i.e., in Part 2 of this two-part paper series). Furthermore, the simulation-based inference framework discussed in this paper can be extended further, and thus handling weakly dependent observation data. Finally, it is worth remarking that such an inference framework is suitable for implementation in distributed computing, i.e., computational tasks involving both the data-to-learned summary statistics and the Bayesian inferencing problem can be posed as a unified distributed inference problem that will exploit distributed optimization and MCMC algorithms for supporting large datasets associated with complex simulation models. Motivation Over the last few years, major advances have occurred in the field of simulation-based inference and, more importantly, researchers as well as practitioners across various domains of engineering and applied science are now heavily relying on complex mathematical and simulation models for interpreting observational output datasets, forecasting system behaviors, and making decisions or optimal experiment design. While these complex simulation models provide useful information with high-fidelity, however due to intractability of the exact likelihoods, these models are also poorly suited for statistical inference problems including assessing the predictive capabilities and robustness or estimating model parameters for inverse problems that are required for rigorous uncertainty quantification on quantities of interest. Hence, developing a viable simulation-based inference, that gives additional momentum to the field of statistical inference and, at the same time, that provides reliable solutions with practical pipeline interface for the uncertainty quantification researchers and practitioners, is necessarily required. The main objective of this paper, which is Part 1 of a two-part paper series, is to provide a simulation-based inference framework – leveraging algorithmic implementations for summarizing learned statistics in the Bayesian setting – that preserves the statistical power of the inference for estimating quantities of interest and their uncertainties, interpreting observed simulated output datasets or forecasting system behaviors (e.g., see [ 1 ] - [ 7 ] for related discussions on simulation-based inference). The remainder of this paper is organized as follows. In Section 2 , we present our main results including formal problem statements, where we provide coherent mathematical arguments that are necessary for the exposition of simulation-based inference with learned summary statistics. The section also presents a transformation technique for data-to-learned summary statistics, based on the Cressie-Read discrepancy measure under moment (and also conditional) moment restrictions, that serve as a proxy to the exact log-likelihood function (i.e., an approximation to the exact intractable log-likelihood) in the Bayesian setting. Moreover, the mathematical formulations presented in this section also provide a viable way for algorithmic implementations in distributed computing that will support large datasets associated with complex simulation models. Finally, Section 3 contains some concluding remarks 2 Main results In this section, we present our main results that include formal problem statements, in which we provide step-by-step coherent mathematical arguments that are necessary for the exposition of simulation-based inference with learned summary statistics (see Fig. 1 , Fig. 2 and Fig. 3 ). Here, we stress that such data-to-learned summary statistics, which preserve the statistical power of the inference, will serve as a proxy to the exact log-likelihood function (i.e., an approximation to the exact intractable log-likelihood) in the Bayesian setting. Moreover, the mathematical formulations presented in this section provide a viable way for algorithmic implementations in distributed computing that will support large datasets associated with complex simulation models. 2.1 Inference with learned summary statistics - Cressie-Read discrepancy measures under moment restrictions Suppose we have independent observation data y^{\rm obs}=\bigl\{y_{i}^{\rm obs}\bigr\}_{i=1}^{n} , with support \mathbb{R}^{d_{y}} (see also Fig. 1 ). Then, we consider the following Cressie-Read discrepancy criterion of the form \displaystyle\min_{\pi_{i},1\leq i\leq n;\,\beta^{\rm obs}}\,\frac{1}{\gamma(\gamma+1)}\sum\nolimits_{i=1}^{n}\left[\bigl(n\pi_{i}\bigr)^{\gamma+1}-1\right],\quad\text{with}\quad\gamma\in\mathbb{R}\setminus\{-1,0\}, (1) where the above minimization is carried out under the following restrictions (i) \sum\nolimits_{i=1}^{n}\pi_{i}g\bigl(y_{i}^{\rm obs},\beta^{\rm obs}\bigr)=0 , (ii) \sum\nolimits_{i=1}^{n}\pi_{i}=1 , with \pi_{i}\geq 1 , for i=1 , 2 , …, n , while g\colon\mathbb{R}^{d_{y}}\times\mathbb{B}\to\mathbb{R}^{d_{g}} , with \mathbb{B}\subseteq\mathbb{R}^{d_{\beta}} , is a measurable function for modeling moment restrictions, i.e., E\left[g\bigl(y,\beta^{\rm obs}\bigr)\right]=0 , and \beta^{\rm obs}\in\mathbb{B} is a vector of unknown parameters that satisfies the above moment restrictions. 1 1 1 The expression \frac{1}{\gamma(\gamma+1)}\sum\nolimits_{i=1}^{n}\bigl[\bigl(n\pi_{i}\bigr)^{\gamma+1}-1\bigr] is usually interpreted as limiting cases for \gamma=-1 or 0 . Moreover, for a given \gamma , the above minimum discrepancy estimator for the parameters \beta^{\rm obs}\in\mathbb{B} minimizes with respect to \pi_{i} , for i=1 , 2 , …, n , while the parameters \beta^{\rm obs} are restricted to satisfy the above two constraints, i.e., \sum\nolimits_{i=1}^{n}\pi_{i}g\bigl(y_{i}^{\rm obs},\beta^{\rm obs}\bigr)=0 and \sum\nolimits_{i=1}^{n}\pi_{i}=1 , with \pi_{i}\geq 1 , for i=1 , 2 , …, n . Here, we

Read the complete text