Bayesian optimisation for Bayesian evidence ( BOBE ) – a fast and efficient likelihood emulator for model selection

Ameek Malhotra · 2026

Read Bayesian optimisation for Bayesian evidence ( BOBE ) – a fast and efficient likelihood emulator for model selection by Ameek Malhotra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11150.txt.

Introduction

Ameek Malhotra presents BOBE, a fast stand-in for Bayesian evidence. Bayesian model ranking gives an elegant way to sort models by how well they fit data. Its key number, the evidence, is an integral over many dimensions, of likelihood times prior. That step is often the slow one: elegant theory, brutal math.

BOBE learns the likelihood's shape so the evidence can be found far faster. It needs only a few true evaluations of the real likelihood. Cosmology teams face this cost on every model check. A fast, faithful stand-in could make strict model ranking routine instead of a luxury.

Catalog record

CREATORAmeek Malhotra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11150

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bayesian optimisation for Bayesian evidence ( BOBE ) – a fast and efficient likelihood emulator for model selection Ameek Malhotra Abstract The formalism of Bayesian model selection provides a very elegant way of ranking different physical models in terms of how compatible they are with a given set of observed data. However, its practical application is often hampered by the challenge of having to compute the Bayesian evidence – a multi-dimensional integral over the product of likelihood and prior probability. This usually necessitates a large number of function calls to the likelihood, which may become prohibitive in case of “slow”, costly to evaluate likelihoods. A possible solution to this problem lies in approximating the slow full likelihood by a fast emulated likelihood. In this paper, we introduce BOBE (Bayesian Optimisation for Bayesian Evidence), a method to construct a Gaussian Process Regression (GPR)-based emulator. BOBE utilises a Bayesian Optimisation algorithm designed specifically to (i) provide a realistic estimate of the emulator’s uncertainty and its impact on the evidence calculation, and (ii) minimise the number of likelihood evaluations required in order to meet a given evidence accuracy goal. We apply it to a number of toy examples as well as actual cosmological likelihoods, and demonstrate that training the emulator to a sufficient accuracy takes a factor of 𝒪 ⁡ ( 10 3 ) \mathcal{O}(10^{3}) fewer direct likelihood evaluations than would be needed if one were to directly compute the evidence integral via nested sampling. BOBE ’s overhead is independent of the likelihood computation time t ℒ t_{\mathcal{L}} , making it particularly useful for “expensive” likelihoods with t ℒ ≳ 1 t_{\mathcal{L}}\gtrsim 1 s. BOBE is written in Python , supports MPI parallelisation, takes advantage of automatic differentiation and just-in-time-compilation provided by JAX , can straightforwardly be implemented with cosmological data analysis frameworks such as Cobaya , and is available for download from https://github.com/Ameek94/BOBE . CPPC-2025-XX 1 Introduction At the heart of the empirical sciences lies mankind’s desire to understand Nature by describing reality in terms of quantitative theories, i.e., mathematical models. Knowledge can be advanced via the conception of new models on the theory side, or by comparing, ranking or possibly rejecting models in light of new observations. In either case, it is imperative to have rigorous, quantifiable criteria for model selection such that competing theories can be judged fairly. The framework of Bayesian statistics provides such a criterion, with the fundamental ingredient for Bayesian model comparison being the Bayesian evidence \mathcal{Z} [ 82 , 83 , 84 ] . For any given physical model \mathcal{M} with free parameters \theta and data \mathcal{D} , it is defined as the integral over the product of the likelihood \mathcal{L}(\mathcal{D}|\theta,\mathcal{M}) of the data and the prior probability \pi(\theta|\mathcal{M}) of the parameters: \displaystyle\begin{split}\mathcal{Z}\equiv P(\mathcal{D}|\mathcal{M})&=\int\mathrm{d}\theta\;\mathcal{L}(\mathcal{D}|\theta,\mathcal{M})\,\pi(\theta|\mathcal{M})\\ &\equiv\int\mathrm{d}\theta\;\hat{\mathcal{P}}(\theta|\mathcal{M}).\end{split} (1.1) Note that the evidence \mathcal{Z} is also the normalisation factor of the posterior probability of the parameters, \mathcal{P}(\theta|\mathcal{M})\equiv\tfrac{1}{\mathcal{Z}}\,\mathcal{L}(\mathcal{D}|\theta,\mathcal{M})\,\pi(\theta|\mathcal{M}) , so one can interpret the integrand of Eq. ( 1.1 ) as an unnormalised posterior \hat{\mathcal{P}}(\theta|\mathcal{M}) . If we assume two models \mathcal{M}_{1} and \mathcal{M}_{2} with equal model prior probabilities P(\mathcal{M}_{1})=P(\mathcal{M}_{2}) , the ratio of two different models’ evidences, also known as the Bayes factor, \displaystyle\mathcal{B}_{12}\equiv\frac{\mathcal{Z}_{1}}{\mathcal{Z}_{2}}=\frac{P(\mathcal{D}|\mathcal{M}_{1})}{P(\mathcal{D}|\mathcal{M}_{2})}\,, (1.2) has a natural interpretation in terms of “betting odds” between the models. Unlike frequentist approaches based on maximum likelihood values which only measure the quality of fit at a point, the evidence quantifies how well the model as a whole explains the data. It rewards risky predictions that agree well with the data and punishes generic models which need parameters to be fine-tuned to achieve a good fit, thereby organically implementing the spirit of Occam’s razor. Bayes factors are commonly mapped to a strength of the evidence in favour of one model via Jeffreys’ scale [ 39 , 83 ] (see, e.g., Tab. 1 ). \ln\mathcal{B}_{12} \mathcal{B}_{12} Evidence in favour of \mathcal{M}_{1} \ln\mathcal{B}_{12}<0 \mathcal{B}_{12}<1 none ( \mathcal{M}_{2} preferred) 0\leq\ln\mathcal{B}_{12}<1 1\leq\mathcal{B}_{12}\lesssim 3 inconclusive 1\leq\ln\mathcal{B}_{12}<2.5 3\lesssim\mathcal{B}_{12}\lesssim 20 weak 2.5\leq\ln\mathcal{B}_{12}<5 12\lesssim\mathcal{B}_{12}\lesssim 150 moderate \ln\mathcal{B}_{12}\geq 5 \mathcal{B}_{12}\gtrsim 150 strong Table 1 : Jeffreys’ scale, adapted from Ref. [ 83 ] . If one aims to reliably differentiate between different categories on the Jeffreys scale, it follows that the computation of the logarithm of the Bayes factors has an explicit precision requirement of \mathcal{O}(0.1) (which similarly applies to the precision of the log-evidences, \sigma_{\ln\mathcal{Z}} ). Generally, the bottleneck of Bayesian model selection lies in the computation of the evidence integral (Eq. ( 1.1 )). 1 1 1 Evaluating the integrand of Eq. ( 1.1 ) involves three separate computations: (i) priors \pi(\theta|\mathcal{M}) (this is typically trivial), (ii) theory (i.e., the theoretical prediction of observables given parameters \theta and model \mathcal{M}) and (iii) likelihood function (which takes as input the observables computed in step (ii)). Even for basic typical model selection problems encountered in cosmology, efficient state-of-the-art integration methods based on nested sampling [ 73 ] (as implemented in packages such as MultiNest [ 19 ] , Polychord [ 32 , 33 ] , Dynesty [ 76 ] or nautilus [ 45 ] ), or using Markov-chain Monte Carlo (MCMC)-generated posterior samples [ 56 , 34 , 41 , 52 , 63 , 50 ] , reaching an evidence precision of \sigma_{\ln\mathcal{Z}}\sim 0.1 necessitates upwards of 10^{5} - 10^{6} evaluations of the integrand [ 78 ] – a substantially larger number than would be required for parameter inference [ 48 , 21 , 9 ] . The number of evidence integral evaluations required by nested sampling and MCMC typically exhibits only mild scaling with the dimensionality of parameter space, as long as the integrand is well-behaved (i.e. unimodal, approximately Gaussian, with linear degeneracies between parameters) [ 65 , 73 ] . However, likelihoods or priors of higher complexity with features such as multimodality, non-Gaussianity or non-linear degeneracies may lead to a significant increase in the number of function calls needed. This is not problematic per se , but may become an issue when coupled with evidence integrands that are expensive to calculate. Here, the cost of a single evaluation depends both on the model and the observable under consideration. To give an example from a cosmological context, considering Planck Cosmic Microwave Background (CMB) anisotropy data [ 3 ] , computation times for theory plus likelihood on a modern CPU may range from a fraction of a second for base \Lambda CDM cosmology to \mathcal{O}(1~\mathrm{s}) in extended models (e.g., \Lambda CDM with non-zero spatial curvature [ 49 ] , or inflationary features [ 12 ] )). However, for other models or observables where costly non-perturbative simulations must be performed (e.g., N-body [ 77 ] , hydrodynamics [ 85 ] , lattice [ 20 ] or numerical relativity [ 7 ] ), it might take hours or even days. In the future, as the precision of observations improves, there will be a trend for the corresponding likelihoods to become more elaborate, necessitating at the same time more accurate (and therefore more expensive) theory calculations, thereby exacerbating the issue. 2 2 2 In addition, new data may require the introduction of additional nuisance parameters, causing the dimensionality of the problem to increase as well. A possible solution to this problem lies in replacing the expensive evidence integrand with a fast approximation (a.k.a. emulator

Read the complete text