Delayed Acceptance Markov Chain Monte Carlo for Robust Bayesian Analysis
Masahiro Tanaka · 2025
Read Delayed Acceptance Markov Chain Monte Carlo for Robust Bayesian Analysis by Masahiro Tanaka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11761.txt.
Introduction
Quasi-Bayesian methods let analysts draw conclusions without fully specifying a probability model, but they are slow: each step needs the inverse and determinant of large matrices. Masahiro Tanaka proposes a two-stage sampling algorithm to cut that cost. In the first stage, proposals are screened against an approximate posterior, which is cheap to compute. Only proposals that pass go to the second stage, where the exact target posterior decides acceptance.
Tests on synthetic and real data show the trade-off clearly. Each iteration yields slightly fewer effective samples than standard sampling, yet the effective samples per second roughly double. That makes the method attractive wherever posterior simulation is the bottleneck. Tanaka presents the algorithm as a practical advance for robust Bayesian analysis with large covariance structures.
Catalog record
| CREATOR | Masahiro Tanaka |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Delayed Acceptance Markov Chain Monte Carlo for Robust Bayesian Analysis Masahiro Tanaka Abstract This study introduces a computationally efficient algorithm, delayed acceptance Markov chain Monte Carlo (DA–MCMC), designed to improve posterior simulation in quasi-Bayesian inference. Quasi-Bayesian methods, which do not require fully specifying a probabilistic model, are often computationally expensive owing to the need to evaluate the inverse and determinant of large covariance matrices. DA–MCMC addresses this challenge by employing a two-stage process: In the first stage, proposals are screened using an approximate posterior, whereas a final acceptance or rejection decision is made in the second stage based on the exact target posterior. This reduces the need for costly matrix computations, thereby improving efficiency without sacrificing accuracy. We demonstrate the effectiveness of DA–MCMC through applications to both synthetic and real data. The results demonstrate that, although DA–MCMC slightly reduces the effective sample size per iteration compared with the standard MCMC, it achieves substantial improvement in terms of effective sample size per second, approximately doubling the efficiency. This makes DA–MCMC particularly useful for cases where posterior simulation is computationally intensive. Thus, the DA–MCMC algorithm offers a significant advancement in computational efficiency for quasi-Bayesian inference, making it a valuable tool for robust Bayesian analysis. Keywords: delayed acceptance Markov chain Monte Carlo; robust Bayesian analysis; generalized posterior; Gibbs posterior 1 Introduction In a standard Bayesian inference, a probabilistic model is used for the data-generating process and the corresponding likelihood function, p\left(\mathcal{D}|\boldsymbol{\theta}\right) , where \mathcal{D} denotes a set of observations with a sample size of N , \boldsymbol{\theta}\in\mathbb{R}^{K} denotes a K -dimensional vector of unknown parameters, and p\left(\boldsymbol{\theta}\right) denotes a prior. A posterior density is proportional to the product of the likelihood and prior, p\left(\boldsymbol{\theta}|\mathcal{D}\right)\propto p\left(\mathcal{D}|\boldsymbol{\theta}\right)p\left(\boldsymbol{\theta}\right) . Because a posterior is generally intractable, we simulate random draws from the density using numerical techniques, such as Markov chain Monte Carlo (MCMC) algorithms. A well-known shortcoming of standard Bayesian analysis is that it needs to fully specify a probabilistic model. Alternative quasi-Bayesian approaches have been proposed to improve the robustness toward model misspecification, which have different constructions of quasi-likelihood that rely on loss function and moment conditions instead of a probabilistic model. This study considers two types of quasi-Bayesian approaches. In the first approach, a quasi-likelihood is based on an empirical risk function r\left(\boldsymbol{\theta};\mathcal{D}\right) (e.g., [ 19 , 20 , 9 , 4 , 13 ] ). Hereinafter, we ignore the dependency on \mathcal{D} and write r\left(\boldsymbol{\theta}\right)=r\left(\boldsymbol{\theta};\mathcal{D}\right) . For instance, consider a linear regression with response variable y_{i} , covariates \boldsymbol{x}_{i} , and coefficients \boldsymbol{\theta} . The unknown parameter \boldsymbol{\theta} can be estimated using an empirical risk function with quadratic losses, r\left(\boldsymbol{\theta}\right)=N^{-1}\sum_{i=1}^{N}\left(y_{i}-\boldsymbol{\theta}^{\top}\boldsymbol{x}_{i}\right)^{2} where N denotes a sample size. Here, a probabilistic assumption does not have to be imposed on the error term such as the normality; thus, \boldsymbol{\theta} can be estimated with more robustness. Given an empirical risk function, a Gibbs posterior is defined as follows: \pi_{\omega}\left(\boldsymbol{\theta}\right)\propto\left[\exp\left(-Nr\left(\boldsymbol{\theta}\right)\right)\right]^{\omega}p\left(\boldsymbol{\theta}\right). (1) In this approach, a scaling parameter (also known as a learning rate parameter) \omega\left(>0\right) must be selected to calibrate the spread of the posterior; however, it is not a theoretically or computationally trivial problem. 1 1 1 See [ 16 ] for a review of the related literature. Recently, Frazier et al. [ 7 ] proposed a new approach that specifies a quasi-posterior as follows: \pi\left(\boldsymbol{\theta}\right)\propto\left|\boldsymbol{W}\left(\boldsymbol{\theta}\right)\right|^{-\frac{1}{2}}\exp\left\{-\frac{N}{2}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)^{\top}\boldsymbol{W}\left(\boldsymbol{\theta}\right)^{-1}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)\right\}p\left(\boldsymbol{\theta}\right), (2) where \bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)=\nabla r\left(\boldsymbol{\theta}\right) , \nabla denotes the gradient operator, and \boldsymbol{W}\left(\boldsymbol{\theta}\right) denotes an estimate of the covariance of \sqrt{N}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right) . As argued in [ 7 ] , this approach can provide proper uncertainty quantification without selecting \omega under some regularity conditions. The second approach specifies a quasi-likelihood based on a generalized method of moments (GMM) criterion (e.g., [ 10 , 5 , 17 ] ). In a GMM, a statistical problem is formulated under a set of moment conditions, E\left[\boldsymbol{m}_{i}\left(\boldsymbol{\theta};\mathcal{D}\right)\right]=\boldsymbol{0} , where \boldsymbol{m}_{i}\left(\cdot\right) denotes a vector-valued function termed a moment function. We shortly denote \boldsymbol{m}_{i}\left(\boldsymbol{\theta}\right)=\boldsymbol{m}_{i}\left(\boldsymbol{\theta};\mathcal{D}\right) . The unknown parameters \boldsymbol{\theta} are estimated by minimizing a GMM criterion \bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)^{\top}\boldsymbol{W}\left(\boldsymbol{\theta}\right)^{-1}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right) , with \bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)=N^{-1}\sum_{i=1}^{N}\boldsymbol{m}_{i}\left(\boldsymbol{\theta}\right) . Then, a quasi-posterior is given by \pi_{\omega}\left(\boldsymbol{\theta}\right)\propto\left[\left|\boldsymbol{W}\left(\boldsymbol{\theta}\right)\right|^{-\frac{1}{2}}\exp\left\{-\frac{N}{2}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)^{\top}\boldsymbol{W}\left(\boldsymbol{\theta}\right)^{-1}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}\right)\right\}\right]^{\omega}p\left(\boldsymbol{\theta}\right). (3) This approach can be regarded as a special case of ( 2 ) when the moment conditions are derived under the first-order condition for an empirical risk function. Although the first approach can only handle exactly identified models, the second can also handle over-identified models. For notational convenience, we subsequently focus on ( 2 ). The biggest challenge in implementing Bayesian inference with ( 2 ) is the computational load. The evaluation of \pi\left(\boldsymbol{\theta}\right) is computationally expensive because of the inverse matrix \boldsymbol{W}\left(\boldsymbol{\theta}\right)^{-1} as well as the matrix determinant \left|\boldsymbol{W}\left(\boldsymbol{\theta}\right)\right| . To the best of our knowledge, no studies have addressed this issue. Yin et al. [ 18 ] proposed a posterior simulator for inference with ( 3 ); however, their proposal aimed to address the numerical stability and can be computationally expensive. In this study, we propose a new algorithm based on a delayed acceptance MCMC (DA–MCMC) [ 6 ] , which can be beneficial for Monte Carlo simulation when the target kernel is expensive to compute. DA–MCMC can be more computationally efficient than the standard MCMC because it can shorten the computation of \boldsymbol{W}\left(\boldsymbol{\theta}\right)^{-1} . A single cycle of DA–MCMC has two stages. In the first stage, after being generated for a new state, the proposal is promoted to the second stage with probability based on an approximate target density. In the second stage, the promoted proposal is accepted with probability based on the exact target density. Through applications to synthetic and real data problems, we demonstrate that the proposed algorithm is approximately two times more efficient than the standard MCMC in terms of the effective sample size per second. The remainder of this paper is organized as follows: Section 2 introduces DA–MCMC, Section 3 compares the proposed algorithm with existing algorithm via synthetic and real data examples, and Section 4 concludes the paper. 2 Delayed acceptance MCMC To expedite the posterior simulation with ( 2 ), we propose using DA–MCMC [ 6 ] . A single cycle of the algorithm comprises two stages: (1) screening a proposal with an approximate posterior and (2) determining whether to accept or reject with the exact posterior. The second stage occurs only when a proposal passes the first stage. Given a current state \boldsymbol{\theta}^{\left(t\right)} , a proposal \boldsymbol{\theta}^{\prime} is generated from a proposal kernel, \boldsymbol{\theta}^{\prime}\sim q_{1}\left(\cdot|\boldsymbol{\theta}^{\left(t\right)}\right) . The first-stage acceptance probability is based on an approximation to the exact target kernel \pi^{*}\left(\boldsymbol{\theta}^{\prime}\right) , which is evaluated with less computational cost than \pi\left(\boldsymbol{\theta}\right) . An approximation to the target kernel is constructed by replacing \boldsymbol{W}\left(\boldsymbol{\theta}^{\prime}\right) with the current value \boldsymbol{W}\left(\boldsymbol{\theta}^{\left(t\right)}\right) : \pi^{*}\left(\boldsymbol{\theta}^{\prime}\right)=\left|\boldsymbol{W}\left(\boldsymbol{\theta}^{\left(t\right)}\right)\right|^{-\frac{1}{2}}\exp\left\{-\frac{N}{2}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}^{\prime}\right)^{\top}\boldsymbol{W}\left(\boldsymbol{\theta}^{\left(t\right)}\right)^{-1}\bar{\boldsymbol{m}}\left(\boldsymbol{\theta}^{\prime}\right)\right\}p\left(\boldsymbol{\theta}^{\prime}\right). (4) With this approximation, we do not need to compute the most computationally demanding quantities, that is, the inverse and determinant of \boldsymbol{W}\left(\boldsymbol{\theta}^{\prime}\right) . The first-stage acceptance probability is computed as follows: \alpha_{1}\left(\boldsymbol{\theta}^{\left(t\right)},\boldsymbol{\theta}^{\prime}\right)=\min\left\{1,\;\frac{q_{1}\left(\boldsymbol{\theta}^{\left(t\right)}|\boldsymbol{\theta}^{\prime}\right)\pi^{*}\left(\boldsymbol{\theta}^{\prime}\right)}{q_{1}\left(\boldsymbol{\theta}^{\prime}|\boldsymbol{\theta}^{\left(t\right)}\right)\pi^{*}\left(\boldsymbol{\theta}^{\left(t\right)}\right)}\right\}. (5) With probability \alpha_{1}\left(\boldsymbol{\theta}^{\prime},\boldsymbol{\theta}^{\left(t\right)}\right) , \boldsymbol{\theta}^{\prime} is “promoted” as a proposal for the second stage; otherwise, \boldsymbol{\theta}^{\prime} is rejected, thereby maintaining the current state \boldsymbol{\theta}^{\left(t+1\right)}=\boldsymbol{\theta}^{\left(t\right)} . In the second stage, the acceptance probability is evaluated based on the exact target kernel \pi\left(\boldsymbol{\theta}^{\prime}\right) as follows: \alpha_{2}\left(\boldsymbol{\theta}^{\left(t\right)},\boldsymbol{\theta}^{\prime}\right)=\min\left\{1,\;\frac{q_{2}\left(\boldsymbol{\theta}^{\left(t\right)}|\boldsymbol{\theta}^{\prime}\right)\pi\left(\boldsymbol{\theta}^{\prime}\right)}{q_{2}\left(\boldsymbol{\theta}^{\prime}|\boldsymbol{\theta}^{\left(t\right)}\right)\pi\left(\boldsymbol{\theta}^{\left(t\right)}\right)}\right\}. (6) where q_{2}\left(\boldsymbol{\theta}^{\prime}|\boldsymbol{\theta}^{\left(t\right)}\right) denotes the actual proposal density given by: q_{2}\left(\boldsymbol{\theta}^{\prime}|\boldsymbol{\theta}^{\left(t\right)}\right)=\alpha_{1}\left(\boldsymbol{\theta}^{\left(t\right)},\boldsymbol{\theta}^{\prime}\right)q_{1}\left(\boldsymbol{\theta}^{\prime}|\boldsymbol{\theta}^{\left(t\right)}\right). (7) As argued in [ 6 ] , compared with the standard