An efficient Monte Carlo method for valid prior-free possibilistic statistical inference
Ryan Martin · 2025
Read An efficient Monte Carlo method for valid prior-free possibilistic statistical inference by Ryan Martin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10585.txt.
Introduction
Ryan Martin speeds up a prior-free method of statistical inference in a 2025 paper. The method gives belief grades that act like a Bayesian output yet need no prior. Its grades mark what is possible rather than what is probable, which breaks standard sampling tools.
Martin finds the best probability stand-in for the method's belief set: a blend that can be sampled with ease. Samples from the blend then turn into a close copy of the true output. Tests show the copy is both sharp and cheap to compute. The trick may bring this careful style of inference into daily data work.
Catalog record
| CREATOR | Ryan Martin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10585
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An efficient Monte Carlo method for valid prior-free possibilistic statistical inference Ryan Martin Abstract Inferential models (IMs) offer prior-free, Bayesian-like posterior degrees of belief designed for statistical inference, which feature a frequentist-like calibration property that ensures reliability of said inferences. The catch is that IMs’ degrees of belief are possibilistic rather than probabilistic and, since the familiar Monte Carlo methods approximate probabilistic quantities, there are significant computational challenges associated with putting this framework into practice. The present paper overcomes these challenges by developing a new Monte Carlo method designed specifically to approximate the IM’s possibilistic output. The proposal is based on a characterization of the possibilistic IM’s credal set, which identifies the “best probabilistic approximation” of the IM as a mixture distribution that can be readily approximated and sampled from. These samples can then be transformed into an approximation of the possibilistic IM. Numerical results are presented highlighting the proposed approximation’s accuracy and computational efficiency. Keywords and phrases: confidence distribution; credal set; Gaussian possibility; inferential model; inner probabilistic approximation. 1 Introduction Numerous efforts to advance Fisher’s vision of fiducial inference have been made over the years. Among these efforts, arguably “one of the original statistical innovations of the 2010s” (Cui and Hannig, 2024 ) is the inferential model (IM) framework put forward in Martin and Liu, ( 2013 ); Martin and Liu, 2015a ; Martin and Liu, 2015c and later synthesized in Martin and Liu, 2015b . What’s unique about the IM framework is that its output takes the form of an imprecise probability—specifically, a possibility measure—and, consequently, inference is based on possibilistic reasoning: hypotheses assigned small possibility are refuted by the data while hypotheses whose complements are assigned small possibility are corroborated by the data. This shift from probability to possibility theory has principled motivations: the IM’s possibilities satisfy a frequentist-style validity property that Bayesian/fiducial probabilities do not satisfy, i.e., the IM’s possibility assigned to true hypotheses tends to be not small, hence it’s a provably rare event that the data-driven IM output refutes a true hypothesis or corroborates a false hypothesis. More details about IMs and their properties are provided in Section 2 below; some basic background on possibility theory is presented in Appendix A . Despite all that the IM framework has to offer, it has been slow to gain traction, largely due to computational challenges. Indeed, as shown recently in Jacob et al., ( 2021 ) , the familiar Monte Carlo methods used to approximate ordinary probabilities aren’t enough to approximate imprecise probabilities; something more is needed. The goal of this paper is to identify the aforementioned “something more” for possibilistic IMs and to develop the corresponding computational machinery needed to make the IM framework accessible for everyday use in applications. The jumping off point here is the fact that all (coherent) imprecise probabilities, including the possibilistic IM’s output, correspond to a (non-empty) set of ordinary or precise probabilities, called the credal set . Different brands of imprecise probabilities have their own mathematical properties, and one way this distinction manifests is in the kinds of constraints imposed on their associated credal sets. Possibility measures are among the simplest imprecise probabilities and, in turn, their credal sets have a relatively simple characterization. In particular, results like that in Theorem 1 below make it relatively easy to identify probability distributions in the credal set that “best approximate” the IM’s possibilistic output. The best approximation is relatively simple mathematically but might be difficult to compute; fortunately, further approximations can be made. Such second-level approximations can take various forms but, inspired by the asymptotic results in Martin and Williams, ( 2025 ) , here I’ll use a family of Gaussian approximations as proposed in Cella and Martin, ( 2025 ) . These individual Gaussian approximations on their own are not fully satisfactory, as Cella and Martin acknowledge, because they only ensure accuracy in a limited sense. If the individual approximations could be appropriately stitched together, then that would give an overall accurate approximation—but Cella and Martin weren’t able to provide a suitable stitching procedure. Here, using Theorem 1 , I propose a stitching procedure that achieves the relevant statistical and computational desiderata, thereby closing the critical gap left by Cella and Martin and facilitating a principled probabilistic approximation to the IM’s output. I also show how this probabilistic approximation can be transformed back into a possibility measure that is both easy to compute and accurately approximates the target IM output. The remainder of this paper is organized as follows. Section 2 provides the necessary background on possibilistic IMs, highlighting the existing computational bottlenecks. The credal set characterization and proposed Monte Carlo strategy are presented in Section 3 . Three illustrative examples, including logistic regression and a semiparametric problem involving censored data, are presented in Section 4 . These are cases where direct-but-naive IM computations are expensive but not out of reach, so the accuracy of the proposed approximation can be assessed. Section 5 shows empirically that the proposed IM approximation performs well compared to standard Bayesian and likelihood-based solutions. A higher-dimensional logistic regression example is considered in Section 6 , where the proposed IM approximation can, in a matter of seconds, easily solve a problem that was practically out of reach by previous efforts in the IM literature. The insights and results here in the present paper make up an important first step in a series of developments needed to create an IM toolbox for practitioners. The concluding remarks in Section 7 describe, among other things, my vision of where these developments can and need to go. Relevant technical details are given in the appendix/supplement. 2 Background The first IM developments relied on random sets and their corresponding belief functions. More recent developments in Martin, 2022b , building on Martin, ( 2015 , 2018 ) , define a possibilistic IM by applying a version of the probability-to-possibility transform to the model’s relative likelihood. This shift is philosophically important, but the present review focuses on the details, properties, and computation of this possibilistic IM. Consider a parametric model \{\mathsf{P}_{\theta}:\theta\in\mathbb{T}\} consisting of probability distribution supported on a sample space \mathbb{Z} , indexed by a parameter space \mathbb{T}\subseteq\mathbb{R}^{d} . Suppose that the observable data Z , taking values in \mathbb{Z} , is a sample from the distribution \mathsf{P}_{\Theta} , where \Theta\in\mathbb{T} is the unknown/uncertain “true value.” The model and observed data Z=z together determine a likelihood function \theta\mapsto L_{z}(\theta) and a corresponding relative likelihood R(z,\theta)=\frac{L_{z}(\theta)}{\sup_{\vartheta}L_{z}(\vartheta)},\quad z\in% \mathbb{Z},\quad\theta\in\mathbb{T}. I’ll implicitly assume that the denominator is finite for almost all z . As is typical in the literature, I will also assume that prior information about \Theta is vacuous. The relative likelihood itself defines a data-dependent possibility contour, i.e., a non-negative function such that \sup_{\theta}R(z,\theta)=1 for each z ; see Appendix A . This contour, in turn, determines a possibility measure that can be used for uncertainty quantification about \Theta , given Z=z , which has been extensively studied in the literature (e.g., Shafer, 1982 ; Wasserman, 1990a ; Denœux, 2006 , 2014 ) . In particular, these references suggest assigning data-driven possibility values to hypotheses H about \Theta via the rule H\mapsto\sup_{\theta\in H}R(z,\theta),\quad H\subseteq\mathbb{T}. This purely likelihood-driven possibility has a number of desirable properties,