No-prior Bayesian inference reIMagined: probabilistic approximations of inferential models
Ryan Martin · 2025
Read No-prior Bayesian inference reIMagined: probabilistic approximations of inferential models by Ryan Martin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19748.txt.
Introduction
Ryan Martin rebuilds prior-free Bayesian inference from possibility models with exact guarantees, in work from twenty twenty-five. With no prior knowledge, analysts usually pair a default prior with Bayes' rule. Those posteriors often give only roughly valid uncertainty statements. Inferential models built as possibility measures give exact validity instead. They are not probabilities, though, which limits their direct use.
Martin takes the inner probability shadow of such a model. That shadow keeps exact coverage for credible sets in the build. Efficiency at large samples is preserved by the approximation too. Where group symmetry holds, the answer matches classic Bayes and fiducial results. A Monte Carlo method computes the shadow in practice. Worked examples show the method behaving as theory promises. Prior-free inference gains reliability without losing familiarity.
Catalog record
| CREATOR | Ryan Martin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19748
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
No-prior Bayesian inference reIMagined: probabilistic approximations of inferential models Ryan Martin Abstract When prior information is lacking, the go-to strategy for probabilistic inference is to combine a “default prior” and the likelihood via Bayes’s theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This construction is natural, but the corresponding posterior distributions generally only offer limited, approximately valid uncertainty quantification. The present paper takes a reimagined approach offering posterior distributions with stronger reliability properties. The proposed construction starts with an inferential model (IM), one that takes the mathematical form of a data-driven possibility measure and features exactly valid uncertainty quantification, and then returns a so-called inner probabilistic approximation thereof. This inner probabilistic approximation inherits many of the original IM’s desirable properties, including credible sets with exact coverage and asymptotic efficiency. The approximation also agrees with the familiar Bayes/fiducial solution obtained in applications where the model has a group transformation structure. A Monte Carlo method for evaluating the probabilistic approximation is presented, along with numerical illustrations. Keywords and phrases: Confidence distribution; credal set; fiducial inference; p-value; possibility theory; relative likelihood; validity. 1 Introduction The program in which science advances by formulating what’s currently known, however vague or incomplete that might be, as prior beliefs and then applying a normative procedure to update those prior beliefs in light of new data is natural and deeply rooted in all of us who’ve studied probability and statistics. Despite its appeal, this program is challenging to implement for several reasons, not the least of which is that genuine prior information is rarely available, hence no particular formulation of prior beliefs is warranted. Brad Efron, in his presentation at the 2016 Joint Statistical Meetings in Chicago, said that “scientists like to work on new problems,” meaning that there’s often no history or experience to draw from in order to build a meaningful prior distribution. For similar reasons, Efron, 2013 stated more formally that “…the most important unresolved problem in statistical inference is the use of Bayes theorem in the absence of prior information.” The present paper offers new insights, theory, and methodology with the ambitious goal of resolving this most important unresolved problem. Fisher, 1933 ; Fisher, 1935a ; Fisher, 1935b and his fiducial argument was the first proposed solution to the above problem, making “a bold attempt to make the Bayesian omelet without breaking the Bayesian egg” ( Savage, 1961 ) ; see Zabell, 1992 for an excellent survey. The consensus is that Fisher’s solution failed, but even his “biggest blunder” ( Efron, 1998 ) had a major impact, inspiring fundamental advances such as confidence limits ( Neyman, 1941 ) , imprecise probability ( Dempster, 1966 ) , and new proposed solutions, including generalized fiducial inference ( Hannig et al., 2016 ; Murph et al., 2021 ) , confidence distributions ( Xie and Singh, 2013 ; Thornton and Xie, 2020 ; Cox, 2006 ; Schweder and Hjort, 2016 ) , and objective/non-informative Bayes ( Jeffreys, 1946 ; Berger, 2006 ; Berger et al., 2009 ; Kass and Wasserman, 1996 ) . In what follows, to keep terminology simple, I’ll (inaccurately) refer to all of these approaches as no-prior Bayes solutions . A difficulty with Bayesian-like probabilistic inference in this no-prior setting concerns the interpretation of the posterior probabilities themselves. When genuine prior information is available, then the Bayesian posterior probabilities are the unique coherent updates of prior beliefs given the observed data. But when there’s no prior beliefs to update, and a default prior is used in its place, of course the aforementioned “updating” interpretation disappears and, consequently, it’s unclear if the corresponding posterior distribution is meaningful at all. Indeed, “[Bayes’s formula] does not create real probabilities from hypothetical probabilities” ( Fraser, 2014 ) and, put a bit more forcefully, …any serious mathematician would surely ask how you could use [Bayes’s theorem] with one premise missing by making up an ingredient and thinking that the conclusions of the [theorem] were still available. ( Fraser, 2011b ) Fortunately, coherent updating of prior beliefs isn’t necessary for a posterior to have belief-forming inferential weight. But making this case requires, first, defining what it takes for a framework to have belief-forming inferential weight and, second, demonstrating that a proposed framework meets this requirement. To me, the only way forward is to demonstrate that the posterior probabilities are reliable , i.e., it’s a demonstrably rare event that the posterior assigns high (resp. low) probabilities to assertions about the unknown that are false (resp. true). The advantage of such a requirement is that the belief-forming inferential weight is inherited from Fisher’s inductive logic: if, e.g., assigning high probability to a false assertion is a rare event and, in the application at hand, the assertion is assigned high probability, then it’s safe to infer that the assertion is true because rare events effectively don’t happen. No-prior Bayes solutions often have some form of reliability, but the false confidence theorem ( Balch et al., 2019 ) says that none have the strong reliability property I just described; see, also, Martin, 2019 ; Martin, 2024b and Section 2 below. Since no-prior Bayes solutions can’t offer reliable belief assignments, there’s motivation to look beyond these existing approaches. An alternative to these probabilistic approaches is the inferential model (IM) framework ( Martin and Liu, 2013 ; Martin and Liu, 2015a ; Martin, 2022b ; Martin, 2024a , e.g.,) , which returns a data-dependent possibility measure offering reliable uncertainty quantification about unknown parameters. Further details and references about possibility measures and the specific IM construction are given in Section 2 below. Importantly, my proposed shift from probabilistic to possibilistic uncertainty quantification facilitates strong reliability and, among other things, this strong reliability implies the usual frequentist error rate control without giving up on the fully conditional Bayesian-like reasoning. Despite the obvious benefits, I’m under no delusion that statisticians will abandon probabilistic inference in favor of possibilsitic IMs in the near future. But that doesn’t mean IMs have to wait for the distant future to make a contribution. The “reIMagined” approach I’m proposing here starts with the provably reliable possibilistic IM and then reads off and returns an inner probabilistic approximation as a novel no-prior Bayes solution. As I’ll demonstrate below, the proposed inner probabilistic approximation inherits some—but necessarily not all—of the original possibilistic IM’s strong reliability properties: in particular, the corresponding credible sets for the full parameter are exact confidence sets. There’s just only so much that can be achieved by constructing default priors and checking if the corresponding posterior distributions are reliable. This motivates a new approach, and my suggestion is to prioritize the reliability properties and directly construct a data-dependent probability that has those desired properties. The remainder of the paper is organized as follows. Some brief background on possibility theory and possibilistic IMs is presented in Section 2 . A characterization of the possibilistic IM’s credal set is presented in Section 3 , which is then used to define the corresponding inner probabilistic approximation. Various properties of the proposed inner probabilistic approximation are developed in Section 4 , including a correspondence with the familiar no-prior Bayes solutions in models that feature a group-theoretic invariance property and a version of the celebrated Bernstein–von