Asymptotic efficiency of inferential models and a possibilistic Bernstein–von Mises theorem

Ryan Martin, Jonathan P. Williams · 2024

Read Asymptotic efficiency of inferential models and a possibilistic Bernstein–von Mises theorem by Ryan Martin, Jonathan P. Williams (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15243.txt.

Introduction

Ryan Martin and Jonathan P Williams tackle a core question in statistics in this 2024 study. Their framework, the inferential model, states doubt with ranges of belief rather than one exact chance. That style gives exact guarantees even in small samples, but it raised a worry: does the care cost speed, so that large samples still give loose answers?

The authors prove a new theorem that answers no. As samples grow, their method's belief range shrinks to the tightest set that still holds the best known bell-curve answer. They also extend the result to cases where extra unknowns must be removed first. That settles a standing dispute about which removal method keeps answers sharp, in favor of one of the two camps.

Catalog record

CREATORRyan Martin, Jonathan P. Williams
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE121 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-15243

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Asymptotic efficiency of inferential models and a possibilistic Bernstein–von Mises theorem Ryan Martin, Jonathan P. Williams Abstract The inferential model (IM) framework offers an alternative to the classical probabilistic (e.g., Bayesian and fiducial) uncertainty quantification in statistical inference. A key distinction is that classical uncertainty quantification takes the form of precise probabilities and offers only limited large-sample validity guarantees, whereas the IM’s uncertainty quantification is imprecise in such a way that exact, finite-sample valid inference is possible. But are the IM’s imprecision and finite-sample validity compatible with statistical efficiency? That is, can IMs be both finite-sample valid and asymptotically efficient? This paper gives an affirmative answer to this question via a new possibilistic Bernstein–von Mises theorem that parallels a fundamental Bayesian result. Among other things, our result shows that the IM solution is efficient in the sense that, asymptotically, its credal set is the smallest that contains the Gaussian distribution with variance equal to the Cramér–Rao lower bound. Moreover, a corresponding version of this new Bernstein–von Mises theorem is presented for problems that involve the elimination of nuisance parameters, which settles an open question concerning the relative efficiency of profiling-based versus extension-based marginalization strategies. Keywords and phrases: Bayesian; fiducial; Gaussian; large-sample; nuisance parameters; possibility theory; relative likelihood. This is an extended version of the paper ( Martin and Williams, 2024 ) presented at the 8th International Conference on Belief Functions , in Belfast, UK. 1 Introduction According to Efron, (2013) , “the most important unresolved problem in statistical inference is the use of Bayes theorem in the absence of prior information.” Numerous attempts have been made to resolve the problem, including Bayesian inference with default priors ( Jeffreys, 1946 ; Berger et al., 2009 ) , fiducial inference in Fisher’s original sense ( Fisher, 1935 ; Zabell, 1992 ) and its generalizations ( Fraser, 1968 ; Hannig et al., 2016 ; Dempster, 1967 ; Dempster, 2008 ) , and the various imprecise-probabilistic proposals ( Berger, 1984 ; Walley, 1991 ; Dubois, 2006 ; Augustin et al., 2014 , e.g.,) . Many of these solutions offer a large-sample result that goes roughly as follows: the associated credible sets achieve the nominal frequentist coverage probability when the sample size, n , is large. Statisticians insist on methods that are reliable in the sense of tending to report “correct inferences” across repeated uses, at least asymptotically, so results like this are high-value. The key result is the so-called Bernstein–von Mises theorem which says that, under certain regularity conditions, the Bayesian or fiducial posterior distribution is approximately Gaussian, centered at the maximum likelihood estimator, and is efficient in the sense that its variance equals the Cramér–Rao lower bound; here “approximately” is in the sense that the total variation distance between the two distributions is vanishing in probability as n\to\infty . For details, see van der Vaart, (1998, Ch. 10) , Ghosh et al., (2006, Ch. 4) , or Hannig et al., (2016) . Among other things, this result ensures that the Bayesian and fiducial uncertainty quantification at least approximately meets the kind of reliability requirements mentioned above when the sample size n is large. Still, the above Bayesian and fiducial developments have not proved to be fully satisfactory, perhaps because large-sample confidence sets fail to tell the whole story. Indeed, the false confidence theorem ( Balch et al., 2019 ; Martin, 2019 ; Carmichael and Williams, 2018 ) implies that, whether n is small or large, there exists false hypotheses to which the (Bayesian or fiducial) posterior distribution will tend to assign relatively high probability or confidence . False confidence is related to other familiar-yet-mysterious phenomena such as Stein’s paradox ( Stein, 1959 ) , the non-existence of finite-length confidence intervals ( Gleser and Hwang, 1987 ) , and that the “confidence” properties enjoyed by confidence distributions are not preserved under probability calculus ( Fraser, 2013 ; Fraser, 2011 ; Schweder and Hjort, 2013 , e.g.,) . To eschew the inherent unreliability revealed by the false confidence theorem, precise posterior probabilities must be replaced by imprecise probabilities. The inferential model (IM) framework, including the original developments in Martin and Liu, (2013) ; Martin and Liu, 2015a () and the more recent generalizations in Martin, 2021a () ; Martin, 2022a () ; Martin, 2022b () , does just this. Their proposal is provably valid in a sense that implies safety from false confidence and, e.g., it provides exact finite-sample confidence sets. But one might guess that in order to be provably valid, the IM must sacrifice on efficiency—that is, the aforementioned IM confidence sets must be larger than the asymptotically efficient Bayesian or fiducial credible sets. The examples in the aforementioned references all demonstrate, however, that, despite the imprecision and exact validity, the IM’s solutions are no less (and sometimes more) efficient than their Bayesian and fiducial counterparts. But so far there are no general theoretical results concerning the IM’s efficiency. Towards addressing this question about efficiency, this paper—an extended version of our conference paper, Martin and Williams, (2024) —presents a possibilistic version of the Bernstein–von Mises theorem that applies to the class of likelihood-based IMs considered in Martin, (2015) ; Martin, (2018) ; Martin, 2022b () . Specifically, we show that a version of the IM’s possibility contour, properly centered and scaled, can be accurately approximated by a Gaussian possibility contour with covariance matrix equal to the Cramér–Rao lower bound. More precisely, when n is large, the IM’s credal set is the smallest that contains the Gaussian distribution with variance equal to the Cramér–Rao lower bound. This result confirms our conjecture that, despite the IM’s inherent imprecision, which is necessary to achieve exact validity, there is no loss of efficiency asymptotically. It also generalizes the characterization result offered in Martin, 2023a () for group transformation models: for large n , the Bayesian and fiducial solutions (are roughly the same and) correspond to the inner probabilistic approximation of the IM, i.e., the Bayesian/fiducial posterior distribution is the “most diffuse” element in the IM’s asymptotic credal set. This result is extended to the practically important case where to-be-eliminated nuisance parameters are present, i.e., where only some feature of the full model parameter is of interest. There are two broadly acceptable ways to carry out marginalization in this possibilistic framework: one is based on the formal extension principle, which is purely possibility-theory-motivated, and the other is based on suitable profiling, which has statistical origins. Empirical evidence ( Martin, 2021a ; Martin, 2023b , e.g.,) strongly suggests that the profiling-based strategy is more efficient than the extension-based strategy, but so far there is no general theory available that confirms or explains this phenomenon. The asymptotic analysis presented in Section 4 formally settles this matter by demonstrating that, as conjectured, the profile-based strategy gives an asymptotically tighter possibility contour than the extension-based strategy. 2 Background 2.1 Possibility theory 2.1.1 Generalities Possibility theory is among the simplest imprecise probability theories, corresponding to so-called consonant belief structures (e.g., Shafer, 1976 , Ch. 10) , i.e., belief and plausibility functions with nested focal elements. Other key references include Zadeh, (1978) , Dubois and Prade, (1988) , and Dubois, (2006) . This simplicity comes in exchange for certain limits on its expressiveness, but

Read the complete text