Posterior Consistency in Parametric Models via a Tighter Notion of Identifiability
2025
Read Posterior Consistency in Parametric Models via a Tighter Notion of Identifiability (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11360.txt.
Introduction
Nicola Bariletto, Bernardo Flores, and Stephen Walker go back to a base ask in Bayes-style data work. The work came out in 2025. When does the end spread settle on the truth as data grows? The book reply leans on smooth-form terms plus one key rule. That rule says split knob marks must give split spreads.
That rule is seldom probed. The team says a bad end can rise in one way sole. The truth must sit at a weak edge in a way that breaks the rule. Such breaks are at home in loose, form-free models, and read as forced in knob-based ones. The team's work shows the old smooth-form load is not a must. A bit more strict form of the rule, on its own, makes the end settle true. That holds when the best-fit pick fails to close in too.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11360
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Posterior Consistency in Parametric Models via a Tighter Notion of Identifiability Abstract We investigate Bayesian posterior consistency in parametric density models with proper priors, challenging the common perception that the topic is settled. Classical results from the 1970s established posterior consistency as a consequence of MLE convergence, by combining regularity conditions with the assumption of model identifiability. In particular, the latter was treated as a background assumption and never examined in depth. This approach has gone largely unquestioned, partly due to a subsequent and nearly exclusive shift in focus to sieve-based methods tailored to nonparametric consistency. In our analysis, we place identifiability at the heart of posterior consistency. We show that, once one enlarges the model family to include weak limits, inconsistency fundamentally stems from a failure of identifiability at the true distribution. This finding reveals an important distinction: while such a failure can occur naturally in nonparametric models, it is highly implausible and essentially self-inflicted in parametric ones. This motivates a separate treatment of the two cases, with our focus here on the parametric side. Our theory leads to the finding that classical regularity assumptions are overly restrictive, while a simple tightening of identifiability suffices to establish posterior consistency even in irregular models where the MLE is inconsistent. Moreover, we prove that inconsistency requires the presence of densities with pathological oscillations that precisely match the true distribution. As we exemplify with an illustrative model, such behavior may arise only if the modeler possesses exact prior knowledge of the ground truth and adversarially encodes it in the model. Our example also underscores the need for distinct tools to study frequentist and Bayesian consistency: while MLE inconsistency stems from overfitting caused by likelihood peaks at the data—appropriately addressed through regularity or sieve methods—Bayesian parametric inconsistency is more naturally resolved by examining the identifiability structure of the model. Nicola Bariletto Bernardo Flores Stephen G. Walker The University of Texas at Austin August 24, 2026 1 Introduction Asymptotic consistency is a fundamental criterion for evaluating the quality of statistical estimation procedures. In Bayesian inference, the study of consistency of posterior distributions has been a highly active area of research, with the first contributions dating back to Joseph Doob’s work ( Doob,, 1949 ) . In his seminal result, Doob proved that, under a mild estimability condition, the posterior distribution asymptotically concentrates in arbitrary neighborhoods of the data-generating parameter value (under the assumption that a true one exists), for any parameter value belonging to a set of prior mass one. While remarkably parsimonious in its assumptions, Doob’s approach was later reevaluated due to a major drawback: the theorem does not explicitly characterize the set of parameters at which the posterior is consistent, making it impossible to determine whether a given parameter belongs to this set, or how large its complement (where inconsistency may occur) is. Subsequent major contributions appeared in the late 1960s and through the 1970s, focusing on parametric models for density estimation based on independently and identically distributed (iid) observations. A prominent example is the work of Andrew Walker ( Walker,, 1969 ) ( Berk,, 1970 , see also) , which leveraged the extensive classical theory on the consistency of frequentist procedures, particularly maximum likelihood estimators (MLEs), to establish posterior consistency. These approaches involved imposing identifiability and regularity conditions on the parametric family of likelihoods—such as smoothness of the log-likelihood ratio near zero and appropriate decay outside compact sets—to ensure both MLE consistency and concentration of the posterior around the MLE, thereby guaranteeing the convergence of posterior mass towards the true parameter value. With Thomas Ferguson’s breakthrough definition of the Dirichlet process prior ( Ferguson,, 1973 ) , which made nonparametric inference practically feasible within the Bayesian framework, the literature on Bayesian consistency quickly shifted focus to infinite-dimensional models—partly due to the intriguing mathematical challenges they posed. Key early contributions include Diaconis and Freedman, 1986b () ; Diaconis and Freedman, 1986a () , followed by major developments in nonparametric density estimation ( Ghosal et al.,, 1999 ; Barron et al.,, 1999 ; Walker,, 2004 ) . The core idea in these works is to establish consistency using sieve methods which ensure that the posterior distribution concentrates within suitably defined neighborhoods of the true data-generating density. These approaches also paved the way for important theoretical advances—such as the study of contraction rates ( Ghosal et al.,, 2000 ; Ghosal and van der Vaart, 2007a, ; Lijoi et al.,, 2007 ) and misspecified models ( Kleijn and van der Vaart,, 2006 ; De Blasi and Walker,, 2013 ) —as well as for applications to specific nonparametric models ( Lijoi et al.,, 2005 ; Ghosal,, 2001 ; Ghosal and van der Vaart, 2007b, ; Ghosal and Roy,, 2006 ) . This trajectory of the literature has effectively shifted focus away from the parametric setting, with the study of nonparametric consistency nearly halting progress on the parametric side. As a result, conditions dating back more than 50 years, such as those in Walker, (1969) , remain the standard tools for establishing consistency in finite-dimensional models. 1 1 1 See, e.g., the recent textbook treatment in Ghosal and van der Vaart, (2017) , sect. 6.4. See instead Mao et al., (2024) ; Rustand et al., (2023) ; Miller, (2021) ; Doğan et al., (2021) for very recent applied and methodological work citing Walker, (1969) . Indeed, to the best of our knowledge, although posterior consistency has been extensively studied for certain specific parametric models in recent years, 2 2 2 For instance, in the case of finite mixtures ( Rousseau and Mengersen,, 2011 ; Guha et al.,, 2021 ) there has been little to no major development in the realm of general parametric consistency since the original contributions from the early 1970s. In this article, we argue that this has resulted in a narrow view of parametric consistency and left key aspects of the topic underexplored. Moreover, these trends have limited the available conditions for establishing consistency to those developed decades ago—a time when, due to the lack of tools for a genuinely Bayesian analysis, the best available approach was to tie posterior consistency to the regular behavior of the MLE, thereby evaluating the asymptotic performance of Bayesian procedures through their alignment with frequentist ones. 1.1 A new understanding of parametric consistency The key aim of this article is to conduct a fundamental reexamination of posterior parametric consistency. To set the stage for our discussion, consider the following standard modeling framework: let the sample space be (\mathbb{R},\mathscr{B}(\mathbb{R})) , 3 3 3 Throughout the article, we only consider \mathbb{R} as our sample space to facilitate exposition, though much of our treatment easily extends to higher-dimensional scenarios. where \mathscr{B}(T) denotes the Borel \sigma -algebra on a topological space T , and let \mathrm{d}x denote the Lebesgue measure on the real line. Define the statistical model \mathcal{F}_{\Theta}:=\{f_{\theta}:\theta\in\Theta\} , where f_{\theta}:=\mathrm{d}F_{\theta}/\mathrm{d}x is the density (Radon--Nikodym derivative) associated with a probability measure 4 4 4 With a slight abuse of notation, we identify any probability measure F on (\mathbb{R},\mathscr{B}(\mathbb{R})) with its cumulative disribution function (CDF), writing F(x)\equiv F((-\infty,x]) for all x\in\mathbb{R} . F_{\theta}(\mathrm{d}x)\ll\mathrm{d}x parametrized by \theta\in\Theta\subseteq\mathbb{R}^{p} , for some p\in\mathbb{N} , and where \Theta is assumed to be closed. As is natural