Nonparametric predictive inference for discrete data via Metropolis-adjusted Dirichlet sequences

Davide Agnoletto, Tommaso Rigon, David B. Dunson · 2025

Read Nonparametric predictive inference for discrete data via Metropolis-adjusted Dirichlet sequences by Davide Agnoletto, Tommaso Rigon, David B. Dunson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08629.txt.

Introduction

Davide Agnoletto, Tommaso Rigon, and David Dunson build a Bayes method to predict next counts with no stiff form for the source. Count data, births, claims, goals, often fit no clean curve, and mixture models cost much to run. Their 2025 chain, the MAD sequence, makes each next call a mix of a base distribution and step kernels set on past points. The step rule is tuned so the chain stays fair.

In the long run the sequence trades like a fair draw, and the back view of the source takes a walk form that is easy to sample from. A bell-curve close form aids fast work. Methods stretch to multi-count, regression, and yes-no data, with case runs shown.

Catalog record

CREATORDavide Agnoletto, Tommaso Rigon, David B. Dunson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-08629

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonparametric predictive inference for discrete data via Metropolis-adjusted Dirichlet sequences Davide Agnoletto, Tommaso Rigon, David B. Dunson Abstract This article is motivated by challenges in conducting Bayesian inferences on unknown discrete distributions, with a particular focus on count data. To avoid the computational disadvantages of traditional mixture models, we develop a novel Bayesian predictive approach. In particular, our Metropolis-adjusted Dirichlet ( mad ) sequence model characterizes the predictive measure as a mixture of a base measure and Metropolis-Hastings kernels centered on previous data points. The resulting mad sequence is asymptotically exchangeable and the posterior on the data generator takes the form of a martingale posterior. This structure leads to straightforward algorithms for inference on count distributions, with easy extensions to multivariate, regression, and binary data cases. We obtain a useful asymptotic Gaussian approximation and illustrate the methodology on a variety of applications. Keywords: Count data; Martingale posterior; Nonparametric Bayes; Predictive inference; Smoothing 1 Introduction Bayesian nonparametric modeling of count distributions is a challenging task, and several solutions have been proposed over the years. A Bayesian nonparametric mixture of Poisson kernels lacks flexibility since both centering and scaling of the kernels are controlled by a single parameter. Canale and Dunson 2011 , Canale and Prünster 2017 proposed a more flexible class of kernels obtained by rounding continuous distributions. However, estimating these mixture models using Markov chain Monte Carlo ( mcmc ) algorithms can be cumbersome in practice. Alternatively, one can directly specify a Dirichlet process ( dp ) prior ( Ferguson 1973 ) on the data generator as Y_{i}\mid P\overset{\textup{iid}}{\sim}P,\qquad P\sim\text{DP}(\alpha,P_{0}), (1) where Y_{i}\in\mathcal{Y} , i=1,\ldots,n , are assumed to be independent and identically distributed (iid) conditionally on P , \mathcal{Y} is a countable space, \alpha is the precision parameter, and P_{0} is a base parametric distribution, such as a Poisson. Despite the appealing flexibility, it is well known that assuming ( 1 ) produces the conjugate posterior distribution P\mid y_{1:n}\sim\mathrm{DP}\Big(\alpha+n,P_{0}+\sum_{i=1}^{n}\delta_{y_{i}}\Big), with y_{1:n}=(y_{1},\dots,y_{n}) , which lacks smoothing and therefore tends to have poor performance unless the distribution is concentrated on a small number of values. However, using traditional Bayesian nonparametric machinery, it is not clear how to specify a nonparametric process P having the same simplicity and flexibility as ( 1 ) while allowing smoothing. This motivates taking a predictive approach, which bypasses the need to directly specify a prior for P . In a predictive approach, the statistical uncertainty is taken into account by modeling the conditional distribution of new data Y_{n+1} given past observations y_{1:n} . Blackwell and MacQueen 1973 described the predictive rule resulting from the dp prior using a Pólya urn scheme for which Y_{1}\sim P_{0} and Y_{n+1}\mid y_{1:n}\sim P_{n} for n\geq 1 , where P_{n}(A)=\mathds{P}(Y_{n+1}\in A\mid y_{1:n})=\frac{\alpha}{\alpha+n}P_{0}(A)+\frac{1}{\alpha+n}\sum_{i=1}^{n}\mathds{1}(y_{i}\in A), (2) for any measurable set A\subseteq\mathcal{Y} and where \mathds{1}(\cdot) denotes the indicator function. The sequence (Y_{n})_{n\geq 1} generated according to ( 2 ) is known as a Dirichlet sequence and is a conditionally iid random sample from P , with {P\sim\textsc{DP}(\alpha,P_{0})} . Although predictive laws can be obtained by marginalizing models of the form in ( 1 ), potentially with alternative priors used in place of the dp , we instead start by defining the predictive law P_{n} . Thanks to Ionescu-Tulcea’s theorem one can characterize the law of the joint sequence (Y_{n})_{n\geq 1} by specifying a sequence of one-step-ahead predictive distributions. Moreover, if the resulting sequence is exchangeable, de Finetti’s theorem implies the existence of a random probability measure P , conditionally on which the data are iid. This strategy bypasses prior elicitation; in our case, avoiding the difficult problem of directly specifying a prior for P . Moreover, it highlights how the tasks of inference and prediction are intrinsically connected within the Bayesian paradigm. There is a growing recent literature discussing the foundations of the Bayesian predictive approach, see for example Fortini and Petrone 2012 ; Fortini and Petrone 2023 ; Fortini and Petrone 2025 , Holmes and Walker 2023 , Fong et al. 2023 , Berti et al. 2025 . It is reasonable to think that a better estimator for count data distributions would be obtained by replacing \mathds{1}(\cdot) in ( 2 ) with a more diffuse kernel that allows the borrowing of information between the atoms. Early ideas along these lines can be found in Hjort 1994a ; Hjort 1994b , whereas Berti et al. 2023b provide a rigorous recent discussion. Unfortunately, for a general choice of the kernel, the corresponding sequence of predictive distributions does not generate an exchangeable sequence of random variables ( Sariev and Savov 2024 ) , which is required for recovering the posterior distribution through de Finetti’s theorem. To address this problem, we consider a generalization of the predictive approach that relaxes the exchangeability assumption. In this paper, we introduce a novel generalized Bayesian predictive method to model count data distributions. We propose the recursive predictive rule P_{n}(A)=(1-w_{n})P_{n-1}(A)+w_{n}K_{n}(A\mid y_{n}), (3) for any measurable set A\subseteq\mathcal{Y} , where (w_{n})_{n\geq 1} is a sequence of decreasing weights w_{n}\in(0,1) , and, for all n\geq 1 we let K_{n}(\;\cdot\mid y_{n})=K(\;\cdot\;;y_{n},P_{n-1}) be a sequence of Metropolis-Hastings ( mh ) kernels, which will be formally defined in Section 2 . The special case ( 2 ) is recovered for w_{n}=(\alpha+n)^{-1} and K_{n}(\cdot\mid y_{n})=\mathds{1}(y_{n}\in\cdot) . The simple structure ( 3 ) resembles a frequentist kernel density estimator ( kde , Wand and Jones 1995 ) under a particular choice of weights w_{n} , where mh kernels centered at the observed data points serve a similar role to local kernels in kde . More precisely, if w_{n}=(\alpha+n)^{-1} , then the recursion in equation ( 3 ) becomes P_{n}(A)=\frac{\alpha}{\alpha+n}P_{0}(A)+\frac{1}{\alpha+n}\sum_{i=1}^{n}K_{i}(A\mid y_{i}). This is similar in spirit to the recursive predictive algorithms of Hahn et al. 2018 ; Fong et al. 2023 , but, crucially, we specify a kernel K_{n}(\cdot\mid y_{n}) tailored for count data. The predictive rule ( 3 ) with mh kernels generates a Metropolis-adjusted Dirichlet ( mad ) sequence, which we show to be conditionally identically distributed ( cid , Kallenberg 1988 ; Berti et al. 2004 ). In particular, mad s are cid sequences admitting a recursive structure ( Berti et al. 2023a ) . Consequently, mad sequences are asymptotically exchangeable, which means that, for large n , (Y_{n})_{n\geq 1} can be regarded as an approximately iid sample from a random distribution P . In other words, the predictive ( 3 ) implies the existence of an implicit prior for P , which is a novel alternative to a dp . The posterior of P can be regarded as a martingale posterior in the sense of Fong et al. 2023 , implying that a predictive resampling algorithm can be used to obtain posterior samples for P allowing uncertainty quantification. The literature about cid sequences ( Berti et al. 2004 ; Berti et al. 2012 ; Fortini et al. 2018 ; Berti et al. 2021 ; Berti et al. 2023a ; Berti et al. 2025 , e.g.) has strong roots in probability theory, but the statistical properties of such sequences have not been fully investigated, with a few notable exceptions. An approach based on the direct specification of copulas is discussed in Hahn et al. 2018 ; Fong et al. 2023 , whose focus is on continuous

Read the complete text