Informed Asymmetric Dirichlet Priors for Multivariate Bernoulli Mixture Models
Luisa Ferrari, Maria Franco Villoria, Garritt L. Page, Alex Laini · 2026
Read Informed Asymmetric Dirichlet Priors for Multivariate Bernoulli Mixture Models by Luisa Ferrari, Maria Franco Villoria, Garritt L. Page, Alex Laini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21545.txt.
Introduction
Luisa Ferrari and three colleagues propose a Bayesian method for grouping binary data, as in ecology, via Bernoulli mixtures. Many methods trade speed against full inference; their method delivers both. They fix a group count with an asymmetric Dirichlet prior on mixture weights, with prior settings from Penalized Complexity, letting users shape the induced cluster-count spread. An MCMC routine fits the model. Simulations and applications show the method matching rivals, beating them in some settings. A presence-absence dataset shows the proposal, with cluster parameters tied to environment.
Catalog record
| CREATOR | Luisa Ferrari, Maria Franco Villoria, Garritt L. Page, Alex Laini |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55850 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21545
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Informed Asymmetric Dirichlet Priors for Multivariate Bernoulli Mixture Models Luisa Ferrari, Maria Franco Villoria, Garritt L. Page, Alex Laini Abstract Clustering multivariate binary data is of interest in many scientific fields, including ecology, biomedicine, and social policy. Beyond heuristic clustering algorithms, such data can be modelled using multivariate Bernoulli mixture models. Many Bayesian implementations of these models involve a trade-off between computational efficiency and full posterior inference. We propose instead a Bayesian approach able to provide both aspects. The method fixes the total number of components to a large value and employs an asymmetric Dirichlet prior on the mixture weights. The asymmetric Dirichlet hyperparameters are elicited using the popular Penalized Complexity prior framework, which provides an intuitive way for users to inform the induced distribution of the number of clusters. An efficient MCMC algorithm is then developed to fit the model. Simulations and real-world applications demonstrate that the method is competitive with existing alternatives and can outperform them in certain settings. The proposal is illustrated using an ecological dataset about presence–absence of species across multiple sites, where cluster-specific parameters are modelled on the basis of environmental conditions. Overall, the proposed method provides a computationally efficient, fully Bayesian, and interpretable framework for clustering multivariate binary data, with potential applications across diverse scientific domains. 1 Introduction Multivariate binary data consist of multiple binary responses recorded jointly for the same statistical unit, so that each observation is a vector of 0/1 outcomes rather than a single binary variable. This structure arises naturally in many scientific fields. In biomedicine, individuals are frequently described by binary indicators representing the presence or absence of multiple diseases, clinical conditions or genetic variants, as in comorbidity studies, disease classification and treatment response ( 35 ) . In ecological studies, a species (or another taxon) is typically detected in only a subset of the sampled sites within a given area. In particular, studies that only record binary presence–absence information for species (or intraspecies genetic variants) have become increasingly common due to the widespread adoption of DNA metabarcoding techniques for genetic identification ( 32 ) . In social policy, countries are often described by sets of binary indicators capturing the adoption of policies or institutional features ( 34 ) . In many instances, it is of interest to cluster the multivariate binary observations to find underlying structures. For example, clustering ecological presence–absence matrices can help identify groups of species with similar habitat preferences, revealing co-occurring species assemblages ( 16 ) . These assemblages are useful for informing conservation strategies and improving ecological monitoring by summarizing complex biodiversity patterns into fewer subgroups. Likewise, in biomedicine and genetics, clustering individuals based on binary disease or genetic profiles can uncover subphenotypes, which may correspond to distinct therapeutic responses or risk factors, thereby supporting the need for targeted interventions and personalized medicine ( 1 ; 31 ) . Similar objectives appear in several other fields, including text classification ( 13 ) , voting data ( 12 ) , and animal classification ( 18 ) . These applications illustrate the broad utility of clustering methods for multivariate binary data. While algorithmic clustering procedures are often straightforward to implement, they are inferentially limited and challenging to extend to complex modeling scenarios. On the other hand, model-based approaches provide probabilistic assignment of observations to clusters, can readily incorporate covariates, easily accommodate missing data, quantify uncertainty in cluster parameter estimation, and facilitate estimation of the number of clusters from the data ( 21 ) . Model-based clustering is typically formulated through finite mixture models (FMMs), in which the distribution of an observed response (denoted by Y_{i} ) is expressed as the following convex combination of K component distributions with mixing proportions \omega_{k}\geq 0,\sum_{k=1}^{K}\omega_{k}=1 : \displaystyle p(Y_{i}~\mid~\bm{\theta}_{1},\ldots,\bm{\theta}_{K})=\sum_{k=1}^{K}\omega_{k}p_{k}(Y_{i}~\mid~\bm{\theta}_{k}). (1) Here, the \bm{\theta}_{k}\in\mathbb{R}^{d} denote cluster-specific parameters. The number of components K can be fixed to a specific value or assigned a prior. Either way however, K does not necessarily correspond to the number of clusters, which is instead defined as the data-informed number of occupied components (denoted by K^{+} ), and can be estimated regardless of how K is treated. In the context of multivariate binary data, p_{k}(\cdot~\mid~\bm{\theta}_{k}) in ( 1 ) is a multivariate Bernoulli distribution, where conditional independence is usually assumed between the binary variables within clusters ( 2 ) . There are a variety of software packages that implement multivariate Bernoulli mixture models, including the EM-based implementation available in flexmix ( 17 ) , the MCMC-based Bayesian approach of BayesBinMix ( 28 ) , and the more recent variational inference proposal of VICatMix ( 29 ) . However, existing software implementations tend to prioritise either computational efficiency or full posterior inference, failing to achieve both simultaneously. Moreover, to the best of our knowledge, none of the available packages readily accommodate the inclusion of covariates in the modelling of latent component-specific parameters. An additional limitation, both in this context and more broadly in the FMM literature, is the little attention given to the specification of prior information on the number of clusters. As mentioned, in most cases the number of components K is either fixed a priori or assigned a relatively uninformative prior, with little consideration about the induced prior on the number of occupied components K^{+} and its implications in terms of prior beliefs and posterior inference. To address this gap, we propose a novel prior specification for multivariate Bernoulli mixture models, building on the recent approach of 26 , which has proven successful in univariate and multivariate Gaussian mixture models. The method is based on the use of an asymmetric Dirichlet prior on the mixture weights ( \omega_{1},\ldots,\omega_{K} ), which enables efficient posterior inference while retaining a fully Bayesian formulation. This specification also provides the advantage of an intuitive and flexible way to incorporate prior information about the number of clusters. In particular, it allows the user to tune the prior through two hyperparameters: one representing a soft upper bound on the expected number of clusters, and another reflecting the degree of uncertainty regarding this upper bound relative to smaller values. Furthermore, this framework facilitates prior sensitivity analysis, as the prior is formulated in a transparent and consistent way. This contributes to the growing literature on user-friendly and interpretable prior specification ( 10 ; 6 ; 23 ) . The remainder of the paper is organized as follows. In Section 2 , we provide the necessary background and notation for multivariate Bernoulli mixture models, and review existing implementations from the literature. Section 3 presents our proposed method, based on an asymmetric Dirichlet prior for the mixture weights, along with the details of the MCMC implementation used for posterior inference. In Section 4 , we evaluate the performance of the proposed approach through a simulation study. Section 5 illustrates the application of our method in two case studies: a simpler example on a handwritten digits dataset, and a real-world ecological application on an original dataset obtained from an author-led DNA metabarcoding campaign. Finally, Section 6 concludes with a discussion. Code to replicate the simulations and applications is available at the associated GitHub repository: https://github.com/LFerrariIt/binary_clustering/ . 2 Multivariate Bernoulli mixture model In this section, we introduce the formal framework for multivariate Bernoulli mixture models (MBMMs), essential for the understanding