Clustering data with values missing at random using scale mixtures of multivariate skew-normal distributions
Pillay J, Tortora C, Punzo A, Bekker A · 2025
Read Clustering data with values missing at random using scale mixtures of multivariate skew-normal distributions by Pillay J, Tortora C, Punzo A, Bekker A (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20329.txt.
Introduction
Jason Pillay, Cristina Tortora, Antonio Punzo, and Andriette Bekker cluster messy data with missing values in a 2025 paper. Real data sets often mix skewed, heavy-tailed groups with holes where values were never recorded. Standard clustering assumes tidy, complete, bell-shaped groups and breaks under those conditions.
Their method extends a flexible mixture family that already handles skew and heavy tails. It now also handles values missing at random, a common and workable assumption. The team derives the needed math for the missing parts and builds a tailored expectation algorithm. Closed-form steps keep the fitting practical. Because the plain normal model sits inside the family, older methods appear as special cases. The result widens model-based clustering to rougher real-world data.
Catalog record
| CREATOR | Pillay J, Tortora C, Punzo A, Bekker A |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20329
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Clustering data with values missing at random using scale mixtures of multivariate skew-normal distributions Pillay J, Tortora C, Punzo A, Bekker A Abstract Handling missing data is a major challenge in model-based clustering, especially when the data exhibit skewness and heavy tails. We address this by extending the finite mixture of scale mixtures of multivariate skew-normal (FMSMSN) family to accommodate incomplete data under a missing at random (MAR) mechanism. Unlike previous work that is limited to one of the special cases of the FMSMSN family, our method offers a cluster analysis methodology for the entire family that accounts for skewness and excess kurtosis amidst data with missing values. The multivariate skew-normal distribution, as parameterised by Azzalini & Valle 1996 and Arnold & Beaver 2002 includes the normal distribution as a special case, which ensures that our method is flexible toward existing symmetric model-based clustering techniques under a normality assumption. We derive the distributional properties of the missing components of the data and propose an augmented EM-type algorithm tailored for incomplete observations. The modified E-step yields closed-form expressions for the conditional expectations of the missing values. The simulation experiments showcase the flexibility of the FMSMSN family in both clustering performance and parameter recovery for varying percentages of missing values, while incorporating the effects of sample size and cluster proximity. Finally, we illustrate the practical utility of the proposed method by applying special cases of the FMSMSN family to global CO2 emissions data. Keywords: Mixture Models, skew-normal distribution, missing values at random. 1 Introduction Analysing high-dimensional data is now standard practice in industry and academia due to constant improvements in computational power and the increased availability of high-dimensional data. Model-based clustering is one of the more popular analysis tools because the results from the method are typically easy to interpret, and with the available computational power, the method is efficient in fitting the data. Finite mixture modelling is appropriate for describing heterogeneity in a population by assuming the said population is a mixture of sub populations, each of which can be modelled by a probability distribution. In theory, the finite mixture model’s design allows it to be fitted with any probability distribution needed. Historically mixtures of multivariate normal distributions have dominated the finite mixture modelling literature. These mixtures are often referred to as a Gaussian Mixture Models (GMMs). Their popularity is due to the algebraic and computational simplifications inherent to the multivariate normal distribution, which make it easier to fit data (recent examples of GMMs in applied fields include Zhu et al. 2022 ; Fu et al. 2021 ; Potemkin et al. 2024 ). This, combined until recently with a small literary pool providing theory on finite mixture models with other distributions, left practitioners assuming normality out of need rather than aptness or belief. There are datasets in many fields whose geometry is not sufficiently described by the elliptical symmetric normal distribution because they exhibit significant skewness. Noticeably, when cluster distributions are asymmetric and have heavier tails, GMMs often compensate by overestimating the number of clusters. The ’extra’ clusters are not helpful in practice and weaken the practitioner’s interpretations and analyses. The demand for a more flexible distribution that could handle asymmetry led to the development of the multivariate skew-normal distribution, first introduced by Azzalini & Valle 1996 . As the name suggests, the distribution’s construction encompasses normality as a special case but is also embedded with an explicit skewness parameter that can describe asymmetry. In recent times the multivariate skew-normal distribution has proven useful in chemistry ( Meija et al. 2020 ; Wagih et al. 2020 ; Fein et al. 2020 ), environmental, biomedical ( Lachos et al. 2010 ; Ferreira et al. 2016 ; Freitas et al. 2024 ), and economic ( Vernic 2006 ) fields including modelling toolkits such as linear regression, time series, and graphic models, ( Azzalini & Capitanio 1999 , Yong et al. 2021 ). The multivariate skew-normal distribution still does not address the heavy tails some empirical distributions exhibit. This motivated the construction of a family of new probability distributions borne of the multivariate skew-normal to handle excess kurtosis in data, known as Scale Mixture of Skew-Normal (SMSN) distributions. When extended to a clustering context, a finite mixture of SMSN distributions thus is a more flexible model that can better describe asymmetrical clusters in data. Several analyses have benefited from the SMSN family, including applications of the multivariate skew-hyperbolic ( Maleki et al. 2019 ), skew-t ( Mahdavi et al. 2021 ; Schumacher et al. 2021 ; Lachos et al. 2022 ), and skew-power-exponential ( Dang et al. 2023 ) distributions, among many other multivariate members ( Alencar et al. 2022 ; Cabral et al. 2012 ). Model-based clustering using the FMSMSN family displays a strong classification performance on complete datasets but cannot be applied as is to datasets with missing values (motivating examples can be found in Cabral et al. 2012 ; Cabral et al. 2012 ; Vrbik & McNicholas 2014 ). Incomplete datasets are a common challenge faced in numerous fields, including economic, environmental ( Griffith & Liau 2021 ), and, more commonly, public health and medical fields ( Gravesteijn et al. 2021 ). When data have missing values, practitioners usually either subset the complete data to fit a clustering method or use an array of imputation techniques to fill in the missing values and fit the same model on each imputation. The former discards valuable information, which could lead to a biased model fit and harms/weakens interpretations offered by the clustering results. The latter can be computationally expensive. It is thus worth pursuing imputation approaches to circumvent possible bias and variance suppression ( Little et al. 2024 ; Ayilara et al. 2019 ; Allen et al. 2021 ). From what was surveyed, the recent developments on accommodating missingness show a need and a varied use of special members of the SMSN family. Distributions such as the multivariate skew-normal and multivariate skew-t are among the popular members explored ( Alencar et al. 2022 ; Galarza et al. 2022 ; Lachos et al. 2022 ; Valeriano et al. 2023 ; Park et al. 2024 ). Many of these techniques assume a special property of missingness in data: the probability of a missing entry in an observed vector is not dependent on the value of said entry but potentially dependent on the value of the observed entries, otherwise known as Missing At Random (MAR) - see Seaman et al. 2013 for a discussion on apt definitions and properties of the types of missing patterns found in data. It is thus clear that the literature on extending model-based clustering for the FMSMSN family to fit to incomplete data is ongoing, but limited. This paper makes two primary contributions: one theoretical and one methodological. First, it extends the distribution theory of the multivariate skew-normal distribution explicitly in terms of a random vector’s observed and missing components. In this context, it allows us to derive the full probability distribution governing the Missing At Random (MAR) mechanism for all members of the FMSMSN family, a novel development not currently available in the surveyed literature. In doing so, it establishes crucial closed-form expressions for the expectation and covariance structures while