Extending TCLUST to higher dimensions
Lucía Trapote, Luis Ángel García-Escudero, Agustín Mayo-Iscar · 2026
Read Extending TCLUST to higher dimensions by Lucía Trapote, Luis Ángel García-Escudero, Agustín Mayo-Iscar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03750.txt.
Introduction
Trapote and co-authors extend the robust clustering method TCLUST to high dimensions. Outliers distort many standard clustering tools and can wreck the partitions they return. Trimming-based methods cut outlier influence and help flag real anomalies. TCLUST trims in the spirit of the MCD estimator, across unknown multiple clusters. It shines on low-dimensional data but strains in high dimensions, where parameter counts explode.
A rival method, RLG, assumes clusters lie near low-dimensional subspaces. It falters when subspaces cross and assumes plain isotropic errors. The new method, tHHDC, merges both lines inside the HDDC frame. Trimming and eigenvalue constraints are added with care. Theory for the method comes with a feasible algorithm. A simulation study and a real-data example show its value. Input parameter choice is discussed as part of the package. Statisticians get a robust option for high-dimensional grouping.
Catalog record
| CREATOR | Lucía Trapote, Luis Ángel García-Escudero, Agustín Mayo-Iscar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 112 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03750
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Extending TCLUST to higher dimensions Lucía Trapote, Luis Ángel García-Escudero, Agustín Mayo-Iscar Abstract Outliers are known to significantly distort the results of many commonly used clustering methods, often leading to unreliable partitions. To address this issue, several robust clustering approaches have been developed that not only reduce their influence but also facilitate the detection of meaningful outliers. This presentation focuses on robust clustering methods based on trimming, especially TCLUST, which extends the type of trimming used by MCD in one-population problems to the more general case of multiple and unknown clusters. While TCLUST performs well on low-dimensional data, it struggles with high-dimensional datasets due to the complexity of estimating a large number of parameters. The Robust Linear Grouping (RLG) method offers an alternative by assuming clusters lie near lower-dimensional subspaces, thereby combining clustering with dimensionality reduction. However, RLG has limitations when subspaces intersect and assumes overly simplistic isotropic orthogonal errors. A robust clustering method extending TCLUST will be presented, building on the High Dimensional Data Clustering (HDDC) approach by incorporating trimming and eigenvalue constraints. This new approach, called tHHDC, combines TCLUST and RLG, requiring careful modification and integration of both methodologies within that HDDC framework. A study of the theoretical properties of this approach, together with a feasible algorithm for its implementation, will be presented. The interest of the proposed methodology, along with the issue of selecting input parameters, will be illustrated through a simulation study and a real-data example. 1 Introduction Outliers are a well-known challenge in cluster analysis, often leading to misleading or erroneous conclusions. Specifically, their presence can result in relevant and well-defined clusters being incorrectly merged or, conversely, in the detection of spurious clusters that do not correspond to any meaningful structure in the data. This motivates the interest in the use of robust clustering techniques ( 21 ; 2 ; 31 ; 19 ; 24 ) . These methods are specifically designed to withstand a certain proportion of outlying observations. In some cases, outliers can be interpreted as forming small, isolated clusters themselves, thereby suggesting an increase in the total number of clusters, G . However, inflating the number of clusters is not always a viable or effective strategy. It can be computationally infeasible and may undermine the interpretability of the clustering results. Additionally, clustered outliers represent one of the most difficult forms of contamination, as they can affect even robust statistical procedures. Consequently, adopting a unified approach that simultaneously addresses both clustering and outlier detection is a natural and effective strategy. This unified approach is also motivated by the close connection between cluster analysis and anomaly detection goals, since cluster analysis seeks to identify dense regions or “crowds” of data points, and anomaly detection focuses on identifying observations that lie far from these regions. Several robust clustering strategies have been proposed in the literature. One approach relies on heavy-tailed mixture models, such as mixtures of t -distributions or mixtures of contaminated Gaussian distributions ( 28 ; 29 ) . Another strategy is noise modeling, where outliers are fitted through uniformly distributed noise components ( 3 ; 11 ) . A third major direction consists of trimming-based approaches, where outliers are tried to be excluded from the clustering process ( 13 ; 27 ; 20 ) . In this paper, we focus on that trimming-based approach to robust clustering and, in particular in the TCLUST method ( 20 ) . Trimming methods are easy to interpret and statistically appealing: a predefined fraction \alpha of the data is excluded, under the assumption that these observations are the most outlying ones, and standard statistical tools are subsequently applied to the remaining data. The trimming approach adopted is data-driven and is similar to approaches used in robust statistics with high-breakdown-point behavior already applied in regression and multivariate estimation, such as the Least Trimmed Squares (LTS) estimator ( 34 ) and the Minimum Covariance Determinant (MCD) estimator ( 35 ) . The computational implementation of these techniques has been facilitated by the development of “concentration steps” or “C-steps”, introduced by 33 . The TCLUST method, applying trimming as well as appropriate constraints on the eigenvalues of the component scatter matrices, has shown good properties in terms of theoretical behavior, algorithmic performance, and robustness. We will review this TCLUST method in Section 2.1 . Unfortunately, these good properties become less satisfactory in practical applications when TCLUST is applied to high or even moderately high dimensions (for example, dimensions not smaller than 8 or 10). This performance degradation of TCLUST as p increases will be illustrated in Sections 4 and 5 . Two primary difficulties arise in high dimensions for TCLUST: first, the problem of initialization, as the algorithm heavily relies on a good random initialization for the concentration steps; and second, the high number of parameters to estimate, which grows rapidly with p due to the consideration of full covariance structures. It is obvious that higher-dimensional problems are increasingly common in modern statistical practice, and therefore it seems reasonable to attempt to extend this good performance of TCLUST to higher dimensions. Assuming that the observations are clustered around subspaces of lower dimension than the ambient space, it is reasonable to consider simultaneous robust clustering and dimensionality reduction. With this idea in mind, the robust linear clustering (RLG) method introduced in 17 incorporates trimming into a subspace-based clustering approach. This procedure, which we will review in Section 2.1 , has some limitations due to its simplifying assumptions of isotropic orthogonal errors, not adequately modeling the projections onto the approximating spaces, and troubles with intersecting subspaces. To extend the applicability of TCLUST to higher dimensions, we will present in Section 3 a compromise between TCLUST and RLG. This compromise builds on the HDDC methodology introduced in 7 by incorporating trimming and suitable constraints on the different dispersion-related parameters. After presenting the methodology in Section 3.1 , Section 3.2 introduces its population formulation, together with theoretical results on existence and consistency. A feasible algorithm for its practical implementation is presented in Section 3.3 . That algorithm requires certain modifications compared to the algorithms already proposed for RLG, TCLUST and HDDC. The methodology introduced in Section 3 involves the selection of a considerable number of tuning parameters. Section 4 provides guidance to help the reader understand the different roles these tuning parameters play. A procedure will also be introduced to determine, in a data-driven way, the intrinsic dimensions of the approximating subspaces. This procedure requires a modification of the objective function to include a model complexity penalty, similar to that considered in 9 . The practical interest of the proposal will be supported through simulations in Section 5 and by analyzing a well-known real dataset in Section 6 . Finally, Section 7 summarizes the main results obtained and outlines some open directions for future research. 2 TCLUST and RLG 2.1 TCLUST Although the first robust clustering method considering a data-driven trimmed approach was the trimmed k -means in 13 . Trimmed k -means, being an extension of the classical k -means method, inherits its preference for homoscedasticity and spherical clusters. To address this shortcoming, TCLUST was proposed in 20 as a more flexible, but still robust, alternative. TCLUST performs maximum likelihood estimation by assuming