Assessing One‐Dimensional Cluster Stability by Extreme‐Point Trimming
2025
Read Assessing One‐Dimensional Cluster Stability by Extreme‐Point Trimming (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00258.txt.
Introduction
Erwan Dereure, Emmanuel Akame Mfoumou, and David Holcman assess one-dimensional cluster stability in 2025 by trimming extreme points. Given a sample of independent points on a line, the span shrinks as the most extreme points are removed one by one. The diameter-shrinkage ratio quantifies that relative reduction at each step.
The team derives formulas, with finite-sample corrections, for the expected shrinkage under uniform and Gaussian models. The two curves stay distinct even after moderate trimming. A simple rule assigns each sample to the closer profile, beating the classic likelihood-ratio test in small or noisy samples while staying consistent for large ones. The criterion also plugs into clustering methods to judge stability.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-00258
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Assessing One‐Dimensional Cluster Stability by Extreme‐Point Trimming Abstract We develop a probabilistic method for assessing the tail behavior and geometric stability of one-dimensional n i.i.d. samples by tracking how their span contracts when the most extreme points are trimmed. Central to our approach is the diameter-shrinkage ratio, that quantifies the relative reduction in data range as extreme points are successively removed. We derive analytical expressions, including finite-sample corrections, for the expected shrinkage under both the uniform and Gaussian hypotheses, and establish that these curves remain distinct even for moderate number of removal. We construct an elementary decision rule that assigns a sample to whichever theoretical shrinkage profile it most closely follows. This test achieves higher classification accuracy than the classical likelihood-ratio test in small-sample or noisy regimes, while preserving asymptotic consistency for large n. We further integrate our criterion into a clustering pipeline (e.g. DBSCAN), demonstrating its ability to validate one-dimensional clusters without any density estimation or parameter tuning. This work thus provides both theoretical insight and practical tools for robust distributional inference and cluster stability analysis. E. Dereure 1 1 1 Group of Applied Mathematics and Computational Biology, Ecole Normale Supérieure, PSL University, Paris, France. , E. Akame Mfoumou 1 , and D. Holcman 1, 2 2 2 Churchill College, Cambridge University, CB30DS UK. 1 Introduction The automated identification of clusters or isolated points is a fundamental step in many classification and spatial analysis pipelines [ 1 , 2 , 3 ] to identify structures in unlabeled data. Clustering typically begins by assigning labels to data points, indicating their membership to one or more groups. However, the strategies used to define these groups can vary significantly across clustering methods, depending on the underlying assumptions about data structure, density, or similarity. Clustering and classification algorithms can be broadly categorized into partitioning-based, hierarchical, and density-based methods. Partitioning methods, such as K-means [ 4 , 5 ] , Spectral Clustering [ 6 ] , and Support Vector Machines (SVMs) [ 7 ] , divide the data into distinct groups by optimizing specific criteria. K-means partitions data into a fixed number of spherical clusters by minimizing within-cluster variance. Spectral Clustering extends partitioning by leveraging the eigenstructure of similarity graphs to identify clusters with complex, non-convex shapes through an embedding step followed by a partitioning algorithm. Similarly, SVMs perform classification by implicitly mapping data into higher-dimensional feature spaces using the kernel trick, effectively partitioning data through linear separation in that transformed space. Unlike partitioning methods, hierarchical clustering builds a nested structure of clusters either from the bottom up (agglomerative, like Ward’s method [ 8 ] or from the top down (divisive [ 9 ] ). In contrast, density-based methods, such as DBSCAN [ 10 ] , identify clusters as dense regions of points separated by areas of lower density, allowing the discovery of arbitrarily shaped clusters and handling noise naturally, without needing to predefine the number of clusters. Together, these techniques offer complementary strengths, depending on the shape, scale, and noise level of the data. In applications where point clouds represent high-dimensional embeddings—such as cell representations extracted from deep learning models—unsupervised clustering plays a crucial role in uncovering latent structure prior to any downstream statistical inference. Identifying clusters automatically in such settings enables spatial statistical analyses to infer local organizational principles, as in [ 3 ] , where clusters correspond to cellular subtypes or functional microenvironments used to study how subtypes colonize brain area. Identifying clustering across a large population is thus a key step to generate the statitics. A persistent challenge, however, is the lack of an absolute definition of what constitutes a “cluster.” Indeed, in many spatial statistics frameworks, a cluster is meaningful only in contrast to a reference null model, often based on homogeneous Poisson or binomial point processes [ 11 ] . Two primary approaches have been widely employed to determine whether a given cluster represents a true hotspot or merely a spurious pattern. The frequentist approach typically relies on hypothesis testing, often implemented via Monte Carlo simulations, to assess whether the null hypothesis can be rejected [ 12 ] . In contrast, the Bayesian approach evaluates the posterior probability of the null hypothesis relative to alternative hypotheses [ 13 ] . For both paradigms, significant efforts have been made to reduce computational costs, leading to various optimization strategies and algorithmic improvements [ 14 , 15 , 16 ] . Recent works in computational geometry suggest alternative, model-free methods to assess the stability of point ensembles. For instance, the evolution of convex hulls [ 17 , 18 ] , Voronoi cells [ 19 ] , or nearest-neighbor graphs [ 20 ] can provide robust geometric indicators of underlying structure. We focus here on examining the stability of an ensemble under the removal of extreme points—i.e., those furthest from the center of mass. This perspective has also emerged in clustering robustness studies and outlier detection literature [ 21 , 22 ] . The present manuscrit is focusing in one dimension, ans we shall focus on how a segment length (diameter) and center of mass of a point cloud evolve as extreme points are removed successively. Intuitively, point clouds drawn from long-tailed distributions (e.g., Gaussian) are expected to undergo sharper geometric changes compared to those from compact distributions (e.g., uniform). We study here the evolution of geometric quantities for i.i.d. points in one dimension drawn from either a uniform distribution \mathcal{U}[0,L] or a Gaussian distribution \mathcal{N}(0,\sigma^{2}) . Specifically, in section 2 , we derive the distribution and moments of order statistics for both the uniform and Gaussian cases. We particularly examine the expected shift in the center of mass and the behavior of the segment length (diameter) as extreme points are successively removed. In subsection 3.1 , we introduce a family of geometric test statistics designed to discriminate between uniform and Gaussian samples. In particular, we propose an algorithm to assess the geometric stability of empirical one-dimensional distributions, which we benchmark against the likelihood ratio test. Finally, in subsection 3.2 , we demonstrate how this algorithm can be applied to clusters identified by a spatial clustering algorithm. These statistical test can be used for cluster validation, distributional testing, or as preprocessing steps for noise filtering and robust clustering. We show analytically and numerically that Gaussian-distributed ensembles are more sensitive to the removal of extreme points, revealing an intrinsic geometric fragility compared to uniformly distributed samples. This work bridges computational geometry, statistical inference, and robust clustering, and contributes to a growing literature on model-free geometric descriptors for point cloud analysis [ 23 , 24 , 25 ] . 2 Order statistics, center of mass, and segment stability under point removal In many statistical applications, particularly in unsupervised classification and geometric inference, a recurring question is whether an observed ensemble of points exhibits structural stability or reflects the influence of heavy-tailed variability. Motivated by this, we propose a method to assess the stability of point clouds in one dimension by iteratively removing extremal points—those furthest from the ensemble’s center of mass—and tracking the resulting geometric changes. We start with \mathcal{S}_{n}=\{x_{1},\dots,x_{n}\}\subset\mathbb{R} which is a sample of n i.i.d. real-valued random variables. To formulate a statistical criterion for assessing the underlying distribution of such a sample,