Composite Silhouette: A Subsampling-based Aggregation Strategy

Aggelos Semoglou, Aristidis Likas, John Pavlopoulos · 2026

Read Composite Silhouette: A Subsampling-based Aggregation Strategy by Aggelos Semoglou, Aristidis Likas, John Pavlopoulos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13816.txt.

Introduction

Semoglou, Likas, and Pavlopoulos propose Composite Silhouette for picking cluster counts without labels. Micro-averaged Silhouette favors big clusters when sizes vary. Macro-averaging weights clusters equally but lifts noise from small groups. Their criterion averages repeated subsamples. Within each subsample, micro- and macro-averages combine via an adaptive weight set by their normalized gap, smoothed by a bounded function. Finite-sample guarantees back it. On synthetic and real data, true cluster counts come out more accurately.

Catalog record

CREATORAggelos Semoglou, Aristidis Likas, John Pavlopoulos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58756
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13816

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Composite Silhouette: A Subsampling-based Aggregation Strategy Aggelos Semoglou, Aristidis Likas, John Pavlopoulos Abstract Determining the number of clusters is a central challenge in unsupervised learning, where ground-truth labels are unavailable. The Silhouette coefficient is a widely used internal validation metric for this task, yet its standard micro-averaged form tends to favor larger clusters under size imbalance. Macro-averaging mitigates this bias by weighting clusters equally, but may overemphasize noise from under-represented groups. We introduce Composite Silhouette, an internal criterion for cluster-count selection that aggregates evidence across repeated subsampled clusterings rather than relying on a single partition. For each subsample, micro- and macro-averaged Silhouette scores are combined through an adaptive convex weight determined by their normalized discrepancy and smoothed by a bounded nonlinearity; the final score is then obtained by averaging these subsample-level composites. We establish key properties of the criterion and derive finite-sample concentration guarantees for its subsampling estimate. Experiments on synthetic and real-world datasets show that Composite Silhouette effectively reconciles the strengths of micro- and macro-averaging, yielding more accurate recovery of the ground-truth number of clusters. 1 Introduction Clustering evaluation remains a crucial but challenging step in unsupervised learning, largely due to the inherent difficulty of assessing solutions without labeled data 10 . Among various internal clustering evaluation metrics, the Silhouette coefficient 17 is one of the most widely adopted, as it effectively quantifies the compactness and separation of clusters using only intrinsic dataset properties. Its ease of interpretation and widespread implementation in libraries such as scikit-learn 15 have made it a default choice in many practical applications. However, the traditional approach, micro-averaging Silhouette scores across all individual data points 2 , is known to exhibit significant bias, particularly in datasets with imbalanced cluster sizes, frequently encountered in real-world applications. In such cases, larger clusters can disproportionately influence the final score, potentially masking poor separation in minor clusters 14 . An alternative yet rarely utilized strategy, macro-averaging, aggregates Silhouette scores by first computing the mean Silhouette per cluster and then averaging across clusters. Although macro-averaging mitigates cluster-size bias by assigning equal weight to clusters irrespective of their sizes, it can overly emphasize smaller or under-represented clusters. Clustered Data \boldsymbol{C_{1}} Majority Group \boldsymbol{C_{2}} Minority Group Silhouette Aggregation Micro-Averaging Point-wise Weighting Evaluation across all data points: Every individual data point exerts equal influence on the score. Macro-Averaging Cluster-wise Weighting Evaluation across all identified clusters: Each cluster is weighted equally on the score. Domain Impact Business Analytics Focus on global utility . System performance is dominated by the bulk population ( C_{1} ); minority clusters are marginal. Medical Diagnostics Focus on patient-pattern discovery . Minority clusters ( C_{2} ) represent meaningful subgroups that must remain visible. The Inductive Bias Conflict It is often unclear whether a local structure represents a valuable subgroup (requiring Macro) or irrelevant statistical noise (requiring Micro). Practitioners face a bias trade-off with no universal selection criterion . Figure 1 : Silhouette aggregation strategies: Global trends vs. local patterns. This trade-off is especially evident in real-world settings. For instance, in medical clustering 23 , where rare but clinically important patient subgroups must be identified, macro-averaging is often preferable because it ensures that these small clusters are not overshadowed. In contrast, in customer segmentation 11 , where the business impact of large, well-defined customer groups dominates, micro-averaging tends to better reflect practical utility. Yet in other domains, such as topic clustering 24 , where some themes are broad and frequent while others are niche but still valuable, it is often unclear which strategy should be preferred. Depending on the application, both majority coherence and minority representation may be important. Consequently, practitioners face a critical choice between two fundamentally different aggregation strategies, each having its own limitations, and with no clear rule for balancing them across datasets and clustering solutions (Fig. 1 ). Moreover, the disagreement between micro- and macro-averaging may itself carry useful information, as it can indicate whether clustering quality is driven primarily by majority structure or by the fidelity of smaller groups. This suggests that, rather than selecting one aggregation strategy globally, a more effective criterion should adapt to how these two perspectives agree or diverge across different views of the data. The absence of such a criterion is particularly problematic in practical settings, where internal validation metrics guide the choice of the optimal number of clusters. In such cases, inconsistent or biased metrics can lead to misleading evaluations and suboptimal clustering decisions. This raises a central question: Could an internal validation metric combine the strengths of micro- and macro-averaged Silhouette scores to guide cluster-count selection more accurately and reliably, without prior assumptions about which aggregation strategy is preferable? To address this question, we introduce Composite Silhouette, a subsampling-based internal validation criterion that aggregates micro- and macro-averaged Silhouette scores over repeated subsampled clusterings. Instead of relying on a single partition or enforcing a fixed global preference between micro- and macro-averaging, our method computes the two scores on each subsampled clustering and combines them through a subsample-specific convex combination, whose mixing weight is determined by the normalized discrepancy between them and smoothed by a bounded nonlinearity. The final score is then obtained by averaging these per-subsample composite scores across subsampling trials, yielding a more stable and adaptive criterion for cluster-count selection. In this sense, Composite Silhouette performs discrepancy-driven adaptive aggregation: the relative weight assigned to the two Silhouette views is determined locally at the subsample level, rather than fixed in advance for the entire dataset. This allows the criterion to respond to heterogeneous structure without committing a priori to either majority-dominated or minority-sensitive evaluation. We show that this formulation enjoys useful deterministic properties and admits finite-sample concentration guarantees for its subsampling estimate. Across synthetic and real-world datasets, Composite Silhouette accurately identifies the number of clusters in regimes where either micro- or macro-averaging alone would be effective, without requiring prior knowledge of which aggregation strategy is better suited to the data, while remaining competitive in balanced settings. Against a broad range of internal validation baselines, including both averages over subsampled clustering runs and averages from repeated clustering runs on the full dataset, Composite Silhouette achieves the strongest overall performance in recovering the ground-truth number of clusters. Overall, this work offers a principled and practical alternative to existing internal validation metrics, enabling more reliable model selection in settings where traditional approaches may fail to capture the underlying cluster structure accurately. Our code for Composite Silhouette is publicly available at: https://github.com/semoglou/comp_sil . 2 Related Work Internal cluster validity indices Internal validity indices provide a label-free way to evaluate clustering solutions by examining only the geometry and dispersion of the data 7 ; 8 ; 1 . Some indices focus on cluster separation, such as the Dunn index 6 , which takes the ratio of the minimum inter-cluster distance to the maximum intra-cluster diameter to ensure worst-case separation. Other measures, like the Calinski–Harabasz criterion 3 , compare between-cluster dispersion against within-cluster dispersion, favoring compact, well-separated groups. The Davies–Bouldin index 4 quantifies cluster similarity by averaging, for each cluster, the worst ratio of its scatter to its nearest neighbor’s separation and selects the clustering that minimizes this average. Among these, the Silhouette Coefficient stands out for its interpretability: it assigns each point a score in

Read the complete text