Robust Functional Ward’s Linkages with Applications in EEG data Clustering Journal: Computational Statistics and Data Analysis

Tianbo Chen 1 · 2025

Read Robust Functional Ward’s Linkages with Applications in EEG data Clustering Journal: Computational Statistics and Data Analysis by Tianbo Chen 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11081.txt.

Introduction

Tianbo Chen and co-authors make a classic clustering method tougher against outliers, for data made of curves. Each unit in their data is a bundle of curves, as when one patient's brain recording gives many traces. Ward's linkage, the standard rule for merging clusters, compares the spread within clusters and breaks when stray curves distort it. Their 2025 paper defines two functional Ward-type linkages built for grouped curves.

The new rules judge a merger by how much wider a shared band around both clusters' central curves must grow. The centers themselves are chosen with outlier-resistant tools based on band depth and outlyingness. Simulations under varied contamination, plus two analyses of EEG brain data, show the methods hold up where the classic rule fails. The work gives neuroscientists and other curve-data users a clustering method that a few wild traces cannot hijack.

Catalog record

CREATORTianbo Chen 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11081

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Functional Ward’s Linkages with Applications in EEG data Clustering Journal: Computational Statistics and Data Analysis Tianbo Chen 1 Abstract This paper proposes two new distance measures, called functional Ward’s linkages, for functional data clustering that are robust against outliers. Conventional Ward’s linkage defines the distance between two clusters as the increase in sum of squared errors (SSE) upon merging, which can be interpreted graphically as an increase in the diameter. Analogously, functional Ward’s linkage defines the distance of two clusters as the increased width of the band delimited by the merged clusters. To address the limitations of conventional Ward’s linkage in handling outliers and contamination, the proposed linkages focus exclusively on the most central curves by leveraging magnitude-shape outlyingness measures and modified band depth, respectively. Simulations and real-world electroencephalogram (EEG) data analysis demonstrate that the proposed methods outperform other competitive approaches, particularly in the presence of various types of outliers and contamination. 1 Introduction Functional data clustering has become an active research area in recent years, with applications across various scientific fields. One notable example is electroencephalogram (EEG) data analysis. For instance, Euán et al., 2018 utilized the total variation distance (TVD) on estimated spectral densities to cluster resting-state EEG signals from different channels that are spectrally synchronized. Maadooliat et al., 2018 proposed a nonparametric collective spectral density estimation (NCSDE) algorithm for a collection of time series. The coefficients of the basis are used for clustering, thereby reducing the computational complexity. Chen et al., 2020 further extended NCSDE to spatial data, incorporating spatial dependence to construct spatially homogeneous clusters. In other scientific fields, Cheifetz et al., 2017 proposed two data-driven clustering methods for functional data, with applications in water demand modeling. A shape-based clustering approach using dynamic time warping (DTW) was proposed in Teeraratkul et al., 2017 , applied to consumer demand response data, resulting in a 50% reduction in the number of representative groups and an improvement in prediction accuracy. One critical issue in hierarchical clustering algorithms is to define the distance or linkage of two clusters. In addition to some well-known methods such as Ward’s linkage, centroid linkage, and complete linkage, there are many functional data clustering methods. Liao, 2005 concluded three approaches to clustering functional data: methods that depend on the comparison of the raw data, methods based on the comparison of models fitted to the data, and finally, methods based on features derived from the data. Jacques and Preda, 2014 categorized several conventional functional data clustering methods into three group: dimension reduction before clustering, nonparametric methods using specific distances or linkages between curves, and model-based clustering methods. [ Montero and Vilar, 2015 ] presented the TSClust package in R for time series clustering, offering a wide range of alternative linkage methods. Additional review articles can be found in Aghabozorgi et al., 2015 , Chamroukhi and Nguyen, 2019 , Cheam and Fredette, 2020 . Another crucial capability is robustness against outliers and contamination. A significant amount of research has focused on developing robust clustering algorithms for functional data. A widely used technique is trimming, where potential outlying data are deleted before clustering. Garcia-Escudero and Gordaliza, 2005 adopted the cubic B-spline basis and a variant of the k -means algorithm, called the trimmed k-means algorithm, where in each iteration of the algorithm, a fixed number of the most outlying coefficient vectors are excluded from calculating the cluster centers. Rivera-García et al., 2019 proposed a robust, model-based clustering method based on an approximation to the “density function” for functional data. By incorporating a trimming step, the method reduces the effect of contaminated observations. Beyond trimming, Wu and Yu, 2006 utilized independent component analysis (ICA) to obtain independent components for multivariate time series and developed a clustering algorithm called ICLUS to group time series according to the independent components. D’Urso et al., 2015 presented a robust clustering method based on autoregressive models, where a partition around medoids scheme is adopted and the robustness of the method comes from the use of a robust metric between time series. D’Urso et al., 2016 proposed a robust fuzzy clustering method for heteroskedastic time series based on GARCH models. Chen et al., 2021 developed a robust clustering algorithm for time series, where the distance measure is only based on the most central curve, with the centrality defined by the functional data depth. Our goal focuses on developing robust linkages for functional data. The idea arises from Ward’s minimum variance method, or Ward’s linkage [ Ward Jr, 1963 ] , where the distance between two clusters is defined as increased error sum of squares (SSE) when they are merged. In a graphical version, the linkage is the increment of diameter. We refer to [ Milligan, 1979 , Strauss and Von Maltitz, 2017 , Sharma et al., 2019 , Großwendt et al., 2019 ] for further details and related works. Inspired by Ward’s linkage, we propose functional Ward’s linkage, where the distance of two clusters of curves is defined as the increased width of the band delimited by the merged clusters. To deal with the sensitivity of Ward’s linkage to contamination and outliers, the two proposed functional Ward’s linkages rely exclusively on the most central curves in a cluster. We rank the curves in a cluster from the center outward by leveraging magnitude-shape outlyingness measures [ Dai and Genton, 2018b , Dai and Genton, 2019 ] and the modified band depth López-Pintado and Romo, 2009 , Sun and Genton, 2011 . By selecting the curves that with high centrality values, the proposed linkages reduce the impact caused by contamination and outliers. The rest of the paper is organized as follows. We introduce Ward’s linkage and propose two robust functional Ward’s linkages in Section 2 . In Section 3 , the performance of the proposed linkages is evaluated through two simulation experiments. The applications to the EEG data are presented in Section 4 , and we conclude the paper in Section 5 . 2 Methodology 2.1 Conventional Ward’s Linkage Ward’s linkage defines the squared distance between two clusters, denoted as \bm{C_{1}} and \bm{C}_{2} , as the increase in the sum of squared errors (SSE) when they are merged: D^{2}(\bm{C}_{1},\bm{C}_{2})={\rm SSE}(\bm{C}_{1}\cup\bm{C}_{2})-{\rm SSE}(\bm{C}_{1})-{\rm SSE}(\bm{C}_{2}). Intuitively, SSE represents the diameter of the clusters: {\rm dia}(\bm{C}_{i})=SSE(\bm{C}_{i})=\sum_{j=1}^{|\bm{C}_{i}|}(y_{ij}-\bar{y_{i}})^{\top}(y_{ij}-\bar{y_{i}})=|\bm{C}_{i}|\bar{d_{\bm{C}_{i}}},\text{}\text{}i=1,2, where {\rm dia}(\cdot) denotes the diameter, y_{ij} represents the j- th sample in cluster \bm{C}_{i} , \bar{y_{i}} is the centroid of cluster \bm{C}_{i} , \bar{d_{\bm{C}_{i}}} is the average distance to the centroid, and |\cdot| is the number of elements in the cluster. Then, D^{2}(\bm{C}_{1},\bm{C}_{2})=|\bm{C}_{1}\cup\bm{C}_{2}|\bar{d}_{\bm{C}_{1}\cup\bm{C}_{2}}-|\bm{C}_{1}|\bar{d}_{\bm{C}_{1}}-|\bm{C}_{2}|\bar{d}_{\bm{C}_{2}}. (1) This implies that when clusters with high homogeneity are merged, the diameter of the new cluster is smaller compared to merging clusters with lower similarity. 2.2 Functional Ward’s Linkage Analogous to the concept of diameter in conventional Ward’s linkage ( 1 ), we define the functional Ward’s linkage by using the increase in the “width of the band" to measure the distance between two clusters of functional data \bm{C_{1}} and \bm{C}_{2} . We suppose the width of the band delimited by clusters with high homogeneity is narrower: D^{2}(\bm{C}_{1},\bm{C}_{2})=|\bm{C}_{1}\cup\bm{C}_{2}|\cdot W\{B\{(\bm{C}_{1}\cup\bm{C}_{2})\}\}-|\bm{C}_{1}|\cdot W\{B(\bm{C}_{2})\}-|\bm{C}_{2}|\cdot W\{B(\bm{C}_{2})\}, (2) where W\{\cdot\} denotes the average width of the band, and B\{\bm{.}\} represents the band delimited by a cluster of curves: B\{y_{1}(t),y_{2}(t),...,y_{n}(t)\}=\{(t,x(t)):t\in\mathcal{I},{\rm min}_{r=1,...,n}\text{ }y_{r}(t)\leq x(t)\leq{\rm max}_{r=1,...,n}\text{ }y_{r}(t)\}. Specifically,

Read the complete text