Shape-Informed Clustering of Multi-Dimensional Functional Data via Deep Functional Autoencoders

Samuel Singh, Shirley Coyle, Mimi Zhang · 2025

Read Shape-Informed Clustering of Multi-Dimensional Functional Data via Deep Functional Autoencoders by Samuel Singh, Shirley Coyle, Mimi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22969.txt.

Introduction

Some data arrive as curves, not points, and each case holds several curves at once. Samuel Singh, Shirley Coyle, and Mimi Zhang cluster such multi-dimensional functional data by shape. Their framework, FAEclust, uses a deep functional autoencoder. It squeezes each curve set into a code and rebuilds it, even on curved spaces. New penalty tricks steady the training.

A clustering loss joins the training goal, so codes form with grouping in mind. The shape-informed part makes clusters resist shifts in curve timing. The team prove their decoder can approximate any target map. Wide tests check how well the method works in practice.

Catalog record

CREATORSamuel Singh, Shirley Coyle, Mimi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-22969

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Shape-Informed Clustering of Multi-Dimensional Functional Data via Deep Functional Autoencoders Samuel Singh, Shirley Coyle, Mimi Zhang Abstract We introduce FAEclust , a novel functional autoencoder framework for cluster analysis of multi-dimensional functional data, data that are random realizations of vector-valued random functions. Our framework features a universal-approximator encoder that captures complex nonlinear interdependencies among component functions, and a universal-approximator decoder capable of accurately reconstructing both Euclidean and manifold-valued functional data. Stability and robustness are enhanced through innovative regularization strategies applied to functional weights and biases. Additionally, we incorporate a clustering loss into the network’s training objective, promoting the learning of latent representations that are conducive to effective clustering. A key innovation is our shape-informed clustering objective, ensuring that the clustering results are resistant to phase variations in the functions. We establish the universal approximation property of our non-linear decoder and validate the effectiveness of our model through extensive experiments. 1 Introduction Advancements in information technology have enabled the collection of multi-dimensional functional data (FD) across various fields. Analyzing multi-dimensional FD is challenging due to its complexity and the intricate relationships between variables that change over time and space. The large volume of FD, especially in fields like medical imaging and climate science, further complicates efficient data processing. Zhang and Parnell [ 37 ] recently conducted a comprehensive review of clustering methods for FD. The review highlights that current approaches to clustering multi-dimensional FD typically follow one of two strategies: (1) performing multivariate functional principal component analysis [ 5 ] and subsequently applying traditional multivariate clustering techniques to the functional principal component score vectors, or (2) defining a (dis)similarity measure for multi-dimensional FD and then using a (dis)similarity-based clustering method. Although a few other works apply alternative basis systems rather than the eigen-functions of the covariance operator, they are still limited to learning linear representations of FD. Given that the relationships between dimensions can be nonlinear and complex, linear methods, including those derived from multivariate functional principal component analysis, often fall short in effectively learning FD. Neural networks, known for their ability to model nonlinear relationships, offer a compelling alternative for multi-dimensional FD analysis. Rossi et al. [ 23 ] was among the first to apply multilayer perceptrons (MLPs) to FD by introducing functional weights in the first hidden layer. They demonstrated that functional MLPs can approximate continuous mappings from a compact subset of a functional space to \mathbb{R} with arbitrary precision. In the context of function-on-function regression, Wang et al. [ 33 ] converted FD into vectorial form using multivariate functional principal component analysis, subsequently building a traditional neural network for regression where both inputs and outputs were multivariate (i.e., functional principal component score vectors). Unlike [ 23 ] , which modeled functional weights by cubic B-splines, Yao et al. [ 35 ] approximated each functional weight (namely their discrete evaluations over a grid) by a neural network. Thind et al. [ 32 ] extended the functional MLP framework to handle inputs that include both functional and multivariate data. Heinrichs et al. [ 8 ] defined each functional neuron to be a convolution (w\ast y) , where the functional weight w is a translation-invariant kernel: w(s,t)=w(s-t) . A few recent works have developed neural network architectures for operator learning, namely learning mappings between two function spaces [ 16 , 6 , 24 ] . Notably, all these studies focus on supervised learning, designing neural networks for tasks like regression or classification and training neural networks with labeled data. As a result, they are not suited for cluster analysis, which requires identifying patterns in unlabeled data. For cluster analysis of FD, a logical progression is to adapt the autoencoder architecture to FD. Hsieh et al. [ 10 ] made strides in this direction by developing a functional autoencoder (FAE), where the functional weights are modeled as integral kernels. However, this approach poses substantial computational challenges, as it requires training a separate integral kernel for each connection between neurons, making the training process exceedingly complex. Seidman et al. [ 25 ] applied variational autoencoders to FD. However, their approach has a critical limitation: the inputs (and outputs) are not continuous functions but rather function evaluations over a fixed grid. Therefore, the model is not discretization-invariant, and new architectures with new parameters may be needed to achieve the same error for data with varying discretization. In this work, we introduce FAEclust , 1 1 1 https://github.com/samuelveersingh/FAE a comprehensive Python framework for clustering multi-dimensional FD. FAEclust is capable of handling FD in both linear spaces and Riemannian manifolds, combining computational efficiency with robustness to phase variation (time warping) and high stability. Moreover, we prove that the functional decoder is a universal approximator. The paper is organized as follows: Section 2 details the FAEclust architecture, Section 3 introduces the training objective, and Section 4 presents the clustering methodology. Section 5 benchmarks FAEclust against state-of-the-art methods, and Section 6 discusses implications and future directions. 2 Functional autoencoder In FD analysis, subjects are represented by random functions rather than traditional (multivariate) random variables. Below, we introduce the definitions and assumptions used throughout this work. Let \{\boldsymbol{y}_{i}:i=1,\ldots,n\} be a set of n independent p -dimensional sample functions : \boldsymbol{y}_{i}(t)=(y_{i}^{1}(t),\ldots,y_{i}^{p}(t))^{T}\in\mathbb{R}^{p} for any t\in\mathcal{T} , where \mathcal{T} is a compact interval of \mathbb{R} ; the superscript T is the transpose operator. Each sample function \boldsymbol{y}_{i} is a random realization of a p -dimensional random function \vec{Y}=(Y^{1},\ldots,Y^{p})^{T} . For d=1,\ldots,p , the n one-dimensional sample functions \{y^{d}_{1},\ldots,y^{d}_{n}\} are independent realizations of the component random function Y^{d}=Y^{d}(t)=Y^{d}(t,\omega) , defined on a probability space (\Omega,\mathcal{F},\Pr) and taking values in \mathcal{H}(\mathcal{T},\mathbb{R}) . Here, \mathcal{H}(\mathcal{T},\mathbb{R}) is the separable Hilbert space of all square-integrable measurable functions that are defined on \mathcal{T} and taking values in \mathbb{R} . That is, Y^{d} is a measurable map from \Omega to \mathcal{H}(\mathcal{T},\mathbb{R}) . Alternatively, we can view the function value y^{d}_{i}(t) as a realization of the random variable Y^{d}(t,\cdot) , a mapping from (\Omega,\mathcal{F}) to (\mathbb{R},\mathcal{B}_{\mathbb{R}}) , where \mathcal{B}_{\mathbb{R}} is the Borel \sigma -algebra of \mathbb{R} . In the following, we will suppress the dependence of a random function Y(\cdot,\omega) on \Omega and simply write Y . Appendix A provides additional preliminaries on multi-dimensional FD. To formally define the FD clustering problem, assume there are K(\geq 2) clusters in the population. If a sample function \boldsymbol{y}_{i} belongs to the k th cluster ( 1\leq k\leq K ), then it is a realization of the k th random function \vec{Y}_{k} , defined on the probability space (\Omega,\mathcal{F},\Pr_{k}) . In other words, there are K different probability measures defined on the \sigma -algebra (\Omega,\mathcal{F}) . Given access only to the discrete evaluations \{\boldsymbol{y}_{i}(t_{i1}),\ldots,\boldsymbol{y}_{i}(t_{ir_{i}})\}_{i=1}^{n} , a clustering method is to identify the underlying random function for each sample function \boldsymbol{y}_{i} . Table 4 in Appendix A summarizes the notations we will use throughout the work. All vectors are column vectors. 2.1 Network architecture An FAE consists of an encoder \mathcal{E} and a decoder \mathcal{D} ; the encoder \mathcal{E} maps a sample function \boldsymbol{y}\in\mathcal{H}(\mathcal{T},\mathbb{R}^{p}) into a latent representation \boldsymbol{x}\in\mathbb{R}^{s} , and the decoder \mathcal{D} maps the representation \boldsymbol{x} to a reconstruction of \boldsymbol{y} , denoted by \hat{\boldsymbol{y}}\in\mathcal{H}(\mathcal{T},\mathbb{R}^{p}) . That is, the encoder is a mapping from the function space to a latent finite-dimensional space

Read the complete text