CoVariance Filters and Neural Networks over Hilbert Spaces

Claudio Battiloro, Andrea Cavallo, Elvin Isufi · 2025

Read CoVariance Filters and Neural Networks over Hilbert Spaces by Claudio Battiloro, Andrea Cavallo, Elvin Isufi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13178.txt.

Introduction

Claudio Battiloro, Andrea Cavallo, and Elvin Isufi put forth a new way to learn from signals that live in endless spaces in a 2025 paper. Past work used the covariance of a signal, a gauge of how its parts move as one, to build neural nets with good traits. Those nets were shown to be strong and to transfer well, but only for spaces with a fixed, finite size.

The new work defines filters based on the covariance operator and stacks them, with non-linear steps, into full nets for endless spaces. It gives a clear rule for turning such a net into a finite one a computer can run. It also proves a link to a classic tool for finding the main patterns in data. Tests on both made-up and real time-series tasks sort data well, the authors report.

Catalog record

CREATORClaudio Battiloro, Andrea Cavallo, Elvin Isufi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-13178

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CoVariance Filters and Neural Networks over Hilbert Spaces Thanks: Work partially funded by the TU Delft AI Labs programme, the NWO OTP GraSPA proposal #19497, the NWO VENI proposal 222.032. Email to: [email protected] Claudio Battiloro, Andrea Cavallo, Elvin Isufi Abstract Covariance Neural Networks (VNNs) perform graph convolutions on the empirical covariance matrix of signals defined over finite-dimensional Hilbert spaces, motivated by robustness and transferability properties. Yet, little is known about how these arguments extend to infinite-dimensional Hilbert spaces. In this work, we take a first step by introducing a novel convolutional learning framework for signals defined over infinite-dimensional Hilbert spaces, centered on the (empirical) covariance operator. We constructively define Hilbert coVariance Filters (HVFs) and design Hilbert coVariance Networks (HVNs) as stacks of HVF filterbanks with nonlinear activations. We propose a principled discretization procedure, and we prove that empirical HVFs can recover the Functional PCA (FPCA) of the filtered signals. We then describe the versatility of our framework with examples ranging from multivariate real-valued functions to reproducing kernel Hilbert spaces. Finally, we validate HVNs on both synthetic and real-world time-series classification tasks, showing robust performance compared to MLP and FPCA-based classifiers. † † address: 1 Harvard University 2 Delft University of Technology 1 Introduction Covariance-based processing underpins several signal processing and machine learning frameworks, such as data whitening, exposing principal directions, and capturing feature interdependence. Its benefits have been shown in a wide plethora of domains, from brain neuroscience to finance [ 1 , 2 , 3 , 4 , 5 ] . The covariance matrix spectrum implicitly captures the structure of a dataset via the principal components , and said structure can be exploited via the PCA transform. While PCA learning is broadly adopted [ 6 ] , its practical implementation suffers from the inherent stochastic perturbations in the empirical covariance matrix estimated from finite data, which gets amplified when in high-dimension/low-sample regimes or with tightly clustered eigenvalues [ 7 , 8 ] . To address this, coVariance Neural Networks (VNNs) [ 9 ] perform graph convolutions using the empirical covariance matrix as graph shift operator, successfully merging the representational power of PCA and the stability/transferability properties of Graph Neural Networks (GNNs) [ 10 ] . However, VNNs operate only on finite-dimensional Hilbert spaces and little is known about how to generalize their benefits in cases where signals are defined over infinite-dimensional Hilbert spaces. This is a common setting in, for example, time-series processing [ 11 ] or quantum machine learning [ 12 ] . Related Works. Covariance-based data representation has been extensively studied from a graph signal processing perspective. For example, the works in [ 13 , 14 ] formalized stationarity for graph signals and related the graph Fourier transform with the spectrum of the data covariances. This link has been also exploited in [ 15 , 16 ] for graph-based dimensionality reduction. More recently, [ 9 ] introduced VNNs, which use the empirical covariance matrix as a graph shift operator, and showed that VNNs are more expressive and stable than PCA. The transferability properties of VNNs have been studied in [ 17 ] . VNNs have been successfully applied to brain data in [ 18 ] . A variant of VNNs for streaming spatiotemporal signals has been proposed in [ 19 ] , while VNNs with explicit bias mitigation have been proposed in [ 20 ] . The work in [ 21 ] recently proposed to replace the empirical covariance matrix in VNNs with the empirical covariance density operators to improve user’s control on the stability-discriminability trade-off of the network, and enhance robustness to noise. However, these works consider data only on finite-dimensional Hilbert spaces. Contribution. We introduce a novel convolutional learning framework for random signals defined over general, possibly infinite-dimensional, Hilbert spaces, centered on the covariance operator of such space. We leverage the eigensystem of the covariance operator as a frequency domain to define a Hilbert coVariance Fourier Transform, and then we propose spectral Hilbert coVariance Filters (HVF) to manipulate the signal representation in such spectral domain. We show how one can seamlessly develop Hilbert coVariance Networks (HVNs) as a layered architecture of HVFs and nonlinear activations in the same spirit as GNNs [ 10 ] . We propose a principled discretization procedure to make HVFs and HVNs implementable, and we prove that empirical HVFs can recover the Functional PCA (FPCA) [ 22 ] of the filtered signals. Finally, we numerically validate HVNs on both synthetic and real-world classification tasks of time-series, corroborating our findings and showing robustness benefits w.r.t. FPCA and covariance-unaware learning such as MLPs. 2 Preliminaries and Motivation Consider a probability space (\Omega,\mathcal{F},\mathbb{P}) where \Omega is the sample space (set of all possible outcomes), \mathcal{F} is a sigma-algebra, i.e., a collection of measurable subsets of \Omega treated as events, and \mathbb{P}:\mathcal{F}\to[0,1] is a probability measure, i.e., a function assigning probabilities to the elements in \mathcal{F} . Consider also a separable Hilbert space (\mathcal{H},\left\langle\cdot,\,\cdot\right\rangle_{\mathcal{H}}) with inner product \left\langle\cdot,\,\cdot\right\rangle_{\mathcal{H}} and norm \left\lVert\cdot\right\rVert_{\mathcal{H}} . In this paper, we work with random variables X:\Omega\to\mathcal{H} that are square integrable, i.e. they have finite expected squared norm \mathbb{E}\,\left\lVert X\right\rVert_{\mathcal{H}}^{2}<\infty . We denote the mean \mu=\mathbb{E}[X]\in\mathcal{H} . We refer to the elements of \mathcal{H} as signals. Covariance operator. The covariance operator C:\mathcal{H}\to\mathcal{H} is the linear map that encodes all directional (mixed) second moments of X . The covariance operator acts on v\in\mathcal{H} as Cv\;=\;\mathbb{E}\Big[\,\underbrace{\left\langle X-\mu,\,v\right\rangle_{\mathcal{H}}}_{\text{scalar coefficient}}\,(X-\mu)\,\Big]. (1) Note that the operator C is compact and trace-class [ 23 ] , and hence there exist nonnegative eigenvalues \{\lambda_{\ell}\}_{\ell\geq 1} and orthonormal eigenfunctions \{\phi_{\ell}\}_{\ell\geq 1} such that Cv\;=\;\sum_{\ell\geq 1}\lambda_{\ell}\,\left\langle v,\,\phi_{\ell}\right\rangle_{\mathcal{H}}\,\phi_{\ell}. (2) Hilbert Covariance Fourier Transform (HVFT). A spectral representation of signals is conventionally tied to a Fourier transform to analyze them. Given the eigen -system \{(\lambda_{\ell},\phi_{\ell})\}_{\ell} , we interpret the (ordered) eigenvalues as frequencies, and we define the Hilbert coVariance Fourier Transform (HVFT) of a signal x\in\mathcal{H} as the projection \widetilde{x}[\ell]\;\triangleq\;\left\langle x,\,\phi_{\ell}\right\rangle_{\mathcal{H}},\qquad\ell\geq 1. (3) Crucially, the HVFT of a signal x\in\mathcal{H} is equivalent to its Functional PCA (FPCA) transform [ 22 ] up to recentering. Although HVF/FPCA transforms are general means to obtain a different representation of signals, they also keep the usual variational characterization, i.e., taking the first r eigenfunctions \{\phi_{\ell}\}_{\ell} is equivalent to selecting the r directions maximizing signal variance under orthonormality, or minimizing reconstruction error. In the finite-dimensional case ( \mathcal{H}\cong\mathbb{R}^{m} ), FPCA and PCA (transforms) are equivalent. Problem Motivation. As explained, the HVFT transform provides a principled spectral domain for (random) signals in Hilbert spaces. Their spectral representations can be directly leveraged in processing/learning algorithms as information-rich features [ 24 ] . However, as we elaborate more in Sec. 4 and empirically show in Sec. 5 , practically implementing FPCA requires a finite number of discretized signals. This often leads to numerical instabilities and poor transferability performance, i.e., two finite batches of discretized samples coming from the same underlying Hilbert space or from similar Hilbert spaces could potentially results in significantly different spectral representations, making FPCA-only learning extremely difficult. For these reasons, there is a clear need for a proper notion of (convolutional) filtering [ 25 ] and neural networks centered on the covariance operator, to successfully merge the representational power of FPCA with the stability/transferability properties of neural

Read the complete text