Beyond Rigid Geometries: The Spline-Pullback Metric for Universal Diffeomorphic SPD Representation Learning

Tushar Das, Subrata Dutta, Sarmistha Neogy, Koushlendra Kumar Singh · 2026

Read Beyond Rigid Geometries: The Spline-Pullback Metric for Universal Diffeomorphic SPD Representation Learning by Tushar Das, Subrata Dutta, Sarmistha Neogy, Koushlendra Kumar Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04406.txt.

Introduction

Tushar Das and three co-authors propose a learnable geometry for the symmetric positive definite matrices that appear throughout machine learning, from covariance data to medical imaging. Networks using these matrices have relied on fixed geometric rules, much like hand-crafted features, which limits what they can express.

Their metric is built from a spline-based transformation that is constrained to stay monotone, avoiding the folding and gradient failures of looser designs. Two versions, acting on spectra or on a matrix factorisation, can approximate any suitable transformation and contain earlier pullback metrics as special cases. The result is a geometry that adapts to data instead of being chosen in advance.

Catalog record

CREATORTushar Das, Subrata Dutta, Sarmistha Neogy, Koushlendra Kumar Singh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04406

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Rigid Geometries: The Spline-Pullback Metric for Universal Diffeomorphic SPD Representation Learning Tushar Das, Subrata Dutta, Sarmistha Neogy, Koushlendra Kumar Singh Abstract The integration of Symmetric Positive Definite (SPD) matrices into deep learning has historically relied on fixed algebraic Riemannian metrics. Analogous to hand-crafted features in classical machine learning, these static formulations impose rigid geometries limiting network expressivity and adaptability. Recent attempts to parameterize these geometries often violate the axioms of primary matrix functions through unconstrained powers or rank-dependent scaling, inviting spatial folding, loss of global surjectivity, and gradient collapse at spectral singularities. In this paper, we introduce the Spline-Pullback Metric (SPM), instantiated as Spectral-SPM and Cholesky-SPM, marking a paradigm shift from static metric selection to universal geometric approximation. By parameterizing the global diffeomorphism via a rank-invariant, monotonically constrained B-spline, SPM acts as a dense universal approximator for strictly increasing C 1 C^{1} diffeomorphisms and theoretically subsumes existing pullback metrics while enabling localized non-linear spectral modelling. Topologically, SPM provides a globally bijective pullback geometry precluding rank-swapping discontinuities and gradient instabilities. Empirically, SPM achieves a state-of-the-art performance across 3 datasets utilizing Linear Probes, SPDNets, and deep Riemannian ResNets. 1 Introduction Covariance matrices, represented as Symmetric Positive Definite (SPD) matrices, constitute a key component in numerous modern deep learning applications spanning areas such as radar signal processing ( Brooks et al. 2019 ) and electroencephalography ( Li et al. 2024 ) , computer vision ( Huang and Van Gool 2017 ) , and medical imaging ( Chakraborty et al. 2020 ) . From the geometrical point of view, the SPD matrix space \mathcal{S}_{++}^{n} represents an open and convex cone within the ambient space of symmetric matrices \mathcal{S}^{n} . As a purely topological space, this cone possesses no inherent geometry or spatial curvature. Because applying standard Euclidean operations directly to SPD matrices violates the positivity boundary constraint, the manifold must be endowed with a Riemannian metric to induce a valid geometry, thereby defining geodesic distances and enabling mathematical projections The problem of handling the positivity boundary constraint has been traditionally tackled by formulating appropriate geometry manually. Among the pioneering methods, the Affine-Invariant Riemannian Metric (AIRM) ( Pennec et al. 2006 ) and the Log-Euclidean Metric (LEM) ( Arsigny et al. 2006 ) were followed by the later developed Power-Euclidean ( Dryden et al. 2009 ) , Log-Cholesky (LCM) ( Lin 2019 ) , and Bures-Wasserstein metrics ( Bhatia et al. 2019 ) and various generalizations of this metric ( Han et al. 2023 ) . Endowing the manifold with such metrics has paved the way for extending key deep learning building blocks to the SPD domain. Examples of such include Riemannian Multinomial Logistic Regression (MLR) ( Chen et al. 2024a ) , convolutions, Riemannian batch normalization ( Brooks et al. 2019 ; Chen et al. 2024c ) , residual blocks ( Katsman et al. 2023 ) , and graph neural networks ( Cruceru et al. 2021 ) . However, relying on classical metric selection remains a manual process, akin to handcrafted feature selection in traditional Machine Learning. The central challenge in advancing SPD matrix and Riemannian metric learning is transitioning from these static mathematical priors to dynamic, computationally efficient, and completely learnable topological representations. Literature Limitations: Although implicit pullback metrics like LEM and LCM preclude the expensive matrix inversions and gradient instability of AIRM, they enforce rigid global topological deformations indifferent to localized spectral noise. Recent advancements attempt to parameterize Riemannian metrics to improve expressivity, but often rely on mathematically ill-posed transformations. For instance, rank-dependent mappings like ALEM ( Chen et al. 2024d ) violate the Primary Matrix Functions definition ( Bhatia 1997 ) due to eigenvector non-uniqueness, causing one-to-many topological failures. Conversely, polynomial power mappings like PCM ( Chen et al. 2026 ) lack global surjectivity onto unconstrained Euclidean space. To prevent undefined negative pre-images, PCM relies on non-injective computational clipping (e.g., \max(x,\epsilon) ), breaking the bijectivity strictly required for a geodesically complete Riemannian metric. We provide a rigorous mathematical proof of these diffeomorphic failures in the Appendix. Furthermore, adapting Euclidean diffeomorphism approximators (like Affine Coupling Flows ( Teshima et al. 2020 ) or deep MLPs ( Hwang 2026 ) ) is infeasible for Riemannian metric learning. They typically require C^{2} smooth targets and only guarantee C^{0} (uniform) convergence, leaving the first derivatives, essential for stable Riemannian back-propagation, structurally discontinuous, often requiring computationally heavy layer cascades. To resolve all these limitations, we introduce the Spline-Pullback Metric (SPM) and its two instantiations, Spectral-SPM (S-SPM) and Cholesky-SPM (C-SPM). In contrast to ALEM or PCM, we mathematically prove that SPM metric itself is a fully learnable, geodesically complete global Riemannian diffeomorphism and a universal approximator. Requiring only a C^{1} target, SPM guarantees the C^{1} convergence necessary for stable back-propagation in a single, parameter-efficient layer. To the best of our knowledge, SPM is the first framework to introduce the paradigm of universal Riemannian diffeomorphic metric learning parameterized via B-splines, capable of localized spectral modelling without sacrificing the fundamental axioms of differential geometry. Our main contributions are summarized as follows: • We mathematically formalize and prove the desirable properties of SPM and its instantiations S-SPM and C-SPM. • We highlight the current metrics’ topological limitations and SPM’s universal solution. • We introduce an asymmetric Float64 matrix perturbation protocol to bound the Lipschitz constant of the Daleckĭĭ-Kreĭn structural gradient, solving the numerical instability of Riemannian backpropagation. • Under a rigorous evaluation protocol, SPM achieves state-of-the-art accuracy across all 9 tested combinations of datasets and architectures, across 7 metrics. 2 Preliminaries We establish the notation and geometric concepts for Symmetric Positive Definite (SPD) matrices and the mechanism of Riemannian isometric pullbacks, which form the theoretical underpining of our framework. We denote the space of n\times n real symmetric matrices as \mathcal{S}^{n} , which forms a flat Euclidean vector space equipped with the standard Frobenius inner product, \langle X,Y\rangle_{F}=\text{tr}(X^{\top}Y) . The set of n\times n Symmetric Positive Definite (SPD) matrices, denoted as \mathcal{S}_{++}^{n} , is an open, convex cone within \mathcal{S}^{n} . It is worth noting that the topological space \mathcal{S}_{++}^{n} possesses no inherent spatial curvature of its own; rather, its geometry is induced by the choice of the Riemannian metric tensor g placed upon it. Because \mathcal{S}_{++}^{n} is an open cone rather than a complete vector space, applying standard Euclidean linear operations directly to SPD matrices may produce matrices that violate the strict positivity constraint (falling outside the manifold) or results in the well-documented "swelling effect" ( Arsigny et al. 2006 ) . Consequently, \mathcal{S}_{++}^{n} must be endowed with a Riemannian metric to measure geodesic distances and define valid tangent space projections. At any given point P\in\mathcal{S}_{++}^{n} , its tangent space \mathcal{T}_{P}\mathcal{S}_{++}^{n} is isomorphic to the flat space of symmetric matrices \mathcal{S}^{n} . To facilitate operations requiring hierarchical sensor ordering, we also define the Cholesky space. Let \mathcal{L}^{n} denote the flat Euclidean space of n\times n lower triangular matrices. The Cholesky manifold, denoted as \mathcal{L}_{++}^{n} , is defined as the open submanifold of \mathcal{L}^{n} . It consists of lower triangular matrices where all diagonal elements are strictly positive ( Lin 2019 ) . Any SPD matrix S\in\mathcal{S}_{++}^{n} can be uniquely mapped to the Cholesky manifold via the Cholesky decomposition, S=LL^{\top} , where L\in\mathcal{L}_{++}^{n} . While historically popular classical metrics

Read the complete text