Atlas-based Manifold Representations for Interpretable Riemannian Machine Learning

Ryan A. Robinett, Sophia A. Madejski, Kyle Ruark, Samantha J. Riesenfeld, Lorenzo Orecchia · 2025

Read Atlas-based Manifold Representations for Interpretable Riemannian Machine Learning by Ryan A. Robinett, Sophia A. Madejski, Kyle Ruark, Samantha J. Riesenfeld, Lorenzo Orecchia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17772.txt.

Introduction

Ryan A. Robinett and four co-authors test a new way to learn curved data spaces. Many datasets are thought to lie on a manifold, a curved surface inside high-dimensional space. Standard tools flatten that surface and lose key features. The team instead learns the surface directly as an atlas.

An atlas is a set of overlapping charts that together cover the surface. Their data structure keeps the atlas smooth enough for calculus-based optimization. A learning heuristic builds the atlas from raw point clouds without labels. Tests covered a Klein bottle classification task and blood cell data. The approach gave clearer interpretations and steadier results there.

Catalog record

CREATORRyan A. Robinett, Sophia A. Madejski, Kyle Ruark, Samantha J. Riesenfeld, Lorenzo Orecchia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-17772

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Atlas-based Manifold Representations for Interpretable Riemannian Machine Learning Ryan A. Robinett, Sophia A. Madejski, Kyle Ruark, Samantha J. Riesenfeld, Lorenzo Orecchia Abstract Despite the popularity of the manifold hypothesis, current manifold-learning methods do not support machine learning directly on the latent d d -dimensional data manifold, as they primarily aim to perform dimensionality reduction into ℝ D \mathbb{R}^{D} , losing key manifold features when the embedding dimension D D approaches d d . On the other hand, methods that directly learn the latent manifold as a differentiable atlas have been relatively underexplored. In this paper, we aim to give a proof of concept of the effectiveness and potential of atlas-based methods. To this end, we implement a generic data structure to maintain a differentiable atlas that enables Riemannian optimization over the manifold. We complement this with an unsupervised heuristic that learns a differentiable atlas from point cloud data. We experimentally demonstrate that this approach has advantages in terms of efficiency and accuracy in selected settings. Moreover, in a supervised classification task over the Klein bottle and in RNA velocity analysis of hematopoietic data, we showcase the improved interpretability and robustness of our approach. 1 INTRODUCTION By extending concepts from flat Euclidean space to more complex, curved spaces, Riemannian manifolds provide a convenient mathematical model to abstractly represent nonlinear data dependencies in high-dimensional datasets. The related manifold hypothesis [ 4 ] , which states that real-world data is predominantly concentrated on low-dimensional manifolds within a high-dimensional embedding space, has been both theoretically [ 10 ] and experimentally [ 39 , 9 ] validated for image data and is considered a key ingredient for the success of deep learning [ 4 , 8 ] . Similarly, natural scientists increasingly encounter empirical data that are well characterized by low-dimensional, often non-Euclidean, Riemannian manifolds. For example, for several systems profiled by single-cell RNA-sequencing (scRNA-seq), which estimates the transcript counts of thousands of genes in tens (or hundreds) of thousands of individual cells, the data were shown to live near low-dimensional manifolds ( d\leq 5 ) and display nontrivial geometry with statistically significant scalar curvature [ 17 ] . As a result, there is now great interest in designing algorithms and simulating dynamics that eschew the high-dimensional ambient space and directly work with a representation of the low-dimensional manifold. Riemannian variants of generative diffusion models have recently been proposed [ 6 , 23 , 31 ] and applied to protein generation [ 52 ] . Stochastic models and dynamic optimal transport algorithms have been applied to learned manifold representations of transcriptomic spaces to study dynamic processes, such as cell-fate decisions in embryogenesis [ 43 , 33 , 22 ] . Although Riemannian optimization techniques are well developed [ 1 ] , most commonly employed manifold representation methods are ill-suited to their application, preventing the deployment of general-purpose machine learning techniques to the low-dimensional manifolds underlying much real-world data. Indeed, the steps of even the simplest Riemannian first-order methods are applications of the manifold’s exponential map (or more generally of a retraction) [ 7 ] , which require knowledge of the manifold’s tangent planes and differentiable structure. By contrast, current manifold learning techniques do not attempt to learn representations that constrain downstream tasks to work within the manifold and its intrinsic geometry. Rather, they focus heavily on dimensionality reduction, i.e., constructing embeddings of data that are naturally represented in a high-dimensional space \mathbb{R}^{n} into a lower-dimensional space \mathbb{R}^{D} , where D<<n is still higher (often substantially) than the intrinsic dimension of the latent data manifold [ 32 ] . Such methods often aim to preserve fundamental intrinsic topological invariants (such as homology) and geometric invariants (such as geodesic distances), but not support optimization. For instance, even the simple task of evolving a given ODE by forward-Euler discretization over the manifold cannot be realized in a generic dimensionality-reduced embedding, as the evolving point may leave the manifold and travel freely in the D -dimensional ambient space. This issue arises in many scientific applications where experimental data naturally include a velocity vector field over the manifold, such as RNA velocity [ 5 , 15 , 48 , 18 ] . See Section 1.2 for further discussion of different manifold learning methods. 1.1 Our Contribution The previous discussion immediately suggests considering manifold representations that directly parametrize the latent manifold via diffeomorphic charts. Because most real-world latent manifolds are not diffeomorphic to Euclidean space [ 14 ] , this approach explicitly requires the use of multiple charts and differentiable transition maps between overlapping charts, i.e., the maintenance of a differentiable atlas [ 29 ] . While some such methods have been proposed, this approach has been relatively underexplored and has found limited practical application. A common objection to the deployment of this idea are the tedious and computationally expensive numerical operations required to construct and maintain a large number of charts and overlaps. The main goal of this paper is to provide a proof of concept demonstrating that practical methods that explicitly learn and maintain a differentiable, approximate atlas can enable scalable analysis of low-dimensional manifold structure that is more faithful and interpretable than afforded by current methods. To this end, we implement a straightforward such data structure, termed Atlas , which, while not optimized, allows for fast chart-membership queries and numerical approximation of exponential maps. Our implementation can represent both known atlases of algebraic manifolds and atlases learned from empirical manifolds given as high-dimensional point-cloud data. For the latter, we also present a simple heuristic, Atlas-Learn , for constructing an Atlas representation via approximate quadratic coordinate charts [ 17 ] . The rest of the paper is dedicated to exploring the Atlas properties. Our empirical analyses showcase its efficiency and its capability to recover manifold structure and enable machine-learning routines to work directly in the inherent geometry of the data. In particular, we demonstrate that our atlas scheme can both speed up first-order Riemannian optimization over manifolds with closed-form algebraic structure and enable it in the first place over manifolds learned from empirical point cloud data. The following are our main contributions in this direction: 1. In Section 3.1 , we show that the Atlas scheme can speed up first-order Riemannian optimization for a benchmark online subspace learning problem on the Grassmann manifold, a classical target of Riemannian optimization routines [ 1 ] . 2. In Section 3.2 , we compare Atlas-Learn with existing manifold-learning techniques on the task of reconstructing an established manifold parametrization of Carlsson’s high-contrast, natural image patches [ 10 , 17 ] from the point cloud data. We show that our scheme outperforms competitors in preserving homology and approximate geodesic path lengths. 3. In Section 3.3 , we implement a Riemannian optimization algorithm – the Riemannian principal boundary ( RPB ) algorithm [ 21 ] – to solve a classification problem over the Klein bottle, a manifold with nontrivial topology, using Atlas -based primitives. The results demonstrate that, relative to existing manifold learning methods, the atlas approach has better accuracy and interpretability. 4. Finally, in Section 3.4 , we apply Atlas-Learn and Atlas to the reconstruction of transcriptomic dynamics over a well-studied hematopoietic scRNA-seq dataset [ 15 ] and find that the predicted flows adhere

Read the complete text