Learning geometry and topology via multi-chart flows

Hanlin Yu, Søren Hauberg, Marcelo Hartmann, Arto Klami, Georgios Arvanitidis · 2025

Read Learning geometry and topology via multi-chart flows by Hanlin Yu, Søren Hauberg, Marcelo Hartmann, Arto Klami, Georgios Arvanitidis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24665.txt.

Introduction

Hanlin Yu and co-authors develop, in a 2025 paper, a way to learn the shape of data that lives on a curved low dimensional surface inside a high dimensional space. Photographs, motions, and molecular shapes often have this hidden geometry. Normalizing flows can learn such surfaces by mapping between the big space and a small latent one.

One flow is not enough when the surface has nontrivial topology, like holes or loops: no single smooth map can cover it. Several flows must be glued together, like charts in an atlas. The authors give a general training scheme for such multi chart flows. They also build the first algorithms for computing geodesics, the shortest paths, on the learned surfaces. Tests showed large gains in estimating topology. Knowing a data surface's true shape, and how to measure distance on it, sharpens everything built on top.

Catalog record

CREATORHanlin Yu, Søren Hauberg, Marcelo Hartmann, Arto Klami, Georgios Arvanitidis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24665

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning geometry and topology via multi-chart flows Hanlin Yu, Søren Hauberg, Marcelo Hartmann, Arto Klami, Georgios Arvanitidis Abstract Real world data often lie on low-dimensional Riemannian manifolds embedded in high-dimensional spaces. This motivates learning degenerate normalizing flows that map between the ambient space and a low-dimensional latent space. However, if the manifold has a non-trivial topology, it can never be correctly learned using a single flow. Instead multiple flows must be ‘glued together’. In this paper, we first propose the general training scheme for learning such a collection of flows, and secondly we develop the first numerical algorithms for computing geodesics on such manifolds. Empirically, we demonstrate that this leads to highly significant improvements in topology estimation. 1 Introduction Figure 1: Using multiple charts to cover a manifold gives the ability to learn the manifold’s true geometry and topology. Normalizing flows [ Papamakarios et al. 2021 ] is a family of flexible neural network models of complex probability distribution from finite observations. They are guaranteed to be bijections allowing tractable sampling and log-density evaluations. However, due to the bijectivity requirement, the dimensionalities of the latent and ambient spaces need to be identical. As real-world datasets often lie on a low-dimensional Riemannian manifold embedded in a high-dimensional ambient space, we cannot have a bijection. As such, the modeling strategy of normalizing flows can be ill-posed. A probability density on an unknown Riemannian manifold can be modeled using a normalizing flow [ Brehmer and Cranmer 2020 , Caterini et al. 2021 ] , by learning a mapping between a low-dimensional latent space and a high-dimensional ambient space. It was demonstrated that, for certain manifolds, the flows are able to model the distribution accurately. However, these methods often consider a single normalizing flow, which is justified only when the manifold is diffeomorphic to a Euclidean space. Some common manifolds, for instance the sphere and the torus, do not satisfy this assumption. It is by definition impossible for a single-chart flow to model these manifolds correctly due to the topological mismatch. Understanding the underlying topology and geometry of the data manifold using only finite observations is an open problem in machine learning [ Hauberg 2019 , Moor et al. 2020 , Acosta et al. 2023 , Ross et al. 2024 , Diepeveen 2024 ] . Some attempts focus on capturing the Riemannian structure using the pullback metric induced by a single normalizing flow [ Hoffman et al. 2019 , Kruiff et al. 2024 ] , while other works [ Schonsheck et al. 2020 , Kalatzis et al. 2022 , Sidheekh et al. 2022 ] use multiple autoencoders or normalizing flows to cover the manifold. However, these approaches typically lack a principled way of choosing the correct encoder [ Loaiza-Ganem et al. 2024 ] . Most importantly, these works did not study the geometric and topological implications of the learned generative model, but focused mainly on the density modeling task. In this paper , we aim at learning data manifolds with the correct geometry and topology. Classic differential geometry achieves this by gluing together local “patches” of the manifold, each of which is modeled with a diffeomorphism. In similar spirit, we learn a mixture of flows, each corresponding to a “patch”. In classic differential geometry, the patches are assumed to perfectly overlap in bordering regions, but such extrapolation guarantees are unrealistic with flows (see Figure 1 ). We propose a formalism to handle such non-overlapping patches, and further develop numerical algorithms for computing geodesics over manifolds defined through such mixture of flows. Our contributions: 1. We demonstrate that using a single normalizing flow to model a distribution on a Riemannian manifold can lead to significant misunderstanding in terms of the underlying topology and geometry. 2. We provide general training strategies for multi-chart flows based on the maximum likelihood principle and demonstrate that they can perform better than single-chart flows of similar complexities. 3. We provide specialized tools to utilize the geometry learned by multi-chart flows that crucially respect the actual topology of the underlying manifold, yielding more reliable representations. Note that beyond implementing the abstract methodology of classic differential geometry, we also account for the fact that the flows cannot perfectly overlap for data learned manifolds. 2 Preliminaries 2.1 A brief intro to Riemannian geometry Riemannian manifolds [ Do Carmo 1992 , Lee, John M. 2018 ] are spaces that locally resemble Euclidean space. We consider a d -dimensional Riemannian manifold isometrically embedded in a D -dimensional Euclidean space, following the typographic mnemonic that the lower-case symbol denotes the smaller dimensionality. The well-known Nash embedding theorem [ Lee, John M. 2018 ] guarantees that such an embedding exists for all Riemannian manifolds, though it is unclear how to construct such an embedding in the general case. A local coordinate chart is given by the pair (U,\phi) , where U is an open set on the manifold and \phi is a bijection between U and an open set of d -dimensional Euclidean space. For simple manifolds, one might be able to construct a single chart that covers the entire manifold. However, for more complex ones, we need a collection of local charts that transition smoothly, known as an atlas . A curve with zero tangential acceleration, intuitively a shortest path on the manifold, is known as a geodesic . For a point \bx on a d -dimensional Riemannian manifold, one can attach a d -dimensional Euclidean space known as the tangent space at \bx , containing all vectors that are tangent to the surface at \bx . Given an initial position \bx_{0} and initial \bbv_{0} , one can use the exponential map \text{Exp}_{\bx_{0}}(\bbv_{0}) to obtain the result of following along the geodesic for unit time. Given the initial position \bx_{0} and the final position \bx_{1} , one can use the logarithmic map \text{Log}_{\bx_{0}}(\bx_{1}) to obtain (one of) the initial velocity that satisfies the boundary condition. These geometric operations are also illustrated in Figure 1 , where we show that these quantities are well-defined even if the manifold is covered by multiple charts. 2.2 Normalizing flows A normalizing flow [ Papamakarios et al. 2021 ] pushes forward a tractable distribution p(\bu) from a latent space \bU to a complex distribution in the input space \bX through the bijective transformation \bbf , such that the resulting distribution q_{\btheta}(\bx) in \bX can be tractably evaluated. For density estimation tasks on Euclidean spaces when \text{dim}(\bX)=\text{dim}(\bU)=D , normalizing flows are typically trained by minimizing the forward KL divergence \text{KL}\left(p(\bx)|q_{\btheta}(\bx)\right) [ Papamakarios et al. 2021 ] , where the density q_{\btheta}(\bx) can be evaluated as q_{\btheta}(\bx)=q(\bu)|\text{det}\left(\bJ_{\bbf}(\bu)\right)|^{-1}\Big|_{\bu=\bbf^{-1}(\bx)} , with \bJ_{\bbf}\in\mathbb{R}^{D\times D} being the Jacobian matrix of the parameterized transformation \bbf:\bU\rightarrow\bX ; the dependency of \bbf on \btheta is dropped to avoid cluttering notations. One can employ specific flow architectures, such that the log determinant of the Jacobian can be obtained efficiently. Two notable examples are RealNVP flows [ Dinh et al. 2017 ] and Neural Spline flows [ Durkan et al. 2019 ] . In many scenarios, one would need to model distributions that are supported on Riemannian manifolds. In the following discussions, we largely follow Brehmer and Cranmer 2020 and Caterini et al. 2021 . A normalizing flow on a Riemannian manifold

Read the complete text