Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds
Oscar Davis , Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein, Avishek Joey Bose · 2025
Read Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds by Oscar Davis , Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein, Avishek Joey Bose (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21608.txt.
Introduction
Oscar Davis and four co-authors move few-step generative modeling onto curved spaces. Models that create geometric data, from protein backbones to map data, usually need long numerical simulations at sampling time. That is because their transport machinery was built for flat Euclidean space while the data live on Riemannian manifolds.
Their generalised flow maps learn to jump along the generation process in a few large steps instead of crawling through many small ones, on any such curved space. Three training styles adapt self-distillation tricks to the setting, and theory shows the framework contains earlier flat-space few-step models, like consistency and shortcut models, as special cases. On geospatial data, RNA twist angles, and hyperbolic spaces, the models deliver top sample quality in one or a few steps, with probability scores that rival or beat slower rivals.
Catalog record
| CREATOR | Oscar Davis , Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein, Avishek Joey Bose |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-21608
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds Oscar Davis , Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein, Avishek Joey Bose Abstract Geometric data and purpose-built generative models on them have become ubiquitous in high-impact deep learning application domains, ranging from protein backbone generation and computational chemistry to geospatial data. Current geometric generative models remain computationally expensive at inference—requiring many steps of complex numerical simulation—as they are derived from dynamical measure transport frameworks such as diffusion and flow-matching on Riemannian manifolds. In this paper, we propose Generalised Flow Maps ( GFM ), a new class of few-step generative models that generalises the Flow Map framework in Euclidean spaces to arbitrary Riemannian manifolds. We instantiate GFM s with three self-distillation-based training methods: Generalised Lagrangian Flow Maps, Generalised Eulerian Flow Maps, and Generalised Progressive Flow Maps. We theoretically show that GFM s, under specific design decisions, unify and elevate existing Euclidean few-step generative models, such as consistency models, shortcut models, and meanflows, to the Riemannian setting. We benchmark GFM s against other geometric generative models on a suite of geometric datasets, including geospatial data, RNA torsion angles, and hyperbolic manifolds, and achieve state-of-the-art sample quality for single- and few-step evaluations, and superior or competitive log-likelihoods using the implicit probability flow. 1 Introduction Dynamical measure transport offers a unifying and prescriptive framework for constructing neural network-based generative models that learn to sample a desired target distribution by pushing forward a tractable prior. Numerical solution of the resulting dynamical systems has led to popular method families—including diffusion models ( Song & Ermon 2020 ) , flow matching ( Lipman et al. 2022 ; Peluchetti 2023 ; Liu et al. 2022 ; Albergo & Vanden-Eijnden 2022 ) , and stochastic interpolants ( Albergo et al. 2023 ) —which together have revolutionised the field and led to state-of-the-art results over continuous modalities ( Karras et al. 2024 ; Polyak et al. 2024 ) . While often applied to Euclidean data such as images, this powerful paradigm naturally extends to data types that are inherently geometric and lie on a known Riemannian manifold, in which case the associated flows and diffusions are defined directly on the manifold ( Huang et al. 2022b ; De Bortoli et al. 2022 ; Chen & Lipman 2024 ) . Such geometric generative models have found widespread application in high-impact scientific settings such as rational drug design on the \mathrm{SE(3)}^{\scriptscriptstyle N} manifold of protein backbones ( Bose et al. 2024 ; Huguet et al. 2024 ; Watson et al. 2023 ) , generative material design in computational chemistry ( Miller et al. 2024 ) , and even discrete data using the Fisher-Rao geometry on the probability simplex ( Davis et al. 2024 ; Cheng et al. 2025a ) . The scalability of dynamical transport-based generative models arises from their use of simple regression-based objectives that lead to rapid simulation-free training. However, unlike training, obtaining high-quality generated samples at inference time requires numerical solution of the parametrised dynamical system, which necessitates evaluating the large learnt model numerous times. The computational complexity of inference is further burdened in geometric settings, where each step of simulation requires computing potentially numerically unstable operators that must guarantee manifold constraints for faithful inference. For instance, for matrix Lie groups like \mathrm{SO(3)} , computing the standard exponential and logarithmic maps requires truncating an infinite matrix power series ( Al-Mohy & Higham 2012 ) , which may incur additional sources of error beyond just step-size discretisation error compared to inference on Euclidean spaces. Therefore, reducing the number of Riemannian operations, while maintaining this powerful inductive bias, has the potential to lead to higher fidelity generated samples. Figure 1: Left: The instantaneous vector field v_{t} of the Riemannian probability flow ODE. Right: The Generalised flow map X_{s,t} that jumps along the trajectory of the Riemannian probability flow ODE by steps of size t-s . Both models are depicted on \mathbb{S}^{2} . The search for accelerated inference with dynamical generative models defined on Euclidean spaces has spurred the development of fast inference techniques that fall broadly into two methodological families. The first family involves the intricate design of higher-order samplers ( Dockhorn et al. 2022a ; Zhang & Chen 2022 ; Sabour et al. 2024 ; Karras et al. 2022 ) , which can produce high-quality samples with less than ten steps. The second pursues direct learning of the flow map—the global solution of the governing differential equation—rather than the instantaneous vector field used in standard simulation ( Boffi et al. 2024 ) . This flow map perspective underlies distillation-based approaches, the most popular of which include consistency models ( Song et al. 2023b ; Song & Dhariwal 2023 ; Lu & Song 2024 ) , which attempt to learn the one-step flow map of a pre-trained teacher. Distillation-based methods have also been extended to the multi-step flow map setting we consider here at scale ( Sabour et al. 2025 ) . Recent advances have further demonstrated that state-of-the-art one-step generative models can be trained from scratch without a pre-trained teacher through self-consistent self-distillation ( Boffi et al. 2025 ; Frans et al. 2025 ) or Monte Carlo direct training ( Geng et al. 2025 ) objectives. These exciting developments naturally raise the question: Can the same flow map principles be extended to Riemannian settings, leading to a new class of few-step geometric generative models? Here, we answer this question in the affirmative by introducing Generalised Flow Maps ( GFM ), a method that generalises and extends flow maps ( Boffi et al. 2025 ) to arbitrary Riemannian manifolds. Overall, our main contributions can be summarised as: 1. Models . We derive the technical conditions required for a flow map to respect manifold constraints, showing how they lead to three variants of GFM : Eulerian, Lagrangian, and Progressive. 2. Learning . We elevate the self-distillation losses presented in Boffi et al. 2025 to the Riemannian setting, showing how each variant can be learned efficiently, and how each recovers their Euclidean counterparts as a specific case. 3. Empirical validation . We comprehensively demonstrate the performance benefits of GFM over previous Riemannian generative models on standard geometric datasets. Specifically, we obtain state-of-the-art performance for single- and few-step sample quality on torsion angles found in RNA backbones and protein side-chains, geospatial data of natural disasters on the Earth’s surface, synthetic data on \mathrm{SO(3)} and on the Poincaré disk model of hyperbolic geometry, demonstrating our method’s robustness to manifolds with non-trivial structures. Our methodology opens the door to an under-explored design space of highly expressive generative models defined over geometric data that enjoy rapid inference. 2 Background 2.1 Riemannian geometry Informally, a d -dimensional manifold {\mathcal{M}} is a topological space covered by a family of sets and corresponding maps, called charts , that render the manifold locally homeomorphic to \mathbb{R}^{d} . Requiring a C^{\infty} differential structure on the charts makes the manifold smooth , and thereby naturally defines the tangency of a vector v\in\mathcal{T}_{x}\mathcal{M} to a point x\in\mathcal{M} , where {\mathcal{T}}_{x}\mathcal{M} denotes the tangent space at point x , and the disjoint union of all tangent spaces \mathcal{T}\mathcal{M}\coloneqq\bigsqcup_{x\in\mathcal{M}}\mathcal{T}_{x}\mathcal{M} forms the tangent bundle . A Riemannian manifold is a pair (\mathcal{M},g) , where