Geometry-Aware Image Flow Matching

Junho Lee, Kwanseok Kim, Joonseok Lee · 2026

Read Geometry-Aware Image Flow Matching by Junho Lee, Kwanseok Kim, Joonseok Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25294.txt.

Introduction

Junho Lee, Kwanseok Kim, and Joonseok Lee say image generators ignore the natural geometry of pictures. They find that meaning lives mostly in directional parts of an image, while size-like parts track a global average, in both pixel and latent spaces. That pattern suggests pictures sit naturally on a sphere-like surface rather than in flat space. The team builds two flow methods for that curved geometry: one uses angular distance, the other constrains motion to the surface. Both beat flat-space baselines.

Catalog record

CREATORJunho Lee, Kwanseok Kim, Joonseok Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63459
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25294

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Geometry-Aware Image Flow Matching Junho Lee, Kwanseok Kim, Joonseok Lee Abstract Recent advances in generative models highlight the power of geometry-aware modeling in manifold-constrained settings. Yet, for natural images, the field remains confined to Euclidean assumptions, failing to exploit the potential of intrinsic geometric structures within the data. In this work, we investigate the geometry of natural images and observe that semantic information is predominantly encoded in directional components, while norm components can be approximated by the global average. This property holds across both RGB and latent spaces, suggesting that natural images can be effectively modeled on a hypersphere. Building on this finding, we introduce Spherical Optimal Transport Flow Matching (SOT-CFM), which utilizes angular distance, and Spherical Flow Matching (SFM), which constrains dynamics directly on the manifold. Our experiments demonstrate that these geometry-aware methods achieve superior performance against Euclidean baselines. Ultimately, this work provides a novel perspective that bridges the gap between Riemannian manifold-based modeling and natural image generation. † † affiliationnotice: Equal contribution 1 Introduction Image generation has seen rapid progress through successive paradigms, from Continuous Normalizing Flows (CNF) ( 8 ; 18 ) to Diffusion models (DM) ( 55 ; 54 ; 21 ; 56 ; 13 ; 26 ) , and more recently to Flow Matching (FM) ( 33 ; 35 ; 1 ) approaches. Each breakthrough has delivered increasingly impressive results in terms of sample quality, training stability, and generation efficiency. However, despite these advances, all these methods fundamentally rely on Euclidean geometry assumptions, treating images as vectors in high-dimensional Euclidean space. While this approach has proven successful, it may not fully capture the intrinsic geometric structure of natural images. If we could better understand and leverage the geometry of image data, we might achieve more principled and effective generative modeling. In domains where the underlying data manifold is known, geometry-aware generative modeling has delivered tangible gains. Early work on Riemannian CNF ( 38 ) parameterizes flexible densities directly on smooth manifolds by integrating ODEs on the manifold. Subsequent Riemannian score-based ( 3 ) and Riemannian Diffusion models ( 23 ) generalized score estimation and diffusion samplers to arbitrary Riemannian manifolds by formulating score operators and diffusion processes with Riemannian gradients/divergences. More recently, Riemannian Flow Matching (RFM) ( 7 ) mitigates simulator bias by aligning geodesic velocities with closed-form target vector fields on Riemannian manifolds. In application domains where geometry is dictated by symmetries ( e.g. , periodic crystals), FlowMM ( 39 ) extends RFM with group-equivariant structure, reporting state-of-the-art structure generation with substantially fewer integration steps. Collectively, these methods exploit geodesics, parallel transport, and manifold-aware metrics to obtain higher-quality samples, faster convergence, and more principled training relative to Euclidean baselines when the geometric prior is correct. However, a fundamental challenge remains: unlike structured domains with well-understood geometric priors, the intrinsic manifold structure of natural images is largely unknown. Although prior work has characterized their statistical properties ( 51 ) and local behavior ( 4 ) , these insights have not yet been translated into exploitable geometric structures for generative modeling. Explicit geometric constraints or symmetries that could define a Riemannian manifold for images remain undiscovered. To bridge this gap, we investigate the intrinsic geometry of natural images through directional decomposition analysis. Our key insight is that semantic information is predominantly encoded in the directional component (unit vector), whereas magnitude (norm) contributes minimally to perceptual quality. Consequently, the norm of individual data points can be effectively approximated by the global average of the dataset. Crucially, while this property might seem intuitive in RGB space, we demonstrate that it holds true even for high-dimensional latent spaces optimized for reconstruction. As illustrated in Figure 1 , hyperspherical projection preserves semantic and visual integrity so effectively that the projected versions remain nearly indistinguishable from the originals, despite substantial changes in their L_{2} norms across both RGB and latent spaces. This observation suggests that natural images can be effectively regarded as data points lying on a hypersphere with a radius determined by the dataset’s average magnitude, both in RGB and latent spaces. This finding enables us to establish geometry-aware image flow matching by either projecting data onto hyperspheres to leverage spherical geometry or by utilizing directional metrics instead of Euclidean metrics between vectors. Beyond its geometric benefits, this spherical projection also provides a practical training advantage by simplifying the learning task—since all projected data points reside on the same sphere with a predetermined radius, models can focus exclusively on learning directional dynamics rather than jointly optimizing both direction and magnitude components. Leveraging these insights, we introduce two approaches that adapt existing flow matching methods to spherical geometry: Spherical Optimal Transport Conditional Flow Matching (SOT-CFM), which replaces Euclidean distances with angular metrics in OT-CFM ( 59 ; 46 ) for optimal transport coupling and Spherical Flow Matching (SFM), which operates entirely on the hyperspherical manifold by projecting both source and target distributions onto the sphere and using geodesic paths as the optimal transport trajectories between data points. Figure 1 : Effect of hyperspherical projection on RGB and latent representations. Original (columns 1, 3) and projected (columns 2, 4) versions in RGB and latent spaces. L2 norms below each image. Despite appreciable norm changes through projection, the images remain almost indistinguishable to human perception. Images are shown in the original pixel value range without per-image normalization. We validate our geometric approach through comprehensive experiments on CIFAR-10 and ImageNet-256. Specifically, we benchmark standard Euclidean baselines (I-CFM, OT-CFM) against our spherical adaptations of these frameworks. We observe that applying our spherical data projection relieves the burden of magnitude modeling, effectively lowering learning difficulty and directly translating to improved generation quality. Furthermore, SOT-CFM gains additional advantages through angular distance metrics. Most notably, SFM achieves the best performance among all evaluated variants. This work offers a novel perspective as the first successful application of Riemannian manifold-based generative methods to natural images, demonstrating the superior efficacy of intrinsic geometric modeling over standard Euclidean approaches. The key contributions of this work are threefold: • We discover and empirically validate that natural images exhibit an intrinsic hyperspherical manifold structure , where semantic information is dominantly encoded in directions. • Leveraging this finding, we propose two geometry-aware flow matching frameworks —SOT-CFM and SFM—that unlock the potential of spherical manifold modeling for natural images • This work establishes the first practical bridge between manifold-based generative modeling and natural images , enabling simple yet principled spherical geometric constraints to be effectively utilized in real-world visual domains. 2 Preliminary 2.1 Flow Matching (FM) Flow Matching (FM) is a generative modeling framework defined on \mathbb{R}^{d} , where d denotes the data dimensionality. It transports a source distribution p_{0} (typically standard Gaussian) to a target data distribution p_{1} via a time-dependent velocity field. Let x_{0}\sim p_{0} and x_{1}\sim p_{1} denote samples from the source and target distributions, respectively. Let \{p_{t}\}_{t\in[0,1]} be a family of intermediate distributions interpolating between p_{0} and p_{1} , and let u_{t}:\mathbb{R}^{d}\times[0,1]\to\mathbb{R}^{d} denote a (marginal) velocity field that generates this path. Formally, the random process (x_{t})_{t\in[0,1]} obeys the ODE \frac{dx_{t}}{dt}=u_{t}(x_{t},t),\qquad x_{t}\sim p_{t}. (1) Flow Matching learns a neural approximation v_{\phi}:\mathbb{R}^{d}\times[0,1]\to\mathbb{R}^{d} to the true marginal velocity field u_{t} by minimizing the squared error: \min_{\phi}\penalty\ \mathbb{E}_{t\sim\mathcal{U}[0,1],\,x_{t}\sim p_{t}}\left[\bigl\|v_{\phi}(x_{t},t)-u_{t}(x_{t},t)\bigr\|^{2}\right]. (2) At sampling time, the learned vector

Read the complete text