Generative Modeling with Orbit-Space Particle Flow Matching 789 Journal: TOG Volume: 45 4 117 7 DOI: 10.1145/3811342 CCS: Computing methodologies Point-based models
Sinan Wang, Jinjin He, Shenyifan Lu, Ruicheng Wang, Greg Turk, Bo Zhu · 2026
Read Generative Modeling with Orbit-Space Particle Flow Matching 789 Journal: TOG Volume: 45 4 117 7 DOI: 10.1145/3811342 CCS: Computing methodologies Point-based models by Sinan Wang, Jinjin He, Shenyifan Lu, Ruicheng Wang, Greg Turk, Bo Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02222.txt.
Introduction
Sinan Wang and colleagues present a flow-matching method for making particle systems. Particles have no fixed order. Labelling them by index makes flows curved and hard to learn. Particles also live in real space. So the final flow speed can carry shape cues, such as surface normals.
Their orbit-space method has three parts. First, it sets a shared form for the path end point. Second, index tags let particles take on roles. Third, geometric paths use arc-length-aware speeds and yield normals as a byproduct. On minimal-surface tests, error fell sharply in one step. On ShapeNet, results matched top methods with far fewer steps.
Catalog record
| CREATOR | Sinan Wang, Jinjin He, Shenyifan Lu, Ruicheng Wang, Greg Turk, Bo Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 112 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02222
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative Modeling with Orbit-Space Particle Flow Matching 789 Journal: TOG Volume: 45 4 117 7 DOI: 10.1145/3811342 CCS: Computing methodologies Point-based models Sinan Wang, Jinjin He, Shenyifan Lu, Ruicheng Wang, Greg Turk, Bo Zhu Abstract . We present Orbit-Space Geometric Probability Paths (OGPP) , a particle-native flow-matching framework for generative modeling of particle systems. OGPP is motivated by two insights: (i) particles are defined up to permutation symmetries , so anonymous indexing inflates per-index target variance and yields curved, hard-to-learn flows; (ii) particles live in physical space, so the flow’s terminal velocity has physical meaning and can encode geometric attributes (e.g., surface normals). OGPP instantiates three key components: (1) orbit-space canonicalization of the probability-path terminal endpoint, (2) particle index embeddings for role specialization, and (3) geometric probability paths with arc-length-aware terminal velocities that generate normals as a byproduct of the flow. We evaluate OGPP on minimal-surface benchmarks, where it reduces metric error by up to two orders of magnitude in a single inference step; on ShapeNet, where it matches the state-of-the-art with 5 × 5\times fewer steps and reaches airplane EMD comparable to DiT-3D with 26 × 26\times fewer parameters and 5 × 5\times fewer steps; and on single-shape encoding, where it produces normals and reconstructions competitive with 6D generators while operating entirely in 3D. \svgpath ./img/ Figure 1 . Left: ShapeNet point cloud generation, single-shape encoding on complex Thingi10k meshes with Poisson-reconstructed surfaces, and minimal surface generation. Middle: Generation process visualization showing geometric probability paths transporting noise to surface points with encoded normals. Right: Energy-driven particle generation: diffusion-limited aggregation (top) and multilayer Thomson problem with electrons on concentric shells (bottom). † † cc-license: by 1. Introduction Particles constitute a central representation in computer graphics, where sampling, geometry, appearance, and physics are often modeled as structured sets of particles embedded in 2D or 3D physical space. Such particle-based representations arise across graphics pipelines for different purposes, from Poisson sampling for ray tracing ( 3 ; 4 ) , to point-set surfaces and clouds for geometric modeling ( 8 ; 27 ; 68 ; 41 ) , to Lagrangian particles for solid and fluid simulations ( 63 ; 85 ; 64 ; 110 ) , and to agent-based animation such as crowd and flock simulation ( 77 ; 65 ; 88 ; 28 ) . Therefore, a generative model natively defined on particles and leveraging their connectivity-free structure and physical-space dynamics is well-motivated for graphics generation tasks. However, modern generative models are built on grids rather than particles (e.g., diffusion ( 32 ; 83 ; 78 ; 11 ) and flow matching ( 48 ) ). In these settings, the representation lives on a fixed grid (e.g., a 2D lattice of pixels), and generation amounts to mapping noise to data distributions on the grid. Despite their successes in generating images or videos, these models do not transfer efficiently to particle generation because they ignore two fundamental differences. First , particles exhibit pronounced symmetries : permuting particle indices leaves the underlying configuration unchanged, yet can arbitrarily alter its vectorized representation in high-dimensional space. In group-theoretic terms, the collection of all such symmetry-related configurations forms the orbit of a particle state. As a result, naively applying grid-based generative frameworks (e.g., flow matching ( 48 ) ) to particle data by flattening particles into long vectors leads to fundamental difficulties: For images, a pixel at a fixed coordinate exhibits consistent statistics across samples. In contrast, particle systems are defined only up to permutation symmetry: a particle at a fixed index does not correspond to any consistent spatial or statistical role across the dataset. Consequently, probability-path endpoints associated with a given index are dispersed throughout space, forcing velocity predictors to average over incompatible targets during training and yielding noisy, poorly structured per-particle flows. State-of-the-art particle generators such as Equivariant Flow Matching ( 45 ; 84 ) mitigate permutation ambiguity via optimal transport couplings. However, these methods incur high computational cost and still operate on flattened, anonymous particle representations, so individual indices must aggregate over many symmetry-induced roles, leading to increased target variance and highly curved flows. Second , particles live in physical space . Generating a set of particles can be viewed as simulating their spatiotemporal evolution under a learned physical velocity field. This differs fundamentally from image generation, where the velocity field in flow matching merely transports pixel values and carries no intrinsic physical meaning. In particle-based settings, however, the velocity field is defined in physical space, and the terminal velocity at t=1 represents a well-defined geometric quantity. For example, when particles sample a surface, this terminal velocity can encode meaningful local geometric information, such as surface normals or orientation. Standard linear paths place particles at the correct locations but do not exploit this geometric degree of freedom. Motivated by these two insights, we propose a generative framework for particles that both respects orbit structure and exploits geometric path. Our key idea is to untangle mixed particle roles by combining orbit-space canonicalization with identity-aware particle index embeddings. On top of this, we design geometric probability paths whose terminal tangents encode per-particle normals, so a single flow jointly generates particle positions and attributes. Our framework consists of three key components (See Figure 2 ): (i) orbit-space canonicalization , (ii) particle index embeddings , and (iii) geometric probability paths . All three are expressed as choices of conditional probability path , which we collectively call Orbit-Space Geometric Probability Paths (OGPP) . For orbit-space canonicalization , we perform symmetry reduction at the terminal endpoint X_{1} : for each particle configuration, we sort indices according to a geometric criterion (e.g., a space-filling curve) and select a single representative from the orbit. This enforces that particle index i consistently lands in a localized and stable spatial region, reducing variability in the training targets seen by each index. Next, for particle index embeddings , we attach a learnable identity embedding to each particle index and provide it to the velocity network. This allows the model to condition on particle identity, enabling different indices to specialize to distinct velocity-field roles, analogous to class-conditional generation. Together, canonicalization and identity embeddings convert noisy mixtures of regression targets into well-separated, easier-to-learn trajectory families, yielding straighter flows. Finally, for geometric probability paths , we replace linear interpolation with geometry-aware paths that exploit the structure of particle systems. Specifically, we construct Hermite-type probability paths whose terminal tangents align with per-particle normals: the endpoint specifies particle position, while the terminal velocity encodes local surface orientation. As a result, the learned flow simultaneously transports particles from noise to data and produces accurate surface normals as an intrinsic byproduct. Figure 2 . OGPP. Our framework integrates three key components: (i) orbit-space canonicalization assigns canonical indices (0,1,2,3) to X_{1} while keeping X_{0} uncanonicalized, (ii) particle index embeddings (colored blocks) allow each index to specialize to its canonical role, and (iii) geometric probability paths encode surface normals via arc-length-aware terminal velocities. Per-particle coordinates \bm{x}_{t_{i}}^{i} and learnable per-index embeddings are fed into a NN, predicting velocities \bm{u}_{t_{i}}^{\theta,i} supervised by reference velocities \bm{u}_{t_{i}}^{\text{ref},i} . We evaluate OGPP on a range of graphics-oriented generative tasks, including geometric reconstruction, shape generation, and physics simulation. For minimal-surface generation, OGPP reduces metric error by up to two