Distance Marching for Generative Modeling

Zimo Wang, Ishit Mehta, Haolin Lu, Chung-En Sun, Ge Yan, Tsui-Wei Weng, Tzu-Mao Li · 2026

Read Distance Marching for Generative Modeling by Zimo Wang, Ishit Mehta, Haolin Lu, Chung-En Sun, Ge Yan, Tsui-Wei Weng, Tzu-Mao Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02928.txt.

Introduction

Modeling the shape of the data itself drives a 2026 paper by Zimo Wang and 7 co-authors. Most generative models move noise toward data without ever describing the data's surface, called its manifold. Their Distance Marching method learns a distance field, which reports how far any point sits from that surface.

New loss functions stress targets from closer data points, reducing ambiguity and bias toward the average. Two deterministic samplers follow the field downhill and converge quickly. The model needs no time input, yet stays competitive with time-based models. Its distance estimates also help with early stopping and spotting out-of-distribution inputs.

Catalog record

CREATORZimo Wang, Ishit Mehta, Haolin Lu, Chung-En Sun, Ge Yan, Tsui-Wei Weng, Tzu-Mao Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02928

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distance Marching for Generative Modeling Zimo Wang, Ishit Mehta, Haolin Lu, Chung-En Sun, Ge Yan, Tsui-Wei Weng, Tzu-Mao Li Abstract Time-unconditional generative models learn time-independent denoising vector fields. But without time conditioning, the same noisy input may correspond to multiple noise levels and different denoising directions, which interferes with the supervision signal. Inspired by distance field modeling, we propose Distance Marching , a new time-unconditional approach with two principled inference methods. Crucially, we design losses that focus on closer targets. This yields denoising directions better directed toward the data manifold. Across architectures, Distance Marching consistently improves FID by 13.5% on CIFAR-10 and ImageNet over recent time-unconditional baselines. For class-conditional ImageNet generation, despite removing time input, Distance Marching surpasses flow matching using our losses and inference methods. It achieves lower FID than flow matching’s final performance using 60% of the sampling steps and 13.6% lower FID on average across backbone sizes. Moreover, our distance prediction is also helpful for early stopping during sampling and for OOD detection. We hope distance field modeling can serve as a principled lens for generative modeling. 1 Introduction Recent advances in generative modeling have been driven by diffusion and flow-based approaches ( 49 ; 17 ; 50 ; 51 ; 46 ; 5 ; 31 ) , which learn denoising vector fields that transport noise toward the data manifold. In practice, high-fidelity and fast sampling typically rely on explicit time conditioning and tightly coupled schedules and parameterizations ( 38 ; 21 ; 18 ; 34 ; 42 ) . Although removing explicit time conditioning simplifies the method and enables flexible denoising tasks, recent attempts ( 52 ; 2 ; 56 ) often fall back on ad-hoc, architecture-dependent coefficient constraints and sacrifice image quality. Figure 1 : We propose Distance Marching to generate images without time input. It is inspired by distance modeling and produces a denoising direction focusing on closer targets, while flow matching loss learns a direction biased toward the data mean in the early stage. We compare outcomes after 20% of the steps to show our generation wanders less. See detailed analysis in Section 4 . A key obstacle is that, once explicit time conditioning is removed, the same noisy input can arise from multiple noise levels and different denoising directions, making the denoising target fundamentally ambiguous ( 29 ; 3 ) . Under standard denoising objectives, the optimizer averages over these incompatible targets and may deviate from a direction pointing toward the manifold. Empirically, we find that simple time-based reweighting does not resolve this ambiguity, and conditional generation can further amplify it through train–inference mismatch ( 6 ) . In this work, we draw inspiration from computer graphics, particularly distance-field-based methods for surface reconstruction and rendering, and propose Distance Marching . We find these seemingly unrelated problems highly relevant to generative modeling: both require reasoning about a low-dimensional structure embedded in an ambient space and navigating points toward that structure. Motivated by this connection, we introduce distance-field-inspired losses to train a neural network that depends only on the current point, thereby decoupling generation from explicit time conditioning. This distance-field view makes standard gradient descent a natural and effective update rule across architectures in our analysis and experiments. Moreover, because the field provides a meaningful scalar distance value, it also enables sphere-tracing updates as used in rendering ( 16 ) , highlighting a concrete advantage of modeling generation from a distance-field perspective. More importantly, from a denoising perspective, distance-field-inspired losses help disambiguate the training target. By concentrating learning on closer targets, the learned denoising direction could more effectively denoise and aligns better with the data manifold. We support this claim with qualitative low-dimensional visualizations and quantitative high-dimensional comparisons. As a result, Distance Marching consistently outperforms prior time-unconditional methods across architectures and scales, regardless whether class conditioning is used. Contributions. Our main contributions are: • Reformulating time-unconditional generation via distance-field modeling. We propose Distance Marching , which learns a distance-like field that depends only on the current point, decoupling generation from explicit time conditioning. • Two principled inference methods from a distance-field view. The learned field supports standard gradient descent via its direction prediction and sphere-tracing-style adaptive updates via its distance value ( 16 ) . • Objectives that reduce target ambiguity. From distance-field modeling, we design losses that focus on closer targets, yielding directions that denoise more effectively. We support it with low-dimensional visualizations and high-dimensional quantitative comparisons. • Competitive results without time conditioning across architectures and scales. Distance Marching improves average FID by 13.5% across CIFAR-10 and ImageNet over recent time-unconditional baselines at similar model sizes ( Table 12 ). It also surpasses strong time-conditional flow-matching models on ImageNet. Notably, we achieve lower FID than the baseline’s final result using only 60% of the sampling steps ( Figure 15 ) and 13.6% lower FID on average across backbone sizes ( Figure 11 ). 2 Related Work Time-conditioned diffusion and flow models. Diffusion ( 49 ; 17 ; 50 ; 51 ) and flow-based models ( 46 ; 5 ; 31 ) typically rely on explicit time or noise conditioning and carefully designed parameterizations. Prior work improves sample quality or reduces sampling steps by refining schedules, coefficients, and conditioning mechanisms ( 38 ; 21 ; 18 ; 34 ; 42 ) . These methods are effective but suffer from exposure bias: during inference, the model is queried at discrete time steps on states it generated itself, which no longer match the true forward-noise distribution, causing error accumulation ( 40 ; 28 ) . Time-unconditional generative modeling. Removing explicit time conditioning has been explored in several lines of work, including early score matching and energy-based formulations ( 20 ; 4 ; 25 ; 12 ) . However, in high-dimensional image generation, eliminating time or noise inputs can degrade image quality ( 12 ; 39 ; 52 ) and training stability ( 11 ) . Recent time-unconditional approaches such as uEDM ( 52 ) and Energy Matching ( 2 ) typically rely on specific coefficient constraints or training schedules, and their sampling remains delicate, with inconsistent gains on large-scale datasets. Equilibrium Matching ( 56 ) shows sensitivity to the choice of decaying coefficients with limited theoretical guidance, and its effectiveness drops when switching architectures or training setups. Distance-field modeling and sphere tracing. Our method draws inspiration from neural distance fields in geometry processing and rendering ( 19 ; 41 ; 57 ) . Distance fields guide points toward the zero level set using a direction and magnitude that depend only on spatial coordinates, and sphere tracing ( 16 ) exploits this property to take adaptive, well-calibrated steps. Prior work ( 15 ; 1 ; 35 ) has introduced directional representations and constraints to better regularize the learned distance field. 43 and 55 indicate the potential of distance-based modeling for generation but do not introduce new loss functions. 3 Method 3.1 Preliminary and Motivation (a) Target two-moons ( orange ) and learned level sets u_{\theta} (b) Our learned level sets u_{\theta} and -\nabla_{\mathbf{x}}u_{\theta} (black arrows) (c) Energy Matching learns an energy landscape with inaccurate gradients and details. (d) Equilibrium Matching provides rough energy landscape especially nearby the data manifold. (e) Our generation avoids meandering near the init:

Read the complete text