Midpoint Generative Models

Daniil Shlenskii, Nikita Gushchin, Lev Novitskiy, Dmitry V. Dylov, Alexander Korotin · 2026

Read Midpoint Generative Models by Daniil Shlenskii, Nikita Gushchin, Lev Novitskiy, Dmitry V. Dylov, Alexander Korotin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29920.txt.

Introduction

Daniil Shlenskii and four colleagues train one-step generative models from a symmetry in flow matching. When the two end distributions match, the drift field dies at the middle time, and its size gives a sound gap measure, the Midpoint Divergence. Randomly flipped blends stretch the gap past the midpoint, and symmetric random blends widen it further. A variational form of the widened gap yields a workable training goal for a one-step maker. The resulting Midpoint Generative Models stand level with rival one-step methods on firmer theory.

Catalog record

CREATORDaniil Shlenskii, Nikita Gushchin, Lev Novitskiy, Dmitry V. Dylov, Alexander Korotin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70693
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29920

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Midpoint Generative Models Daniil Shlenskii, Nikita Gushchin, Lev Novitskiy, Dmitry V. Dylov, Alexander Korotin Abstract We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the corresponding drift field vanishes at the midpoint time, t = 1 / 2 t=1/2 . We show that the norm of this field defines a valid discrepancy between distributions, which we call the Midpoint Divergence . We extend this discrepancy beyond the midpoint by introducing randomly flipped interpolations and further generalize it by replacing deterministic linear Flow Matching interpolations with symmetric stochastic interpolants, yielding a generalized Midpoint Divergence. Finally, we derive a variational formulation of our generalized divergence, yielding a tractable objective for training a one-step generator. The resulting MGM algorithm offers an effective and theoretically grounded approach to generative modeling, achieving competitive performance against existing one-step generative modeling methods. 1 1 footnotetext: AXXX, Russia; 2 Applied AI Institute, Russia; 3 Kandinsky Lab, Russia 1 1 footnotetext: Equal contribution. Corresponding authors: [email protected] 1 Introduction Diffusion and flow models are now at the core of many generative systems, enabling a wide range of practical applications: image generation [ 7 , 35 ] , video generation [ 16 ] , audio generation [ 22 ] , image editing [ 33 ] , and image-to-image translation [ 36 ] . However, whenever diffusion models are applied, the next question is often the same: how can we make them fast enough for practical use? Several lines of work address this question, including the development of more accurate numerical solvers [ 41 , 19 , 30 ] , the distillation of pre-trained diffusion or flow models into one- or few-step generators [ 37 , 42 , 51 , 38 , 12 ] , and the design of new training schemes that learn one-step generators from scratch using structural properties of diffusion and flow models [ 42 , 44 , 8 , 9 ] . In this work, we propose a novel and effective framework based on a previously unused symmetry of Flow Matching with linear interpolation [ 26 , 27 ] . We observe that Flow Matching with linear interpolation between identical endpoint distributions p_{0}=p_{1} has zero velocity vector field at the midpoint time t=1/2 : v_{1/2}(x)\equiv 0. We show that this property can be used as the foundation of a divergence between two probability distributions p_{0} and p_{1} : if the midpoint velocity field is nonzero, then the two endpoint distributions are different. More precisely, the expected squared norm of this field defines a discrepancy that vanishes exactly when the two distributions coincide. In its basic form, this observation applies only at the midpoint time t=1/2 . We further show that, by introducing a random time flip t\mapsto 1-t in the interpolation, one can overcome this problem of v_{t}(x)\not\equiv 0 for arbitrary time t and extend the construction to a time-integrated divergence. Moreover, the same idea applies beyond deterministic linear paths and yields a generalized a Divergence for symmetric stochastic interpolants [ 2 , 1 ] . This divergence provides a principled way to distinguish between two endpoint distributions and serves as the basis for our final training algorithm, which we call Midpoint Generative Models (MGM). Thus, our main contributions are as follows: • We introduce the Midpoint Divergence , a new distributional discrepancy derived from the midpoint symmetry of linear interpolant Flow Matching ( \wasyparagraph 3.1 ). We prove that this divergence is definite: it is nonnegative and vanishes if and only if the two endpoint distributions are equal. We further extend this construction to time-integrated objectives ( \wasyparagraph 3.2 ) and symmetric stochastic interpolants ( \wasyparagraph 3.3 ) by introducing a random time-flip. • We develop Midpoint Generative Models (MGM), a practical training framework for one-step generative modeling based on the proposed divergence. We derive a variational formulation ( \wasyparagraph 3.4 ) with a learned displacement field yielding an effective, practical algorithm for training generators directly from data, without requiring a pre-trained diffusion or flow teacher. We show that our method is competitive with the other approaches, learning one-step generators based on diffusion/flow properties ( \wasyparagraph 5 ). 2 Background We briefly review Flow Matching ( \wasyparagraph 2.1 ) and stochastic interpolants ( \wasyparagraph 2.2 ), which provide the vector-field learning and path-construction framework underlying our method. This fixes notation for the learned ODE dynamics and motivates the interpolant-based discrepancy introduced later. 2.1 Flow Matching Flow Matching learns a time-dependent vector field that defines an ordinary differential equation (ODE) transporting samples between distributions [ 26 , 27 ] . Given independent endpoint samples X_{0}\sim p_{0} and X_{1}\sim p_{1} , a basic choice is the linear interpolant X_{t}=(1-t)X_{0}+tX_{1},\qquad t\in[0,1]. This interpolant defines a path of marginal distributions p_{t}=\mathrm{Law}(X_{t}) . These marginals are recovered by the probability flow ODE \frac{dY_{t}}{dt}=v_{t}^{\star}(Y_{t}),\qquad Y_{0}\sim p_{0}, where the drift is given by the conditional expectation: \displaystyle v_{t}^{\star}(x)=\mathbb{E}_{X_{0},X_{1}}\left[X_{1}-X_{0}\mid X_{t}=x\right]. (1) Thus, Flow Matching reduces generative modeling to learning the drift v_{t}^{\star}(x) that transports samples along the marginal path from p_{0} to p_{1} through the ODE. 2.2 Stochastic Interpolants The stochastic interpolants framework is a generalization of the linear one, allowing more flexible, possibly noisy paths between endpoint samples [ 1 ] . Let X_{0}\sim p_{0} , X_{1}\sim p_{1} , and \epsilon\sim\mathcal{N}(0,Id) be independent. A stochastic interpolant is defined as \displaystyle X_{t}=I_{t}(X_{0},X_{1})+\sigma_{t}\epsilon,\qquad t\in[0,1], where I_{0}(X_{0},X_{1})=X_{0},\qquad I_{1}(X_{0},X_{1})=X_{1},\qquad\sigma_{0}=\sigma_{1}=0, with I_{t} twice continuously differentiable in both time and space and \sigma_{t}^{2}\in C^{2}([0,1]) . The standard Flow Matching construction is recovered by setting I_{t}(X_{0},X_{1})=(1-t)X_{0}+tX_{1} and \sigma_{t}=0 , giving the linear interpolant above. 3 Midpoint Generative Models In this section, we introduce M idpoint G enerative M odels (MGM), a principled framework for training one-step generative models. We begin in § 3.1 by showing that the velocity field induced by linear Flow Matching contains a discriminative signal at the midpoint t=1/2 . In particular, this velocity field vanishes when the endpoint distributions coincide, and its failure to vanish gives rise to the Midpoint Divergence. Next, in § 3.2 , we extend this idea beyond the midpoint. Since non-midpoint times introduce an orientation bias, we introduce a randomly flipped interpolation that restores symmetry and leads to a time-integrated Midpoint Divergence. In § 3.3 , we further generalize the construction from deterministic linear interpolations to symmetric stochastic interpolants, yielding a generalized Midpoint Divergence. Finally, in § 3.4 , we show how this generalized divergence can be used as a training objective for generative modeling. We derive a variational formulation with a learned displacement field model and summarize the resulting practical training algorithm for one-step generators. All proofs are provided in Appendix A . 3.1 Midpoint Divergence Consider the Flow Matching linear interpolation between two distributions p_{0} and p_{1} and the corresponding velocity field v_{t} in ( 1 ). A key property of this field is that it vanishes at the midpoint t=1/2 , i.e., v_{1/2}\equiv 0 , whenever p_{0}=p_{1} . We illustrate this in Figure 1 and state it formally below. Proposition 3.1 (Midpoint symmetry) . Let X_{0} and X_{1} be independent samples from the same distribution p with finite first moment. Then \displaystyle v_{1/2}(x)=\mathbb{E}_{X_{0},X_{1}}\!\left[X_{1}-X_{0}\mid X_{1/2}=x\right]=0\quad\text{for }p_{1/2}\text{-a.e. }x.

Read the complete text