Self-Adversarial One Step Generation via Condition Shifting
Deyuan Liu Peng Sun Yansen Han Zhenglin Cheng Chuyan Chen Tao Lin, [0.5ex] Westlake University · 2026
Read Self-Adversarial One Step Generation via Condition Shifting by Deyuan Liu Peng Sun Yansen Han Zhenglin Cheng Chuyan Chen Tao Lin, [0.5ex] Westlake University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12322.txt.
Introduction
Liu and five colleagues present APEX, a discriminator-free method for one-step text-to-image generation built on condition shifting in flow models. A shifted condition branch yields a velocity field estimating the model's current output distribution, giving a gradient aligned with GAN training without an external discriminator or its instability and memory costs. Their 0.6 billion parameter model beats a 12 billion parameter rival in one-step quality, and LoRA tuning reaches a GenEval score of 0.89 in one step, beating the 50-step teacher while running 15.33 times faster.
Catalog record
| CREATOR | Deyuan Liu Peng Sun Yansen Han Zhenglin Cheng Chuyan Chen Tao Lin, [0.5ex] Westlake University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95208 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12322
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Adversarial One Step Generation via Condition Shifting Deyuan Liu Peng Sun Yansen Han Zhenglin Cheng Chuyan Chen Tao Lin, [0.5ex] Westlake University Abstract The push for efficient text to image synthesis has moved the field toward one step sampling, yet existing methods still face a three way tradeoff among fidelity, inference speed, and training efficiency. Approaches that rely on external discriminators can sharpen one step performance, but they often introduce training instability, high GPU memory overhead, and slow convergence, which complicates scaling and parameter efficient tuning. In contrast, regression based distillation and consistency objectives are easier to optimize, but they typically lose fine details when constrained to a single step. We present APEX , built on a key theoretical insight: adversarial correction signals can be extracted endogenously from a flow model through condition shifting . Using a transformation creates a shifted condition branch whose velocity field serves as an independent estimator of the model’s current generation distribution, yielding a gradient that is provably GAN aligned, replacing the sample dependent discriminator terms that cause gradient vanishing. This discriminator free design is architecture preserving, making APEX a plug and play framework compatible with both full parameter and LoRA based tuning. Empirically, our 0.6B model surpasses FLUX-Schnell 12B (20 × \times more parameters) in one step quality. With LoRA tuning on Qwen-Image 20B , APEX reaches a GenEval score of 0.89 at NFE = 1 in 6 hours , surpassing the original 50-step teacher (0.87) and providing a 15.33 × \times inference speedup. Code is available here . Figure 1: An overview of generated images. 1 Introduction Continuous generative models now achieve strong fidelity across domains, from photorealistic image synthesis ( 14 ; 27 ) to video generation ( 23 ; 7 ) . This progress is largely driven by diffusion models ( 22 ; 14 ) and flow matching frameworks ( 32 ; 38 ) , which sample by integrating a Probability Flow Ordinary Differential Equation (PF-ODE), from noise to data ( 54 ) . The same iterative paradigm also dominates inference cost: multi step integration often requires tens of function evaluations and can be prohibitively expensive ( 27 ; 42 ) , motivating sustained interest in one step synthesis ( 53 ; 50 ; 65 ) . Achieving number of function evaluations (NFE) = 1 at high resolution exposes a persistent trilemma among generation quality, inference efficiency, and training efficiency ( 53 ; 35 ; 65 ; 51 ) . External adversarial components like a discriminator or auxiliary critic can improve one step realism, but they often hurt scalability by introducing training instability and additional system overhead ( 65 ; 28 ; 68 ) . This overhead becomes especially costly when scaling pretrained backbones or doing parameter efficient tuning. In contrast, regression based distillation ( 66 ) and consistency style objectives ( 53 ; 56 ) are typically easier to optimize, yet they often struggle to match adversarial realism in one step, especially for high frequency textures and fine details ( 53 ; 35 ; 19 ; 55 ) . Complementary to these lines, a recent work, TwinFlow ( 11 ) , also explores self adversarial methods that build adversarial signals by model itself. \mathbb{Q} : How can we obtain GAN level one step fidelity at NFE=1 without an external discriminator, while remaining scalable to large pretrained backbones and parameter efficient tuning? Our approach. We introduce APEX , built on a key theoretical insight: the adversarial correction signal that GANs derive from an external discriminator can be generated endogenously within a flow model by separating real and fake scores in condition space . Concretely, APEX constructs a shifted condition \mathbf{c}_{\text{fake}}=\mathbf{A}\mathbf{c}+\mathbf{b} via an affine transformation and trains the model under \mathbf{c}_{\text{fake}} to fit trajectories toward its current one step outputs. This shifted condition branch provides an independent estimator of the fake distribution’s velocity field, enabling the main branch under the true condition \mathbf{c} to receive an adversarial correction signal. We also show that APEX admits a GAN aligned gradient interpretation. Under the Optimal Transport path, the score velocity duality connects velocity regression to score matching, allowing us to express APEX ’s update in the same canonical score difference form as GANs. Crucially, while GANs weight the score difference using sample dependent discriminator terms such as D^{*} or 1-D^{*} , APEX corresponds to a constant weight with a target score induced by condition shifting. This yields stable, discriminator free signals while preserving an adversarial force toward photorealism. Our main contributions are: a. Theoretical Foundation — GAN Aligned Gradient with Constant Weight: We establish a formal gradient level equivalence between APEX and GAN dynamics via score velocity duality ( Section 3.3 ), proving that APEX ’s training gradient takes the canonical score difference form (\mathbf{s}_{\theta}-\mathbf{s}_{\text{mix}})\cdot\partial\mathbf{x}_{t}/\partial\theta with constant weight w\equiv 1 and an implicit score interpolation target \mathbf{s}_{\text{mix}}=(1{-}\lambda)\mathbf{s}_{\text{data}}+\lambda\mathbf{s}_{\text{fake}} , connecting APEX to Fisher divergence minimization and explaining why it avoids the gradient instability of sample dependent discriminator weights. b. Methodology — Self Adversarial Framework via Condition Shifting: We propose APEX , a discriminator free framework using an affine condition shift \mathbf{c}_{\text{fake}}=\mathbf{A}\mathbf{c}+\mathbf{b} to generate an endogenous adversarial signal for one step, high resolution text to image synthesis. This design makes APEX a plug and play replacement fully compatible with LoRA and other parameter efficient fine tuning pipelines. c. SOTA Performance and Scalability: Our 0.6B model surpasses FLUX-Schnell 12B in one step quality at NFE=1 . With LoRA tuning on Qwen-Image 20B , APEX reaches GenEval 0.89 in 6 hours , surpassing the original 50 step teacher model (0.87). 2 Preliminaries Continuous Generative Models. Diffusion generative models ( 22 ; 54 ) and flow matching models ( 32 ) both describe a continuous time evolution that transports a simple prior p(\mathbf{z})=\mathcal{N}(\mathbf{0},\mathbf{I}) toward a complex data distribution p_{\text{data}}(\mathbf{x}) . While classical diffusion is formulated as a stochastic forward noising process and a reverse time SDE, it admits an equivalent deterministic sampler given by the Probability Flow ODE (PF-ODE) associated with the same score field ( 54 ) . We define a time dependent random variable \mathbf{x}_{t} , t\in[0,1] , as a linear interpolant between noise \mathbf{z} and data \mathbf{x} : \mathbf{x}_{t}=\alpha(t)\mathbf{z}+\gamma(t)\mathbf{x}\,. (1) Typically, we adopt the Optimal Transport (OT) path with \alpha(t)=t,\ \gamma(t)=1-t , which satisfies the boundary conditions \mathbf{x}_{1}=\mathbf{z} for pure noise and \mathbf{x}_{0}=\mathbf{x} for pure data. This interpolation path induces a velocity field \mathbf{v}(\mathbf{x}_{t},t) , defining the PF-ODE for sample generation: \frac{\mathrm{d}\mathbf{x}_{t}}{\mathrm{d}t}=\mathbf{v}(\mathbf{x}_{t},t)\,. (2) Given an estimate of \mathbf{v}_{t} , we can numerically integrate Eq. ( 2 ) from t=1 to t=0 using standard ODE solvers (e.g., Euler ( 26 ) ) to generate samples. For conditional generation with condition \mathbf{c} , flow matching trains a neural network \bm{F}_{\bm{\theta}}(\mathbf{x}_{t},t,\mathbf{c}) to approximate a target velocity field. Along the OT path, conditional velocity of a particular pair (\mathbf{x},\mathbf{z}) is defined as the time derivative: \frac{\mathrm{d}}{\mathrm{d}t}(t\mathbf{z}+(1-t)\mathbf{x})=\mathbf{z}-\mathbf{x}\,. (3) This quantity is an unbiased regression target; minimizing a squared error loss recovers the population optimal conditional mean \mathbf{v}^{*}(\mathbf{x}_{t},t) . The standard FM loss is: \mathcal{L}_{\text{FM}}({\bm{\theta}})={\mathbb{E}}_{\mathbf{x}_{t},\,\mathbf{z},\,t}\left[\|\bm{F}_{\bm{\theta}}(\mathbf{x}_{t},t,\mathbf{c})-(\mathbf{z}-\mathbf{x})\|^{2}\right]\,, (4) where the expectation is taken over the joint distribution of (t,\mathbf{x},\mathbf{z}) , ensuring that \bm{F}_{\bm{\theta}} recovers the vector field \mathbf{v}^{*} as the conditional expectation of the per sample velocity targets \mathbf{z}-\mathbf{x} given \mathbf{x}_{t} . Score Velocity