Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers

Wenhao Sun, Zhaoqiang Liu, [0em] University of Electronic Science, Technology of China · 2026

Read Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers by Wenhao Sun, Zhaoqiang Liu, [0em] University of Electronic Science, Technology of China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10744.txt.

Introduction

Wenhao Sun and Zhaoqiang Liu introduce Just-in-Time, a training-free framework that speeds up diffusion transformers in the spatial domain. Sampling is costly, and older methods focus on time steps, missing spatial redundancy, where global structure forms long before fine detail. JiT drives the full latent state from computations on a sparse, dynamically chosen set of anchor tokens. A deterministic micro-flow keeps transitions seamless as new tokens join. On FLUX.1-dev it reached up to sevenfold speedup with nearly lossless quality.

Catalog record

CREATORWenhao Sun, Zhaoqiang Liu, [0em] University of Electronic Science, Technology of China
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54850
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10744

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers Wenhao Sun, Zhaoqiang Liu, [0em] University of Electronic Science, Technology of China Abstract Diffusion Transformers have established a new state-of-the-art in image synthesis, but the high computational cost of iterative sampling severely hampers their practical deployment. While existing acceleration methods often focus on the temporal domain, they overlook the substantial spatial redundancy inherent in the generative process, where global structures emerge long before fine-grained details are formed. The uniform computational treatment of all spatial regions represents a critical inefficiency. In this paper, we introduce Just-in-Time (JiT) , a novel training-free framework that addresses this challenge by acceleration in the spatial domain. JiT formulates a spatially approximated generative ordinary differential equation (ODE) that drives the full latent state evolution based on computations from a dynamically selected, sparse subset of anchor tokens. To ensure seamless transitions as new tokens are incorporated to expand the dimensions of the latent state, we propose a deterministic micro-flow, a simple and effective finite-time ODE that maintains both structural coherence and statistical correctness. Extensive experiments on the state-of-the-art FLUX.1-dev model demonstrate that JiT achieves up to a 7 × \times speedup with nearly lossless performance, significantly outperforming existing acceleration methods and establishing a new and superior trade-off between inference speed and generation fidelity. Figure 1 : Visual showcases of our JiT framework applied to the FLUX.1-dev model. Our method produces high-fidelity and visually compelling images even at significant acceleration factors of 4\times and 7\times . † † footnotetext: {}^{\text{\Letter}} Corresponding author. 1 Introduction Generative artificial intelligence is fundamentally reshaping the paradigm of digital content creation at an unprecedented depth and breadth. Among its advancements, text-to-image 29 ; 30 ; 28 ; 12 and text-to-video 1 ; 46 ; 6 ; 35 ; 38 synthesis, underpinned by diffusion models 4 ; 34 ; 32 , have become the dominant technological route due to their exceptional generation quality and semantic controllability. In recent developments, the diffusion Transformer (DiT) 27 ; 26 ; 43 has emerged as a particularly potent architecture. By leveraging self-attention mechanisms 37 to efficiently model long-range dependencies between arbitrary tokens in image or video data, DiT have demonstrated remarkable scalability and performance potential, continuously pushing the frontiers of generative fidelity. However, the exceptional performance of DiT is coupled with a substantial computational overhead stemming from its self-attention mechanism, whose complexity grows quadratically with the number of input tokens. When generating high-resolution images or, more critically, long-duration videos, this growth leads to a computational avalanche. This issue is further exacerbated by the inherently iterative nature of the diffusion denoising process, resulting in prohibitive inference latency and demanding stringent hardware requirements. These challenges severely constrain the application of DiT in real-time interactive systems, consumer-grade devices, and large-scale commercial services. Efforts to mitigate the high computational cost of DiT have largely progressed along two main directions. The first focuses on the temporal domain, striving to shorten the sampling trajectory by reducing the number of function evaluations. This line of work includes the design of sophisticated high-order solvers 23 ; 47 ; 52 ; 45 ; 25 and the distillation of pre-trained models into few-step variants 31 ; 48 ; 24 ; 13 ; 2 . However, these approaches often come with the caveats of potentially compromising generation fidelity in ultra-low step regimes or demanding retraining resources. A second (complementary) direction aims to make each sampling step more efficient. This is achieved through techniques such as feature caching, which exploits temporal redundancy by reusing intermediate activations across iterations 20 ; 21 ; 53 ; 50 , and low-bit quantization, which accelerates underlying matrix operations and reduces the memory footprint by representing weights and activations with lower numerical precision 8 ; 17 ; 39 . Despite their notable successes in optimizing temporal steps and model parameters, these approaches often overlook the intrinsic spatial redundancy inherent in the generative process. Specifically, they treat all spatial regions with uniform computational effort throughout the generation process. We consider this to be an unnecessary luxury, given the well-established characteristic of diffusion models to first synthesize low-frequency global structures before progressively refining high-frequency details. This observation raises a natural question: How can we dynamically focus computational resources on salient spatial regions during the early stages of generation while deferring computation on less critical areas? To realize this opportunity for dynamic spatial acceleration, we introduce Just-in-Time (JiT), a novel and training-free framework for spatial acceleration. Specifically, our approach achieves dynamic spatial acceleration by introducing a reasonable approximation to the underlying generative ordinary differential equation (ODE), which enables a dynamic reduction of computational load in the spatial domain without requiring model retraining. We implement JiT on the state-of-the-art (SOTA) DiT model FLUX.1-dev 15 and demonstrate that it attains nearly lossless performance while achieving significant inference speedups of up to 7\times (as shown in Fig. 1 ). Our main contributions are summarized as follows: • We propose JiT, a novel and training-free framework for accelerating spatial image generation in flow-matching-based DiT models. Our framework is meticulously designed with two synergistic components: (1) The spatially approximated generative ODE (SAG-ODE), which efficiently drives the latent state by approximating the full velocity field from sparse anchor tokens computations using an augmented lifter operator. (2) The deterministic micro-flow (DMF), a well-designed finite-time ODE that ensures seamless and statistically correct activation of new tokens during stage transitions, thereby maintaining latent space continuity and preventing artifacts. • Extensive experiments and user studies demonstrate the superior acceleration capabilities and preserved generation quality of our method, outperforming existing SOTA acceleration methods for image generation. 2 Related works 2.1 Diffusion models Denoising diffusion probabilistic models (DDPMs) 4 have become a dominant force in generative modeling, lauded for their high-fidelity synthesis capabilities. Their formulation has evolved from score-based stochastic differential equations (SDEs) 34 to deterministic ODE samplers, such as DDIM 33 , and more recently to the flow matching paradigm 22 ; 18 , which directly learns the ODE vector field and is a framework exemplified by FLUX.1-dev model used in our work. Despite their prowess, a critical limitation remains in their slow, iterative sampling process, requiring a large number of neural function evaluations (NFEs). This computational burden has spurred the development of various acceleration methods, and our work contributes a novel, training-free spatial acceleration technique tailored for this modern ODE-based framework. 2.2 Spatial acceleration Spatial acceleration methods aim to reduce the substantial computational cost of diffusion models by operating on a spatially reduced representation of the latent state, particularly during the early, noise-dominated stages of the generation process. Early approaches 9 ; 36 ; 51 adopted a pyramidal or hierarchical strategy 10 ; 5 ; 49 , generating a low-resolution latent and progressively upscaling it. These methods typically rely on explicit upsampling or downsampling operators for dimensionality transition, often coupled with a distribution correction method to align the rescaled features with the target noise distribution at each new scale. While these hierarchical methods have demonstrated feasibility, they are often plagued by some major challenges. For instance, upsampling operators can introduce information loss or aliasing artifacts, and the efficacy of post-hoc correction steps is not always guaranteed, frequently leading to visual inconsistencies in the final output. A notable departure from this paradigm

Read the complete text