ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration
Qicheng Zhao, Yu Li, Qi Sun, Zheyu Yan · 2026
Read ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration by Qicheng Zhao, Yu Li, Qi Sun, Zheyu Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26769.txt.
Introduction
Qicheng Zhao, Yu Li, Qi Sun, and Zheyu Yan present ResilPhase, a method to speed up diffusion image models without wrecking quality. Such models generate images through many slow steps. Cache-then-forecast schemes skip steps by extrapolating, but quality collapses at high speed-ups. The authors trace the failure to forecasting on features misaligned with the model's true trajectory.
They recast the task as extrapolating the whole trajectory at once, in the space of the underlying flow equation. Even then, high-order derivatives of that trajectory are noisy and unstable. A derivative-free extrapolator based on Lagrange interpolation sidesteps the problem. A bounded phase mapping further steadies the forecast across noise levels. The design is plug-and-play with existing models. The authors report strong speed-ups with quality largely preserved.
Catalog record
| CREATOR | Qicheng Zhao, Yu Li, Qi Sun, Zheyu Yan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26769
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration Qicheng Zhao, Yu Li, Qi Sun, Zheyu Yan Abstract The adoption of powerful diffusion models is hindered by their significant inference latency. Recent “cache-then-forecast” schemes alleviate this issue by accelerating DiTs using derivative-based polynomials, but they suffer from severe quality degradation at high acceleration ratios. Our analysis reveals its root cause: the discrete extrapolation performed on representations that are misaligned with the continuous diffusion trajectory and are numerically unstable. Thus, accelerated DiTs suffer from accumulated spatial errors, noisy derivative amplification, and high-order instability. We therefore reformulate accelerated inference as stable macro-trajectory extrapolation in ordinary differential equation (ODE) space. Instead of predicting intermediate features, we align forecasting with the model’s Global Drift (GD), i.e., the end-to-end state evolution, thereby eliminating feature inconsistency and memory overhead. However, even this smooth macro-trajectory remains vulnerable to the derivative fallacy: its higher-order temporal derivatives are intrinsically noisy. Thus, we introduce a derivative-free barycentric Lagrange extrapolator to effectively bypass derivative instability and approximation error. We further propose a bounded Phase Mapping that regularizes the extrapolation domain, suppressing oscillatory error growth. These elements collectively constitute ResilPhase, a noise-resilient acceleration framework. Experiments on FLUX.1-dev and HunyuanVideo demonstrate state-of-the-art fidelity under aggressive acceleration ratios. Code is publicly available at https://github.com/zqc214/ResilPhase . 1 Introduction Diffusion Transformers (DiTs) [ 9 , 25 ] have become the gold standard for high-fidelity visual generation [ 1 , 27 , 23 , 45 , 33 ] , because of their scalable architecture. However, their performance is achieved through an iterative denoising process, requiring tens to hundreds of sequential forward steps that can not be parallelized. This has become a significant latency bottleneck that obstructs real-time and large-scale deployment of DiTs. FLUX.1-dev takes 23.69 seconds to generate an image on an A100 graphics card. To address this latency bottleneck, recent training-free acceleration efforts have evolved from passive “cache-then-reuse” paradigms [ 24 , 37 , 13 ] to “cache-then-forecast” approaches [ 18 , 19 , 44 ] that employ polynomials to predict feature trajectories. However, this prevailing paradigm suffers from severe quality degradation at high acceleration ratios. We argue this failure stems from a single root cause: discrete extrapolation is performed on intermediate representations misaligned with the continuous diffusion trajectory and numerically unstable. This root cause manifests in three intertwined limitations. First, from a spatial perspective, most methods rely on a computationally intensive layer-wise paradigm. Fitting polynomials to highly erratic micro-features within Transformer blocks cascades errors across the network depth, incurring massive memory overhead. While directly forecasting absolute outputs (e.g., FreqCa [ 17 ] ) bypasses this, as highlighted by \Delta -DiT [ 3 ] , it discards highly correlated input priors, restricting prediction fidelity bounds. Conversely, methods reusing residual displacements (e.g., \Delta -DiT [ 3 ] ) remain trapped in localized micro-updates, missing macroscopic continuous dynamics. Thus, existing paradigms lack an end-to-end target that simultaneously preserves input priors and aligns strictly with the ODE vector field. Figure 1 : Suppressing numerical instability via Phase Mapping. (a) Standard trajectory extrapolation on uniform timesteps suffers from Runge’s phenomenon, causing chaotic edge oscillations. (b) Our method maps discrete steps to a bounded phase space, minimizing the error bound for a stable fit. Second, from a temporal perspective, current forecasting methods (e.g., TaylorSeer [ 18 ] and HiCache [ 5 ] ) rely exclusively on derivative-based approximations. They critically overlook the mathematical nature of the dynamic trajectory: while the macro-trajectory itself is smooth, its higher-order derivatives over time are intrinsically chaotic (as shown in Fig. 2 (b)). Estimating these derivatives via finite differences exponentially amplifies the noise. Third, from a numerical approximation standpoint, performing polynomial extrapolation over uniform, discrete time steps inherently triggers Runge’s phenomenon. This numerical instability causes the extrapolation error bound to grow uncontrollably at the interval edges, inevitably leading to catastrophic quality degradation at aggressive acceleration ratios. To overcome these intertwined bottlenecks, we propose ResilPhase , a noise-resilient acceleration framework explicitly addressing the spatial, temporal, and numerical limitations of existing paradigms. First, to resolve spatial cascading errors inherent in layer-wise forecasting, ResilPhase shifts the prediction objective to the network’s macroscopic dynamic evolution. We propose ODE-Aligned Macro-Trajectory Targeting, formulating the prediction target as the Global Drift (GD): the end-to-end state displacement between the model’s final output and initial input. Unlike layer-wise approaches fitting highly oscillatory micro-signals within Transformer blocks, forecasting the GD aligns the extrapolator with the continuous probability flow ODE. This paradigm shift eliminates the memory overhead of caching block features and strictly severs error accumulation across network layers. Figure 2 : Effectiveness of the derivative-free prediction strategy. Unlike (a) our smooth global macro-trajectory, (b) the finite-difference derivative trajectory used by prior methods is intrinsically chaotic. Applying polynomial extrapolation to such unstable dynamics causes severe prediction deviations. As shown in (c), evaluating pure mathematical predictors reveals that our derivative-free Lagrange extrapolator maintains significantly lower L_{1} relative error across varying extrapolation intervals ( N ) than derivative-based solvers (Taylor, Hermite). While predicting the GD yields a smooth macro-trajectory ideal for forecasting (Fig. 2 (a)), it paradoxically amplifies the weakness of derivative-based methods. Like layer-wise micro-features, the GD’s higher-order temporal derivatives remain intrinsically chaotic. Applying derivative-based solvers like Taylor or Hermite to such noisy signals causes divergent predictions. Furthermore, finite-difference estimation of these derivatives across discrete steps introduces compounding approximation errors. To avoid this, we propose a derivative-free extrapolator inspired by Lagrange interpolation. Avoiding the standard O(N^{2}) formulation, we develop a barycentric prediction scheme caching and reusing weights. This reduces complexity to O(N) while eliminating derivative noise. As a purely mathematical predictor, our approach achieves significantly lower and more stable error across extrapolation intervals than prior solvers (Fig. 2 (c)). Even with a robust derivative-free formulation, polynomial extrapolation over uniform discrete time steps remains susceptible to Runge’s phenomenon. As shown in Fig. 1 (a), this numerical instability causes severe edge oscillations; ResilPhase is the first work to identify this as a critical bottleneck in diffusion acceleration. To address this, we introduce a plug-and-play Phase Mapping mechanism (Fig. 1 (b)). As the first theoretically grounded technique to remap the discrete temporal extrapolation domain, we bridge classical numerical analysis and diffusion acceleration by utilizing Chebyshev nodes to project linear time steps ( t ) into a bounded phase domain ( s ), achieving optimal stability for class-conditional generation. Furthermore, we propose a data-driven Balanced Mapping tailored to complex text-to-image and video tasks. By performing extrapolation within this bounded continuous space, our mappings effectively transform a divergent numerical issue into a highly stable prediction, strictly minimizing the mathematical upper bound of the extrapolation error. To summarize, our primary contributions are as follows: • We propose ODE-Aligned Macro-Trajectory Targeting. By forecasting the model’s Global Drift (GD) rather than layer-wise features, we strictly sever spatial cascading errors, align with the continuous diffusion ODE, and eliminate heavy memory overhead. • We introduce a noise-resilient, derivative-free Barycentric Lagrange extrapolator. This O(N) framework perfectly synergizes with the GD by completely bypassing the inherent noise and chaotic high-order derivatives of finite-difference approximations. • We design a plug-and-play Phase Mapping mechanism. By non-linearly projecting discrete time steps into a bounded phase space, it regularizes the extrapolation domain to suppress oscillatory error growth, strictly minimizing the polynomial extrapolation