DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution

Hidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh, Pinar Yanardag, Jinrong Xie · 2026

Read DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution by Hidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh, Pinar Yanardag, Jinrong Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30431.txt.

Introduction

Hidir Yesiltepe and six co-authors present DTG-Restore, a training-free way to fix warped videos with video diffusion models. Their Decoupled Time Guidance (DTG) runs the unconditional branch at a cleaner diffusion step, keeping shapes while blocking warped copies. The method lifts perceptual coherence and restores plausible shapes in AI-made and real videos. They also build GenWarp480, a test set of 4,400 warped 480p clips from diverse text-to-video models. Tests show big gains in shape fidelity and time stability.

Catalog record

CREATORHidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh, Pinar Yanardag, Jinrong Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35921
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30431

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution Hidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh, Pinar Yanardag, Jinrong Xie Abstract Recent progress in video diffusion models has enabled remarkable generative fidelity, yet leveraging these priors for restoration remains limited by the strong coupling between conditional and unconditional branches in standard classifier-free guidance. We introduce a training-free framework that enhances distorted and low-resolution videos by decoupling these signals in time. Our proposed Decoupled Time Guidance (DTG) evaluates the unconditional branch at a cleaner diffusion timestep, providing a lookahead prior that preserves geometry while suppressing replication of warped content. This temporal bias is annealed throughout sampling, allowing the model to transition from structure correction to detail refinement without retraining. Combined with any off-the-shelf restoration module in a plug-and-play manner, our approach improves perceptual coherence and restores plausible structure in AI-generated and real-world videos alike. To facilitate evaluation, we curate GenWarp480 , a benchmark of 4,400 distorted 480p videos synthesized from diverse text-to-video models. GenWarp480 focuses on characteristic generative degradations such as warped faces, body misalignments, and spatial artifacts, providing a purpose-built testbed for assessing robustness to generative errors. Extensive experiments demonstrate that our method achieves significant improvements in structural fidelity and temporal stability without any model training. † † footnotetext: † Equal supervision 1 Introduction Recent advances in large video diffusion transformers 39 ; 23 ; 22 ; 27 have brought unprecedented generative quality to text-to-video synthesis. By modeling joint spatial–temporal correlations through attention across both dimensions, these models can produce videos with coherent motion 42 ; 25 , fine textures 8 ; 9 , and diverse content 41 ; 48 ; 40 ; 43 guided purely by textual input. Their scalability and learned priors make them powerful engines for video generation and editing. Yet, when such generative priors are applied to the task of restoration or super-resolution, they often expose a critical limitation: the tendency to replicate distorted evidence from the input rather than reconstructing underlying structure. In degraded or AI-generated footage, this behavior manifests as warped geometry, stretched motion, and temporally inconsistent details. Conventional video super-resolution (VSR) methods 3 ; 4 ; 19 ; 11 rely on synthetic degradation pipelines and deterministic reconstruction losses. While effective on controlled benchmarks, they fail to generalize to real-world or generative content where degradations are complex and non-stationary. These models often sharpen artifacts rather than removing them, producing results that look crisp frame-wise but inconsistent across time. Diffusion-based VSR frameworks 13 ; 49 ; 46 ; 38 introduce powerful generative priors, yet the standard denoising formulation couples conditional and unconditional branches at the same timestep, forcing the model to remain overly faithful to corrupted low-resolution inputs. This coupling limits the ability of diffusion models to hallucinate plausible structure while maintaining temporal stability. Several recent works have sought to overcome these limitations by refining temporal modeling or expanding the generative backbone. Upscale-A-Video 49 enforces local and global temporal consistency through diffusion-based latent propagation, while VEnhancer 13 unifies spatial and temporal upsampling within a single diffusion transformer. STAR 37 incorporates local enhancement and frequency-aware losses to improve fidelity in real-world settings, and SeedVR2 31 accelerates restoration to a single sampling step using adversarial post-training. Despite their strong performance, these methods require extensive fine-tuning of large diffusion backbones and remain tied to specific training configurations, making them less flexible for arbitrary degradations or unseen content. In this work, we present a training-free and model-agnostic framework for generative video super-resolution that operates entirely at inference time. Our key idea is to decouple the temporal evaluation of conditional and unconditional guidance within the diffusion sampling process. By querying the unconditional branch at a cleaner timestep closer to the data manifold and the conditional branch at the current timestep, the model receives a lookahead prior that discourages replication of spurious geometry while remaining anchored to the observed content. This simple temporal offset, which we term Decoupled Time Guidance (DTG), progressively transitions the denoising process from structure correction to detail refinement, implicitly increasing the effective signal-to-noise ratio and stabilizing both geometry and appearance across frames. After this geometry-preserving refinement, any off-the-shelf restoration or super-resolution module can be attached to further enhance high-frequency details. This plug-and-play composition preserves the structural corrections introduced by DTG while allowing specialized networks to focus solely on texture recovery. Together, these components form a practical pipeline that unifies generative reasoning with restoration fidelity, without retraining or architectural modification. Our contributions are summarized as follows: • We propose Decoupled Time Guidance (DTG), a training-free modification to the diffusion sampling process that decouples conditional and unconditional denoising in time to preserve geometric integrity. • We provide a theoretical interpretation showing that DTG implicitly adjusts the effective signal-to-noise ratio, yielding a cleaner, more stable diffusion trajectory. • We demonstrate that DTG serves as a plug-and-play module applicable to any pretrained video diffusion transformer and can be followed by arbitrary restoration or super-resolution networks for high-frequency enhancement. • Extensive experiments show that DTG improves structural fidelity, temporal consistency, and perceptual realism over recent diffusion-based video restoration approaches 13 ; 49 ; 31 ; 37 , while remaining computationally lightweight and fully model-agnostic. 2 Related Work Text-to-Video Generation. Recent progress in text-to-video (T2V) diffusion has been propelled by large-scale datasets and advances in diffusion transformer architectures. Early approaches adapted pre-trained image diffusion models by inserting temporal layers and fine-tuning them jointly on video data 7 ; 26 ; 33 ; 1 ; 45 ; 36 ; 16 , often balancing between preserving spatial priors and learning temporal coherence. The emergence of Diffusion Transformers (DiT) 27 has since marked a paradigm shift, offering improved scalability and generative quality over 3D U-Nets, and now serves as the backbone for most state-of-the-art video diffusion frameworks 39 ; 23 ; 22 . Despite these advances, direct generation of high-resolution videos remains computationally expensive and limited by the availability of large, high-resolution video-text datasets. Consequently, modern T2V systems often adopt a cascaded design 35 ; 46 ; 12 , where a base model first synthesizes low-resolution videos, followed by a refinement or super-resolution module that enhances spatial fidelity via a noise-guided reconstruction process 24 . While effective, this pipeline requires holistic clip-level processing, incurring high memory cost and slow inference, which restricts scalability and real-world deployment. Generative Video Super-Resolution. Video super-resolution (VSR) aims to reconstruct high-resolution (HR) frames from low-resolution (LR) inputs, restoring fine spatial details and temporal coherence. Conventional CNN- and Transformer-based architectures 3 ; 4 ; 34 ; 15 ; 21 ; 29 ; 11 largely depend on synthetic degradations and lack strong generative priors, which often leads to over-smoothing and suboptimal realism. To overcome this, diffusion-based generative VSR models have gained traction by leveraging pre-trained image and video diffusion priors. For instance, Upscale-A-Video 49 introduces a latent diffusion framework with local-global temporal consistency mechanisms, achieving superior realism and temporal stability across both real-world and AI-generated videos. Similarly, VEnhancer 13 unifies spatial and temporal upsampling within a single diffusion model, using a video ControlNet and space-time augmentation to simultaneously enhance resolution and reduce flickering. These diffusion-based methods mark a transition from reconstruction-based restoration to generative enhancement, where perceptual quality, fidelity, and temporal coherence are jointly optimized. Generative Video Restoration. While traditional VSR

Read the complete text