Training-free and Adaptive Sparse Attention for Efficient Long Video Generation

Yifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui · 2025

Read Training-free and Adaptive Sparse Attention for Efficient Long Video Generation by Yifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21079.txt.

Description

Long videos are the expensive frontier of AI generation. A single eight-second clip can demand hundreds of petaflops of attention computation. Yifei Xia and co-authors present AdaSpa, a sparse attention method that skips most of that work without any retraining. Its first idea is a block pattern. The pattern mirrors the layered sparsity the team found inside video diffusion transformers.

The second idea searches for the right sparse pattern online, head by head. It exploits the fact that the pattern stays fixed across the denoising steps, even as it changes with input and layer. The method plugs into existing models with no fine-tuning and no dataset profiling. Experiments across several models show large speedups with video quality preserved. The authors offer AdaSpa as a general accelerator for the current generation of video models.

Catalog record

CREATORYifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-21079

Browse the full library · About the Tower of Babel