Training-free and Adaptive Sparse Attention for Efficient Long Video Generation
Yifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui · 2025
Read Training-free and Adaptive Sparse Attention for Efficient Long Video Generation by Yifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21079.txt.
Description
Long videos are the expensive frontier of AI generation. A single eight-second clip can demand hundreds of petaflops of attention computation. Yifei Xia and co-authors present AdaSpa, a sparse attention method that skips most of that work without any retraining. Its first idea is a block pattern. The pattern mirrors the layered sparsity the team found inside video diffusion transformers.
The second idea searches for the right sparse pattern online, head by head. It exploits the fact that the pattern stays fixed across the denoising steps, even as it changes with input and layer. The method plugs into existing models with no fine-tuning and no dataset profiling. Experiments across several models show large speedups with video quality preserved. The authors offer AdaSpa as a general accelerator for the current generation of video models.
Catalog record
| CREATOR | Yifei Xia, Suhan Ling, Fangcheng Fu, Yujie Wang, Huixia Li, Xuefeng Xiao, Bin Cui |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-21079