Fast Video Generation with Sliding Tile Attention
Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang · 2025
Read Fast Video Generation with Sliding Tile Attention by Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04507.txt.
Description
Peiyuan Zhang and co-authors speed up AI video making with a leaner form of attention, in a 2025 paper. Top video models build each frame by weighing all other points in the clip. That weighing step eats nearly all the run time: most of a sixteen-minute job for five seconds of video. The waste is plain, since most strong links sit near each point in space and time.
Their method, sliding tile attention, weighs only local blocks that glide across the clip. It works tile by tile, in a shape that fits graphics hardware well. The step runs several times faster than the best prior kernels. On a leading video model, total time fell by more than a quarter with no loss in quality, and a light retrain cut it far more. The code is public.
Catalog record
| CREATOR | Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04507