Fast Video Generation with Sliding Tile Attention

Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang · 2025

Read Fast Video Generation with Sliding Tile Attention by Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04507.txt.

Description

Peiyuan Zhang and co-authors speed up AI video making with a leaner form of attention, in a 2025 paper. Top video models build each frame by weighing all other points in the clip. That weighing step eats nearly all the run time: most of a sixteen-minute job for five seconds of video. The waste is plain, since most strong links sit near each point in space and time.

Their method, sliding tile attention, weighs only local blocks that glide across the clip. It works tile by tile, in a shape that fits graphics hardware well. The step runs several times faster than the best prior kernels. On a leading video model, total time fell by more than a quarter with no loss in quality, and a light retrain cut it far more. The code is public.

Catalog record

CREATORPeiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04507

Browse the full library · About the Tower of Babel