PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers

Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie · 2026

Read PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers by Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01077.txt.

Description

Haopeng Li and co-authors speed up diffusion transformers with PISA, a sparse focus plan that keeps the whole view. Block-sparse focus drops weak blocks to save time, but that bites hard at high sparsity. PISA notes weak-block scores hold a steady shape, so it can guess them well with block-wise Taylor math, not junk them. Strong blocks get exact math, the rest get good guesses, giving near-full focus at less than square cost. Video and image tests show speed gains with top quality kept.

Catalog record

CREATORHaopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52650
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01077

Browse the full library · About the Tower of Babel