PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers
Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie · 2026
Read PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers by Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01077.txt.
Description
Haopeng Li and co-authors speed up diffusion transformers with PISA, a sparse focus plan that keeps the whole view. Block-sparse focus drops weak blocks to save time, but that bites hard at high sparsity. PISA notes weak-block scores hold a steady shape, so it can guess them well with block-wise Taylor math, not junk them. Strong blocks get exact math, the rest get good guesses, giving near-full focus at less than square cost. Video and image tests show speed gains with top quality kept.
Catalog record
| CREATOR | Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52650 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01077