SparseSAM: Structured Sparsification of Activations in Segment Anything Models
Hoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan · 2026
Read SparseSAM: Structured Sparsification of Activations in Segment Anything Models by Hoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17633.txt.
Description
Hoai-Chau Tran and colleagues propose SparseSAM, a training-free frame accelerating attention and MLP layers while keeping token identity. Token merging cuts token length yet adds overhead and suffers quality drop under high compression, while sparse attention leaves the MLP dense. SparseSAM adds Stripe-Sort Attention, turning dense attention into static sparse patterns, plus a Residual-Consistency MLP routing only informative tokens through the MLP. Across four benchmarks it loses little accuracy at moderate density and slightly more at lower density, with twice faster inference and less memory.
Catalog record
| CREATOR | Hoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52460 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17633