SparseSAM: Structured Sparsification of Activations in Segment Anything Models

Hoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan · 2026

Read SparseSAM: Structured Sparsification of Activations in Segment Anything Models by Hoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17633.txt.

Description

Hoai-Chau Tran and colleagues propose SparseSAM, a training-free frame accelerating attention and MLP layers while keeping token identity. Token merging cuts token length yet adds overhead and suffers quality drop under high compression, while sparse attention leaves the MLP dense. SparseSAM adds Stripe-Sort Attention, turning dense attention into static sparse patterns, plus a Residual-Consistency MLP routing only informative tokens through the MLP. Across four benchmarks it loses little accuracy at moderate density and slightly more at lower density, with twice faster inference and less memory.

Catalog record

CREATORHoai-Chau Tran, Chi H. Nguyen Duy M. H. Nguyen, Mathias Niepert, Fan Lai, Khoa D. Doan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52460
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17633

Browse the full library · About the Tower of Babel