AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference
Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir · 2026
Read AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference by Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29535.txt.
Description
Yilin Feng, Ahmed Burak Gulhan, and Mahmut Taylan Kandemir propose AsymVLM, a pruning method treating vision and text tokens differently at inference. Vision tokens are spatially redundant and flood early computation, while text tokens depend on prior words and pile up during decoding. AsymVLM prunes vision tokens aggressively before the first pass with a learned scorer and per-sample budget. It evicts text tokens only past a fixed limit with a time-based threshold, saving up to 54% of compute while leading on document and chart tasks.
Catalog record
| CREATOR | Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39142 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29535