AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference

Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir · 2026

Read AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference by Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29535.txt.

Description

Yilin Feng, Ahmed Burak Gulhan, and Mahmut Taylan Kandemir propose AsymVLM, a pruning method treating vision and text tokens differently at inference. Vision tokens are spatially redundant and flood early computation, while text tokens depend on prior words and pile up during decoding. AsymVLM prunes vision tokens aggressively before the first pass with a learned scorer and per-sample budget. It evicts text tokens only past a fixed limit with a time-based threshold, saving up to 54% of compute while leading on document and chart tasks.

Catalog record

CREATORYilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39142
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29535

Browse the full library · About the Tower of Babel