How Many Visual Tokens Do Multimodal Language Models Need? Scaling Visual Token Pruning with F 3 A
Yijie Huang, Yiqun Zhang, Zhuoyue Jia, Xiaocui Yang, Junzhao Huang, Zihan Wang, Shi Feng, Daling Wang, Yifei Zhang, Yongkang Liu · 2026
Read How Many Visual Tokens Do Multimodal Language Models Need? Scaling Visual Token Pruning with F 3 A by Yijie Huang, Yiqun Zhang, Zhuoyue Jia, Xiaocui Yang, Junzhao Huang, Zihan Wang, Shi Feng, Daling Wang, Yifei Zhang, Yongkang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16359.txt.
Description
Huang and nine colleagues ask how much picture evidence vision-language models really need when the token allowance is fixed. They recast pruning as a search for task-relevant evidence. Their F^3A works before the language model sees picture tokens. It forms cues from the question, pairs them with grid tokens via frozen sparse sensing heads, and spends the allowance in locating, refining, and recovery stages. No training or extra language-model pass is needed, and the usual prompting and decoding setup stays intact.
Catalog record
| CREATOR | Yijie Huang, Yiqun Zhang, Zhuoyue Jia, Xiaocui Yang, Junzhao Huang, Zihan Wang, Shi Feng, Daling Wang, Yifei Zhang, Yongkang Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64897 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16359