What Kind of Visual Tokens Do We Need? Training-free Visual Token Pruning for Multi-modal Large Language Models from the Perspective of Graph
Yutao Jiang, Qiong Wu, Wenhao Lin, Wei Yu, Yiyi Zhou · 2025
Read What Kind of Visual Tokens Do We Need? Training-free Visual Token Pruning for Multi-modal Large Language Models from the Perspective of Graph by Yutao Jiang, Qiong Wu, Wenhao Lin, Wei Yu, Yiyi Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02268.txt.
Description
Chatbots that view images turn each image into many tokens, and most of those tokens waste computing. Yutao Jiang and co-authors prune the waste in this 2025 paper. Their check found that both subject tokens and background tokens matter, since some questions hinge on the scene's backdrop. Cutting only by local importance can throw away context the model needs.
Their method, G-Prune, needs no retraining. It treats tokens as nodes in a graph, linked by how alike their meanings are. Importance then flows along the links until the tokens settle into a ranking. The top tokens, front or back, are kept for the model. Tests on a recent large model showed the pruning held quality while cutting cost. Leaner vision input can make image chat faster and cheaper.
Catalog record
| CREATOR | Yutao Jiang, Qiong Wu, Wenhao Lin, Wei Yu, Yiyi Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02268