Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning
Jialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu · 2025
Read Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning by Jialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08003.txt.
Description
Jialong Qin and colleagues present SharpV, a pruning method that makes video language models cheaper and more reliable. Such models process huge numbers of visual tokens, so computation and memory grow very fast with video length. Uniform compression wastes effort on frames and regions that carry little new information.
SharpV adjusts pruning rates by spatial and temporal information content, sometimes even beating unpruned models. A second stage removes degraded cache features by comparing them with original features in a self calibrating way. Tests on public benchmarks show strong gains, and the method works without exposed attention scores, keeping compatibility with Flash Attention.
Catalog record
| CREATOR | Jialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08003