Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning

Jialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu · 2025

Read Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning by Jialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08003.txt.

Description

Jialong Qin and colleagues present SharpV, a pruning method that makes video language models cheaper and more reliable. Such models process huge numbers of visual tokens, so computation and memory grow very fast with video length. Uniform compression wastes effort on frames and regions that carry little new information.

SharpV adjusts pruning rates by spatial and temporal information content, sometimes even beating unpruned models. A second stage removes degraded cache features by comparing them with original features in a self calibrating way. Tests on public benchmarks show strong gains, and the method works without exposed attention scores, keeping compatibility with Flash Attention.

Catalog record

CREATORJialong Qin, Xin Zou, Di Lu, Yibo Yan, Xuming hu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08003

Browse the full library · About the Tower of Babel