Language-Guided Temporal Token Pruning for Efficient VideoLLM Processing
Yogesh Kumar · 2025
Read Language-Guided Temporal Token Pruning for Efficient VideoLLM Processing by Yogesh Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17686.txt.
Description
Video-capable language models chew through huge numbers of image tokens, and long videos make the cost grow fast. Yogesh Kumar proposes a pruning method that lets the words of the user's question steer which tokens survive. Segments that the question points to keep a dense set of tokens, while less relevant stretches are thinned. The approach is not tied to one model and plugs into existing systems such as TimeChat and LLaVA-Video.
In tests, the method cut computing cost by about 65 percent while keeping 97 to 99 percent of the original scores. On the QVHighlights set it raised the top-hit score by 9.5 points, and on Charades-STA it kept 99.6 percent of the top-score result. Gains were largest on questions with clear time markers, such as asking when an event happens. The author argues that question-guided pruning is a practical route to longer, cheaper video understanding.
Catalog record
| CREATOR | Yogesh Kumar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-17686