Language-Guided Temporal Token Pruning for Efficient VideoLLM Processing

Yogesh Kumar · 2025

Read Language-Guided Temporal Token Pruning for Efficient VideoLLM Processing by Yogesh Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17686.txt.

Description

Video-capable language models chew through huge numbers of image tokens, and long videos make the cost grow fast. Yogesh Kumar proposes a pruning method that lets the words of the user's question steer which tokens survive. Segments that the question points to keep a dense set of tokens, while less relevant stretches are thinned. The approach is not tied to one model and plugs into existing systems such as TimeChat and LLaVA-Video.

In tests, the method cut computing cost by about 65 percent while keeping 97 to 99 percent of the original scores. On the QVHighlights set it raised the top-hit score by 9.5 points, and on Charades-STA it kept 99.6 percent of the top-score result. Gains were largest on questions with clear time markers, such as asking when an event happens. The author argues that question-guided pruning is a practical route to longer, cheaper video understanding.

Catalog record

CREATORYogesh Kumar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17686

Browse the full library · About the Tower of Babel