One Token per Highly Selective Frame: Towards Extreme Compression for Long Video Understanding
Zheyu Zhang, Ziqi Pang, Shixing Chen, Xiang Hao, Vimal Bhat, Yu-Xiong Wang · 2026
Read One Token per Highly Selective Frame: Towards Extreme Compression for Long Video Understanding by Zheyu Zhang, Ziqi Pang, Shixing Chen, Xiang Hao, Vimal Bhat, Yu-Xiong Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14149.txt.
Description
Zhang and five colleagues push long-video understanding toward one token per frame at the final language-model layer. Their learnable token-level compressor replaces heuristic pruning, letting the system digest two to four times more frames with better scores. A question-guided frame selector picks the frames most relevant to each query. Splitting long videos into short segments tames attention bias toward sequence ends, and the combined XComp model, tuned on just 2.5 percent of the usual fine-tuning data, lifts LVBench accuracy.
Catalog record
| CREATOR | Zheyu Zhang, Ziqi Pang, Shixing Chen, Xiang Hao, Vimal Bhat, Yu-Xiong Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70286 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14149