Video Patch Pruning: Efficient Video Instance Segmentation via Early Token Reduction
Patrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn · 2026
Read Video Patch Pruning: Efficient Video Instance Segmentation via Early Token Reduction by Patrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00827.txt.
Description
Glandorf, Norrenbrock, and Rosenhahn present Video Patch Pruning, a framework that brings token reduction into the early layers of vision transformers for video instance segmentation. A differentiable temporal-mapping module picks the most relevant patches early, guided by the foreground selectivity of deeper features. The method cuts patches by up to 60 percent in dense prediction tasks and holds performance below 55 percent patch usage. Its largest drop is 0.6 percent on YouTube-VIS 2021.
Catalog record
| CREATOR | Patrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37210 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00827