Video Patch Pruning: Efficient Video Instance Segmentation via Early Token Reduction

Patrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn · 2026

Read Video Patch Pruning: Efficient Video Instance Segmentation via Early Token Reduction by Patrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00827.txt.

Description

Glandorf, Norrenbrock, and Rosenhahn present Video Patch Pruning, a framework that brings token reduction into the early layers of vision transformers for video instance segmentation. A differentiable temporal-mapping module picks the most relevant patches early, guided by the foreground selectivity of deeper features. The method cuts patches by up to 60 percent in dense prediction tasks and holds performance below 55 percent patch usage. Its largest drop is 0.6 percent on YouTube-VIS 2021.

Catalog record

CREATORPatrick Glandorf, Thomas Norrenbrock, Bodo Rosenhahn
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37210
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.00827

Browse the full library · About the Tower of Babel