Local2Global query Alignment for Video Instance Segmentation

Rajat Koner, Zhipeng Wang, Srinivas Parthasarathy, Chinghang Chen · 2025

Read Local2Global query Alignment for Video Instance Segmentation by Rajat Koner, Zhipeng Wang, Srinivas Parthasarathy, Chinghang Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20120.txt.

Description

Rajat Koner and co-authors present, in twenty twenty-five, Local2Global, an online method for video instance segmentation, picking out and tracking each object in video. Online methods suit long sequences and gradual change, but predictions drift with noise, occlusions, and scene cuts. Their framework builds on query propagation, where learned queries follow objects across frames. It adds two query types: local queries that capture each frame's fresh object features, and global queries that hold past space-time context.

A lightweight transformer decoder, the L2G-aligner, aligns local and global queries early. The model thus uses the current frame while keeping temporal consistency, with smooth transitions. No extra heuristics or memory modules are needed. Tests across segmentation benchmarks show state-of-the-art results with a simple baseline, they report.

Catalog record

CREATORRajat Koner, Zhipeng Wang, Srinivas Parthasarathy, Chinghang Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20120

Browse the full library · About the Tower of Babel