CroBIM-V: Memory-Quality Controlled Remote Sensing Referring Video Object Segmentation

Haochen Jiang, Yuzhe Sun, Zhe Dong, Tianzhu Liu, and Yanfeng Gu · 2026

Read CroBIM-V: Memory-Quality Controlled Remote Sensing Referring Video Object Segmentation by Haochen Jiang, Yuzhe Sun, Zhe Dong, Tianzhu Liu, and Yanfeng Gu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12076.txt.

Introduction

Haochen Jiang, Yuzhe Sun, Zhe Dong, Tianzhu Liu, and Yanfeng Gu track objects named in text in remote sensing video. The task joins video segmentation with a text brief for the target. Far views make targets faint, and dynamic scenes often cut off key views.

Their tool, named in the work, controls memory quality as it tracks. Good memory keeps the target's traits clear across frames. Weak memory lets drift and clutter spoil the cut. The work aims for steadier cuts in hard aerial video. Good tracks help watch coasts, fields, and roads from air.

Catalog record

CREATORHaochen Jiang, Yuzhe Sun, Zhe Dong, Tianzhu Liu, and Yanfeng Gu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12076

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CroBIM-V: Memory-Quality Controlled Remote Sensing Referring Video Object Segmentation Haochen Jiang, Yuzhe Sun, Zhe Dong, Tianzhu Liu, and Yanfeng Gu Abstract Remote sensing video referring object segmentation (RS-RVOS) is challenged by weak target saliency and severe visual information truncation in dynamic scenes, making it extremely difficult to maintain discriminative target representations during segmentation. Moreover, progress in this field is hindered by the absence of large-scale dedicated benchmarks, while existing models are often affected by biased initial memory construction that impairs accurate instance localization in complex scenarios, as well as indiscriminate memory accumulation that encodes noise from occlusions or misclassifications, leading to persistent error propagation. This paper advances RS-RVOS research through dual contributions in data and methodology. First, we construct RS-RVOS Bench, the first large-scale benchmark comprising 111 video sequences, about 25,000 frames, and 213,000 temporal referring annotations. Unlike common RVOS benchmarks where many expressions are written with access to the full video context, our dataset adopts a strict causality-aware annotation strategy in which linguistic references are generated solely from the target state in the initial frame. Second, we propose a memory-quality-aware online referring segmentation framework, termed Memory Quality Control with Segment Anything Model (MQC-SAM). MQC-SAM introduces a temporal motion consistency module for initial memory calibration, leveraging short-term motion trajectory priors to correct structural deviations and establish accurate memory anchoring. Furthermore, it incorporates a decoupled attention-based memory integration mechanism with dynamic quality assessment, selectively updating high-confidence semantic features while filtering unreliable information, thereby effectively preventing error accumulation and propagation. Extensive experiments on RS-RVOS Bench demonstrate that MQC-SAM achieves state-of-the-art performance. I Introduction Remote sensing video has become increasingly important in applications such as earth observation, disaster monitoring, and traffic management [ 14 , 47 , 45 ] . Referring video object segmentation (RVOS), which bridges natural language and visual understanding, holds significant potential for intelligent interpretation of remote sensing imagery [ 34 , 15 , 39 , 1 ] . However, due to limitations in computational resources and communication bandwidth, remote sensing video analysis is increasingly adopting an online processing paradigm [ 12 ] . Under this setting, segmentation decisions must be made frame by frame during observation, rather than after the complete video sequence has been acquired. As summarized in Fig. 1 , this online constraint fundamentally reshapes how text prompts are formulated, how targets are tracked, and how errors accumulate over time in remote sensing RVOS [ 38 ] . Fig. 1: Key differences between natural-scene RVOS and RS-RVOS. (a) Natural videos benefit from strong temporal action cues. (b) Remote-sensing RVOS relies on initial anchoring and memory propagation under online causality. (c) Errors can accumulate over time, causing drift. The online paradigm imposes strict causality constraints: at any time, the system can access only the current frame and past information, without recourse to future-frame context. This constraint directly governs the formulation of text prompts. In online scenarios, text descriptions can only be generated at the initial observation stage and must remain fixed throughout subsequent inference [ 38 , 12 ] . In contrast, existing RVOS benchmarks are largely constructed on natural-scene videos, where many expressions are written with access to the full video context, and only a subset provides first-frame expressions [ 34 , 15 ] . However, in the remote sensing domain, a dedicated RVOS benchmark with first-frame-only referring annotations has not yet been systematically established, which limits the development of RS-RVOS methods. A closer examination reveals a key difference in what can be reliably inferred from the initial frame in natural scenes versus remote sensing scenarios. In many natural-scene videos, the target’s action or state is often observable or strongly suggested even from the initial frame, allowing referring expressions to include dynamic cues for identity specification [ 9 ] . In remote sensing scenarios, however, this assumption often does not hold. Owing to top-down viewpoints, small target sizes, and limited imaging resolution, individual frames in remote sensing videos rarely provide reliable cues about a target’s specific behavior or motion state [ 45 , 47 ] . At the initial observation moment, the system cannot predict future trajectories, nor can it reliably infer the target’s ongoing activity from a single frame. In this work, we focus on remote sensing videos where targets exhibit discernible temporal motion patterns, for which motion can serve as an additional verification cue [ 45 ] . Consequently, remote sensing prompts should primarily describe spatial location and category attributes for initial identity anchoring, rather than persistent action semantics [ 34 ] . This paradigm shift has important implications. As illustrated in Fig. 1 (b), directly applying existing RVOS pipelines that repeatedly inject or enforce text semantics across time in online remote sensing scenarios introduces semantic inconsistencies when the target moves away from its initially described location, as location-dependent phrases become invalid and may misguide cross-modal alignment [ 39 , 1 ] . Meanwhile, even when text is restricted to first-frame identity anchoring, accurately establishing an initial memory anchor remains highly challenging in remote sensing videos. The target often appears small and visually subtle against complex backgrounds [ 45 , 47 ] . Such biased or noisy initialization can severely compromise subsequent tracking and segmentation. As illustrated in Fig. 1 (c), early ambiguities and low-quality predictions cannot be retrospectively corrected using future context. Once such unreliable outputs are written into the memory bank, they contaminate the stored representations and subsequently misguide later-frame inference, resulting in persistent error propagation over time [ 28 , 5 , 4 ] . However, many existing memory-based pipelines update memory with predicted masks/features without reliable quality estimation or explicit mechanisms to reject corrupted updates [ 28 , 4 , 44 ] . This motivates the need for robust memory error-correction and quality-control mechanisms in online RS-RVOS. To address these challenges, we propose a two-stage memory management framework tailored for online remote sensing RVOS. This framework addresses initial memory quality and long-term maintenance through two key insights. First, we identify motion as an orthogonal verification signal; since real moving targets and static distractors exhibit distinct temporal motion patterns, this provides a semantic-independent verification dimension [ 45 ] . Accordingly, we design a Temporal Motion-Consistency Initial Memory Calibration module that utilizes adaptive time windows and a motion-semantic dual verification mechanism to refine initial segmentation and suppress noise, providing a high-quality starting point for sequence tracking. Second, we tackle multi-dimensional challenges via decoupled memory management. Given the orthogonal demands of identity consistency, appearance adaptability, and discriminative power, we introduce a Decoupled Attention Memory Integration mechanism [ 44 , 43 ] . This decomposes memory management into three functional dimensions: Cross-modal Semantic Alignment Attention for fixed identity anchoring via fused text and motion priors [ 34 , 39 ] ; Short-term Spatiotemporal Evolution Attention for capturing target dynamics through sliding windows with occlusion-aware gating [ 5 , 4 ] ; and Discriminative Error-correction Attention for storing prototypes from high-confusion scenes to prevent false storage [ 28 , 44 ] . These dimensions maintain independent feature manifolds and collaborate via dedicated attention mechanisms to ensure representation reliability across long sequences. To facilitate research into causality-aware RVOS, we present the RS-RVOS Bench dataset. Diverging from the global annotation paradigm, RS-RVOS Bench employs a frame-specific spatial-semantic generation

Read the complete text