STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection
Yaoteng Zhang, Qing Zhou, Junyu Gao, Qi Wangmycorrespondingauthor · 2026
Read STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection by Yaoteng Zhang, Qing Zhou, Junyu Gao, Qi Wangmycorrespondingauthor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20738.txt.
Introduction
Yaoteng Zhang and three colleagues present STAR-IOD, a framework for incremental object detection in remote sensing imagery. Imagery arrives as a continuous stream, and standard detectors forget old categories when learning new ones. Their method also faces scale variation within classes and missing labels that make old objects look like background. A subspace-decoupled topology distillation module aligns class relationships across scales, while pseudo-label refinement recovers missing old-class labels.
Catalog record
| CREATOR | Yaoteng Zhang, Qing Zhou, Junyu Gao, Qi Wangmycorrespondingauthor |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70824 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20738
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection Yaoteng Zhang, Qing Zhou, Junyu Gao, Qi Wangmycorrespondingauthor Abstract Remote sensing imagery typically arrives in the form of continuous data streams. Traditional detectors often forget previously learned categories when learning new ones; therefore, research on Remote Sensing Incremental Object Detection (RS-IOD) is of great significance. However, existing methods largely overlook the intra-class scale variations prevalent in remote sensing scenes, which undermines the effectiveness of knowledge transfer and old knowledge preservation. Moreover, RS-IOD also suffers from missing annotations, which cause the model to misclassify old-class instances as background. To address these challenges, we propose a novel framework, STAR-IOD. First, we introduce a Subspace-decoupled Topology Distillation (STD) module to transfer structural knowledge, explicitly aligning inter-class topological relationships and mitigating intra-class representation discrepancies induced by scale shifts. Furthermore, we introduce the Clustering-driven Pseudo-label Generator (CPG), a plug-and-play module that leverages K-Means clustering to dynamically identify class-specific thresholds, thereby guaranteeing an accurate distinction between true positive targets and background noise and alleviating the issue of missing annotations for old classes. We also constructed two Remote Sensing Incremental Object Detection datasets, DIOR-IOD and DOTA-IOD to facilitate research on RS-IOD. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches by 1.7% and 2.1% mAP on DIOR-IOD and DOTA-IOD, respectively, effectively alleviating catastrophic forgetting while preserving strong detection performance on both base and novel classes. The code and dataset are released at: https://github.com/zyt95579/STAR-IOD. keywords Incremental Object Detection,Catastrophic Forgetting ,Pseudo-label Generation ,Topology Distillation, † † titlenote: This work is supported by the National Natural Science Foundation of China under Grant 62471394, 62306241, and 62576284. † † corresponding: Corresponding author 1 Introduction Deep learning has achieved remarkable progress in remote sensing object detection ( 25 ; 60 ; 30 ; 52 ) , demonstrating strong potential in applications such as disaster monitoring, urban planning, and environmental protection. Conventional object detection paradigms ( 16 ; 9 ; 33 ; 57 ; 56 ) are typically predicated on the idealized assumption that training data follows a static distribution and is fully accessible in an offline setting. However, this premise stands in stark contrast to the open and dynamic nature of the real world, where data typically arrives sequentially in a continuous stream. When the model is updated on new tasks, conventional detection models tend to severely forget previously learned knowledge, a phenomenon known as catastrophic forgetting ( 54 ; 31 ; 6 ) . Figure 1: (a) Different scales of the ship in remote sensing images; (b) Different scales of the plane in remote sensing images; (c) t-SNE visualization of feature vectors in the feature space. To mitigate catastrophic forgetting, various Incremental Object Detection (IOD) methods ( 39 ; 22 ; 7 ; 18 ) have been proposed, which can be broadly categorized into three paradigms: knowledge distillation, replay, and architecture adaptation. Knowledge distillation ( 44 ; 28 ) aims to preserve historical knowledge by transferring responses or feature representations from a frozen teacher model to the student. In contrast, replay-based approaches ( 29 ; 35 ; 1 ; 11 ; 50 ) maintain a subset of old samples or synthesized instances and alleviate forgetting via joint training. Architecture adaptation methods ( 45 ; 46 ; 49 ; 40 ; 55 ) introduce task-specific modules or parameter isolation mechanisms to accommodate new knowledge while preserving previously learned representations. These approaches have achieved promising performance on IOD involving natural images. However, unlike natural images, objects in remote sensing imagery typically exhibit highly challenging multi-scale characteristics. Specifically, remote sensing images are acquired from high-altitude platforms, where the spatial resolution varies with sensor altitude and imaging angles. Moreover, objects of the same category can differ significantly in their intrinsic physical sizes, as illustrated in Fig. 1 (a, b). Such intra-class scale variation makes it difficult for feature representations to form compact clusters in the feature space; instead, they exhibit pronounced scale dependency, as shown in Fig. 1 (c). This scale-dependent feature distribution reflects an inherent characteristic of remote sensing targets. Given this scale-dependent feature distribution, directly applying distillation or feature alignment strategies tends to indiscriminately compress scale-variant features into a unified representation. This indiscriminate feature compression not only overlooks the inherent intra-class scale diversity but also risks blurring inter-class boundaries and disrupting the inter-class topological structure. Consequently, it ultimately hinders the model’s ability to balance old knowledge retention and new knowledge acquisition in RS-IOD. Another critical challenge in RS-IOD stems from missing annotations ( 19 ; 6 ; 32 ; 34 ) . In IOD settings, annotations are provided exclusively for newly introduced classes, causing instances of previously learned classes within new data to be treated as background. This foreground–background ambiguity introduces erroneous supervisory signals, suppressing old-class features and accelerating catastrophic forgetting. Pseudo-labeling methods ( 28 ; 3 ; 43 ) are commonly employed to recover missing annotations for old classes; however, their effectiveness in RS-IOD remains underexplored. In remote sensing scenarios, affected by complex backgrounds, dense object distributions, and frequent occlusions, pseudo-labels inevitably contain substantial noise, which significantly reduces the reliability of pseudo-supervision. These noisy pseudo-labels introduce erroneous supervisory signals that interfere with feature representation learning and are further amplified during the distillation process, thereby exacerbating the forgetting of previously learned classes. Furthermore, RS-IOD still suffers from the absence of standardized datasets and unified evaluation protocols, severely hindering fair comparisons among existing methods and restricting further investigation into this challenging problem. To address the challenges of intra-class scale variations and noisy pseudo-labels , we propose a novel Remote Sensing Incremental Object Detection framework, named STAR-IOD. STAR-IOD introduces a Subspace-Decoupling Topological Distillation (STD) module to enforce structured knowledge alignment between the teacher and student models. Specifically, STD employs Scale-adaptive Instance Partitioning (SIP) to divide object instances into small-, medium-, and large-scale subspaces according to their bounding box areas. Operating on the decoder output features, STD constructs inter-class topological matrices within each scale-specific subspace and aligns the student inter-class topology with that of the teacher model. This design effectively alleviates cross-scale feature interference caused by scale variations in remote sensing imagery, enabling the student model to preserve stable and discriminative old-class relational knowledge during incremental learning. Second, to mitigate the adverse impact of noisy pseudo-labels in remote sensing scenarios, STAR-IOD integrates a Clustering-driven Pseudo-label Generator (CPG) to distinguish reliable pseudo-labels from noisy ones, thereby effectively reducing the bias introduced by noisy supervision during model optimization. Specifically, CPG reformulates confidence threshold estimation as a clustering problem and applies the K-Means algorithm to perform binary clustering in the confidence space, dynamically determining an adaptive decision boundary. Furthermore, to bridge the gap in datasets and evaluation benchmarks for RS-IOD, we construct two dedicated datasets and design standardized incremental splitting strategies along with unified evaluation pipelines. These efforts establish a reproducible experimental foundation, which we hope will serve as a valuable benchmark for future research in this field. The main contributions of this work are summarized as follows: (1) We introduce Subspace-decoupled Topology Distillation, which mitigates biased knowledge transfer induced by intra-class scale variations by aligning inter-class topological structures within explicitly decoupled scale-adaptive subspaces. (2) We develop a Clustering-driven Pseudo-label Generator that estimates adaptive confidence thresholds via clustering, effectively mitigating noise interference from unreliable pseudo-labels. (3)