Lightweight SAR Ship Detection via Contrastive Distillation Conference: Great Lakes Symposium on VLSI 2026; June 22–24, 2026; Finger Lakes, NY, USA Great Lakes Symposium on VLSI 2026 (GLSVLSI ’26), June 22–24, 2026, Canandaigua, NY, USA CCS: Computing methodologies Computer vision problems
Surendar Devasundaram, Banafsheh Saber Latibari, Abhijit Mahalanobis · 2026
Read Lightweight SAR Ship Detection via Contrastive Distillation Conference: Great Lakes Symposium on VLSI 2026; June 22–24, 2026; Finger Lakes, NY, USA Great Lakes Symposium on VLSI 2026 (GLSVLSI ’26), June 22–24, 2026, Canandaigua, NY, USA CCS: Computing methodologies Computer vision problems by Surendar Devasundaram, Banafsheh Saber Latibari, Abhijit Mahalanobis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30380.txt.
Introduction
Surendar Devasundaram, Banafsheh Saber Latibari and Abhijit Mahalanobis propose SURGE, a way to teach a small ship-spotting model from a big teacher model for SAR images. It passes shape links from teacher to student with an InfoNCE goal in a shared space. The method works with two-stage, one-stage, and transformer models, with no change to how they run. Tests on the SSDD and HRSID sets show big gains for two-stage models, up to about six mAP points and eight AP75 points over the base student.
Catalog record
| CREATOR | Surendar Devasundaram, Banafsheh Saber Latibari, Abhijit Mahalanobis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28755 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30380
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lightweight SAR Ship Detection via Contrastive Distillation Conference: Great Lakes Symposium on VLSI 2026; June 22–24, 2026; Finger Lakes, NY, USA Great Lakes Symposium on VLSI 2026 (GLSVLSI ’26), June 22–24, 2026, Canandaigua, NY, USA CCS: Computing methodologies Computer vision problems Surendar Devasundaram, Banafsheh Saber Latibari, Abhijit Mahalanobis Abstract . Deep convolutional and transformer-based detectors achieve strong performance for SAR ship detection but are often computationally prohibitive for real-time or onboard deployment. Lightweight models offer improved efficiency yet struggle to capture the complex structural relationships inherent in SAR backscatter. Most existing SAR knowledge-distillation approaches rely on feature or logit matching, which enforces localized activation similarity while neglecting the geometric relationships among object representations. We propose a S tructured U nified R elational knowled GE distillation framework for SAR Ship detection (SURGE) that transfers relational geometry from a powerful teacher detector to a compact student detector using a contrastive InfoNCE objective in a shared projection embedding space. To the best of our knowledge, this work presents the first transformer-based SAR ship detector knowledge distillation framework in SAR domain. The framework is architecture-agnostic in the sense that it provides a common region-level distillation interface for two-stage, one-stage and transformer-based detectors without modifying their deployed architectures. Experiments on the SSDD and HRSID benchmarks demonstrate that the proposed method yields substantial improvements for two-stage detectors, achieving up to 6.2 mAP and 8.0 AP 75 gains over baseline student and even surpassing teacher performance. † † cc-license: by 1. Introduction Synthetic Aperture Radar (SAR) imaging enables robust object detection under adverse weather and illumination conditions, making it indispensable for maritime surveillance, disaster management, and defense applications. Unlike optical imagery, SAR captures backscattering responses from surface structures, providing critical geometric and material information even through clouds and darkness ( 12 ) . However, the strong speckle noise, complex scattering mechanisms, and fine structural variations of SAR scenes pose unique challenges for deep object detectors ( 24 ) . High-capacity convolutional and transformer-based detectors such as Faster R- CNN ( 5 ) , RetinaNet ( 10 ) , and DETR ( 1 ) achieve strong detection accuracy, and their adaptation to SAR data has yielded high-performing but computationally expensive models ( 9 ; 4 ; 3 ) . Such models are often unsuitable for real-time or onboard deployment due to memory and latency constraints. In contrast, lightweight detectors improve efficiency but frequently lose discriminative power, struggling to capture the structural relationships that distinguish targets from clutter in SAR backscatter. Knowledge distillation (KD) has been explored to transfer knowledge from large teacher models to compact students. However, existing SAR-oriented KD methods primarily rely on feature-map matching ( 11 ; 16 ) or logit alignment ( 6 ; 17 ) , enforcing localized activation similarity. These approaches do not explicitly model the relational geometry that governs how a teacher organizes object representations in feature space. As a result, the student learns local responses rather than the structural reasoning employed by the teacher—an important limitation in SAR imagery, where contextual and geometric cues are critical. We address this limitation by proposing a relation-aware knowledge distillation framework that transfers object-level relational geometry from a teacher detector to a compact student. Our method formulates distillation as a contrastive Information Noise-Contrastive Estimation (InfoNCE) objective in a shared projection embedding space, where normalized teacher and student region features are compared via pairwise similarity.We emphasize that the novelty is not a new general-purpose contrastive objective, but a detection-aware formulation for SAR ship detection: teacher predictions from heterogeneous detector families are converted into candidate object regions, aligned across teacher and student preprocessing spaces, and used to supervise object/region embeddings rather than whole-image representations or local activation maps. This enables an architecture-agnostic region-level distillation interface for two-stage, one-stage, and transformer-based detectors while encouraging the student to preserve the teacher’s semantic topology instead of merely matching pixel-level or activation-level responses. Among the evaluated detector families, the two-stage Faster R-CNN architecture is the strongest choice for SAR ship detection and SURGE provides its most substantial improvement on this family. Our main contributions are summarized as follows: • We propose SURGE , a unified relation-aware knowledge distillation framework for SAR ship detection. The novelty lies in converting heterogeneous detector predictions into aligned candidate regions and transferring relational geometry among object-level embeddings, rather than introducing a new general-purpose InfoNCE loss. • We introduce a unified region-level distillation interface applicable to two-stage, one-stage, and transformer-based detectors without modifying their core designs. • To the best of our knowledge, we present the first transformer-based distillation framework for SAR ship detection, demonstrating effective relational transfer without relying on query-level supervision. • Experiments on SSDD and HRSID show substantial gains for lightweight two-stage detectors, with up to 6.2 mAP and 8.0 AP 75 improvement while achieving over 50% parameter reduction . 2. Related Works Recent work in SAR ship detection has primarily focused on adapting deep object detectors originally developed for optical imagery ( 7 ) . Two-stage detectors such as Faster R-CNN ( 9 ) and one-stage architectures, including RetinaNet ( 4 ) have been extended to SAR data using multiscale feature learning and task-specific preprocessing to mitigate speckle noise and complex scattering effects. More recently, transformer-based detectors inspired by DETR have been explored to leverage global context modeling in SAR imagery ( 22 ) . While these approaches achieve strong detection accuracy, their reliance on deep backbones and dense feature representations results in high computational complexity, limiting their suitability for real-time or onboard SAR systems. Knowledge distillation has been investigated to reduce the computational cost of deep models in SAR recognition and detection tasks ( 11 ; 16 ) . Existing SAR-oriented distillation methods predominantly rely on feature-map matching or output-level logit alignment ( 18 ; 23 ; 21 ) . Representative approaches transfer intermediate convolutional features using attention mechanisms, multiscale supervision, or privileged information ( 8 ) , and some combine distillation with network pruning or lightweight architectural design. Despite their effectiveness, these methods primarily enforce localized activation similarity and do not explicitly capture the relational structure among object representations, with most studies focusing on target recognition or classification rather than architecture-agnostic SAR ship detection. Relation-aware KD has been proposed in general computer vision to preserve structural information in representation spaces ( 13 ; 15 ) . By transferring pairwise similarities or distances, these methods enable students to learn the geometric organization of teacher embeddings. More recently, contrastive objectives such as InfoNCE have been incorporated into distillation frameworks ( 14 ; 19 ) , improving robustness and generalization in optical image classification and detection. However, to our knowledge, relation-aware contrastive distillation has not been systematically studied for SAR ship detection across heterogeneous detector architectures, motivating the unified region-level framework proposed in this work. Figure 1. Overview of SURGE framework for SAR ship detection. Given an input SAR image x , a frozen teacher detector T(\cdot) and a trainable student detector S(\cdot) extract feature maps using a backbone and FPN. Teacher predictions are decoded into candidate regions \mathcal{R}=\{r_{i}\} (region proposals for two-stage detectors, dense predictions for one-stage detectors or decoder-predicted bounding boxes in DETR), followed by top- K selection and IoU-based filtering. Teacher regions are mapped to the student image space to ensure