Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration?

Isaac Corley, Alex Stoken, Gabriele Berton · 2026

Read Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration? by Isaac Corley, Alex Stoken, Gabriele Berton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10217.txt.

Introduction

Corley, Stoken, and Berton test 24 pretrained image matchers for optical-radar satellite registration, a disaster-response bottleneck, with no tuning on satellite or radar data. Transfer is uneven: matchers trained for cross-modal work do not always beat the rest. XoFTR and RoMa post the lowest mean tie-point error, 3.0 pixels, on SpaceNet9 training scenes, RoMa using no cross-modal training. XoFTR also runs about ten times faster than RoMa, while protocol choices shift mean error up to 33 times for one matcher.

Catalog record

CREATORIsaac Corley, Alex Stoken, Gabriele Berton
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41285
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10217

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration? Isaac Corley, Alex Stoken, Gabriele Berton Abstract Cross-modal optical–SAR (Synthetic Aperture Radar) registration is a bottleneck for disaster-response via remote sensing, yet modern image matchers are developed and benchmarked almost exclusively on natural-image domains. We evaluate twenty-four pretrained matcher families—in a zero-shot setting with no fine-tuning or domain adaptation on satellite or SAR data—on SpaceNet9 and two additional cross-modal benchmarks under a deterministic protocol with tiled large-image inference, robust geometric filtering, and tie-point-grounded metrics. Our results reveal asymmetric transfer—matchers with explicit cross-modal training do not uniformly outperform those without it. While XoFTR (trained for visible–thermal matching) and RoMa achieve the lowest reported mean error at 3.0 3.0 px on the labeled SpaceNet9 training scenes, RoMa achieves this without any cross-modal training , and MatchAnything-ELoFTR ( 3.4 3.4 px)—trained on synthetic cross-modal pairs—matches closely, suggesting (as a working hypothesis) that foundation-model features (DINOv2) may contribute to modality invariance that partially substitutes for explicit cross-modal supervision. 3D-reconstruction matchers (MASt3R, DUSt3R), which are not designed for traditional 2D image matching, are highly protocol-sensitive and remain fragile under default settings. Deployment protocol choices (geometry model, tile size, inlier gating) shift accuracy by up to 33 × 33\times for a single matcher, sometimes exceeding the effect of swapping matchers entirely within the evaluated sweep—affine geometry alone reduces mean error from 12.34 12.34 to 9.74 9.74 px. These findings inform both practical deployment of existing matchers and future matcher design for cross-modal satellite registration. Figure 1 : Zero-shot SAR–optical registration on SpaceNet9. Left column: full-resolution optical scene (top) and full-resolution SAR scene (bottom). Right column: tiled correspondence gallery from a zero-shot pretrained matcher—each panel shows one randomly sampled, tiepoint-projected overlapping region from the same geographic area in both modalities. Green lines denote affine-RANSAC inliers; orange lines denote outliers. Without satellite-domain fine-tuning or adaptation, a modern pretrained matcher produces dense inlier fields on SAR–optical pairs. 1 Introduction 1 1 footnotetext: Corresponding author: [email protected] When a hurricane makes landfall, cloud cover often renders optical imagery unusable, leaving SAR as the primary observation modality. Registering newly acquired SAR images to pre-existing optical basemaps is necessary to produce georeferenced damage assessments within hours—a task well suited for image matching models. Yet the best pretrained image matchers are designed for indoor and urban natural-image benchmarks, not for overhead cross-modal imagery with speckle, layover, and radiometric inversion. As Robinson et al . ( Robinson et al. 2026 ) observe, “using satellite imagery is not simply ‘computer vision with larger images’ ”; Rolf et al . ( Rolf et al. 2024 ) make the stronger claim that satellite data constitutes a distinct modality whose statistical properties—overhead perspective, sensor diversity, global geographic distribution—systematically violate assumptions baked into natural-image pretraining. Do pretrained matchers survive this domain shift to overhead optical–SAR imagery, or do we need remote-sensing-specific registration methods? Why is cross-modal satellite registration hard? Optical and SAR sensors observe the same scene through fundamentally different physics. Optical sensors record reflected sunlight, producing texture-rich imagery with familiar visual structure. SAR sensors emit and receive microwave pulses, producing imagery dominated by speckle noise, geometric layover from side-looking acquisition, and contrast inversion relative to optical data ( H”ansch et al. 2024 ) . These effects create an appearance gap far larger than typical natural-image domain shifts such as day–night or indoor–outdoor variation. Classical handcrafted feature descriptors (SIFT ( Lowe 2004 ) , phase congruency) produce too few reliable correspondences under this gap ( Xiang et al. 2020 ) . Modern deep matchers achieve strong results on ScanNet, MegaDepth, and similar benchmarks, and recent cross-modal methods—XoFTR for visible–thermal ( Tuzcuoğlu et al. 2024 ) , MatchAnything for multi-domain registration ( He et al. 2025 ) —show that modality-aware training can improve transfer. Yet no systematic comparison across the broader matcher ecosystem exists for overhead optical–SAR imagery. Research question. The SpaceNet9 Challenge (conducted summer 2025) formalizes this evaluation with manually verified tie points across full-resolution optical–SAR scene pairs ( H”ansch et al. 2024 ; Hänsch et al. 2026 ; Schroeder 2025 ; Topcoder 2025 ) . Figure 1 previews the operating regime: tiled correspondence estimation on large satellite scenes where the optical–SAR modality gap challenges every stage of the matching pipeline. A common assumption is that stronger general-purpose matchers transfer broadly. Our results show this assumption fails for overhead optical–SAR imagery: correspondence quality does depend on the matcher architecture, but also on geometric post-processing and the registration protocol itself—tile size, overlap, inlier gating—which can shift accuracy by up to 33\times for a given single matcher, sometimes exceeding the effect of swapping matchers entirely within the evaluated sweep. We evaluate twenty-four pretrained matcher families under a fixed, zero-shot geometric protocol (with per-matcher normalization selected on the same three SpaceNet9 training scenes used for reporting) on SpaceNet9 and two additional cross-modal benchmarks (SRIF ( Li et al. 2023 ) , SARptical ( Hughes et al. 2018 ) ). Rather than proposing a new trained model, we provide controlled evidence of out-of-domain performance and isolate where pretrained matchers succeed, where they fail, and why. Contributions. • A reproducible zero-shot evaluation protocol for large-image cross-modal registration with tiled inference, robust geometric filtering, and tie-point-grounded metrics (§ 3 ). • A controlled benchmark of twenty-four pretrained matchers revealing asymmetric transfer: under a fixed geometric protocol with per-matcher normalization selected on the labeled training scenes, XoFTR and RoMa achieve the lowest reported mean error ( 3.0 px) on SpaceNet9, with MatchAnything-ELoFTR ( 3.4 px) a close third, while MASt3R/DUSt3R are substantially more protocol-sensitive and less stable under default settings (§ 5 ). • Ablations across 16 protocol configurations (64 total runs) on SpaceNet9 showing that protocol parameters (geometry model, tiling, inlier gating) dominate matcher choice as the primary accuracy lever, with findings cross-validated on two additional datasets (§ 5 ). We operationalize our titular question of “good enough” as achieving practical baseline accuracy—sub-8 px mean tie-point error on SpaceNet9 under a zero-shot protocol—with rank ordering that is qualitatively consistent across cross-modal benchmarks. 2 Related Work Cross-modal registration. The SpaceNet9 challenge paper frames optical–SAR registration as a difficult preprocessing problem driven by radiometric and geometric modality differences, including side-looking SAR distortions and weak appearance consistency ( H”ansch et al. 2024 ) . Classical handcrafted pipelines (SIFT ( Lowe 2004 ) , phase congruency) are often insufficient under these conditions ( Xiang et al. 2020 ) , motivating deep feature-matching and learned correspondence methods for SAR–optical pairs ( Hughes et al. 2018 ; Hughes et al. 2020 ; Zhang et al. 2019 ) . Cross-modal matchers and transfer. Recent work directly targets cross-modal matching through modality-aware training. XoFTR extends LoFTR with masked image modeling pre-training and pseudo-thermal augmentation for visible–thermal matching ( Tuzcuoğlu et al. 2024 ) , achieving 22% AUC@5 ∘ on its METU-VisTIR benchmark—an order of magnitude above LoFTR’s 2.6%. However, XoFTR evaluates only on ground-level visible–thermal pairs; whether this cross-modal design transfers to the harder overhead optical–SAR domain with speckle, layover, and orthorectification artifacts has not been tested. MatchAnything ( He et al. 2025 ) proposes a large-scale cross-modality pre-training framework using synthetic cross-modal pairs and diverse training resources (multi-view images, video sequences, image warping). Applied to RoMa and ELoFTR base models, their framework improves

Read the complete text