CoDEx: Combining Domain Expertise for Spatial Generalization in Satellite Image Analysis
Abhishek Kuriyal, Elliot Vincent, Mathieu Aubry, Loïc Landrieu · 2025
Read CoDEx: Combining Domain Expertise for Spatial Generalization in Satellite Image Analysis by Abhishek Kuriyal, Elliot Vincent, Mathieu Aubry, Loïc Landrieu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19737.txt.
Introduction
Abhishek Kuriyal and co-authors propose CoDEx, a way to keep satellite image models accurate when the test terrain looks nothing like the training terrain, in a 2025 paper. Appearance shifts across the globe defeat even models trained on large worldwide sets. Rather than force one model to generalize, they train one expert per source region.
A similarity model learns which experts resemble each other and keeps neighbors consistent. At test time, a selection module picks the experts that fit the new image and blends their votes. Across four public datasets, the blend beat standard domain generalization and adaptation methods. Code is public.
Catalog record
| CREATOR | Abhishek Kuriyal, Elliot Vincent, Mathieu Aubry, Loïc Landrieu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-19737
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CoDEx: Combining Domain Expertise for Spatial Generalization in Satellite Image Analysis Abhishek Kuriyal, Elliot Vincent, Mathieu Aubry, Loïc Landrieu Abstract Global variations in terrain appearance raise a major challenge for satellite image analysis, leading to poor model performance when training on locations that differ from those encountered at test time. This remains true even with recent large global datasets. To address this challenge, we propose a novel domain-generalization framework for satellite images. Instead of trying to learn a single generalizable model, we train one expert model per training domain, while learning experts’ similarity and encouraging similar experts to be consistent. A model selection module then identifies the most suitable experts for a given test sample and aggregates their predictions. Experiments on four datasets (DynamicEarthNet, MUDS, OSCD, and FMoW) demonstrate consistent gains over existing domain generalization and adaptation methods. Our code is publicly available at https://github.com/Abhishek19009/CoDEx . 1 Introduction Earth observation data often exhibits significant spatial domain shifts, such as diverse biomes, architectures, or climate vincent2024satellite ; scheibenreif2024parameter ; tasar2020standardgan . Consequently, trained models struggle to generalize to new conditions, especially when they differ substantially from the ones of the training data. This shortfall is particularly problematic because models then perform best where annotations are already abundant, rather than in regions where their prediction is most needed. Figure 1 : Combing Domain Experts. The appearance of satellite images can vary significantly across regions, even when they contain the same semantic features (here, coastlines). We train experts for each discrete location in the train set, and learn to aggregate the most relevant ones when confronted with an unknown domain. Deep learning models are especially vulnerable to these domain shifts because of their capacity to learn and overfit complex data distributions. Most domain generalization strategies learn a single domain-invariant model li2022domain ; arjovsky2019invariant ; krueger2021out , but real-world benchmarks ( e.g . , WILDS koh2021wilds ) show that such approaches often fail to surpass simple baselines. Domain adaptation techniques—which rely on unlabeled data from a target domain—face similar hurdles, as shown in the U-WILDS benchmark sagawa2022extending . These findings underscore the difficulty of addressing domain shift for Earth observation, which remains a mostly unsolved problem despite its considerable importance. In this paper, we introduce CoDEx (COmbining Domain EXperts), a multi-expert approach to domain generalization tailored for satellite images. Instead of training a single model to perform well on all domains, we learn a specialized expert for each domain in the training set, but also a similarity between experts, which we use to encourage the consistency of similar experts to improve robustness. To aggregate experts’ predictions, we then train a model selection module to weight the outputs of the domain experts for a given input image, see Fig. 1 . At inference, when faced with a completely new domain, we use this selection module—without any additional fine-tuning on test data—to combine the predictions of all experts. We validate our approach on multiple satellite image and time series datasets, including DynamicEarthNet toker2022dynamicearthnet , MUDS van2021multi , OSCD-3ch. daudt2018urban and FMoW christie2018functional , and show consistent performance gains. In summary: • We propose a novel multi-domain training strategy that enforces consistency across domain experts without relying on hand-crafted similarity metrics between domains. • We design a model-selection module to accurately predict which domain experts will yield the most reliable predictions, allowing us to perform robust spatial generalization with minimal computational overhead. • We show consistent qualitative and quantitative improvements over existing domain-generalization and even domain-adaption methods, on four datasets and three baselines. 2 Related Work In this section, we discuss existing work on unsupervised domain adaptation and domain generalization for Earth observation, and multi-experts models. Domain Adaptation for Earth Observation. The goal of domain adaptation is to modify a model trained on annotated domains to optimize it for a target domain where only unannotated data is available. The availability of unlabeled satellite images makes such an approach particularly attractive to Earth observation koh2021wilds ; sagawa2022extending ; lu2024global ; zeng2024domain . Among the most commonly used methods, feature alignment rely on moment matching sun2016deep , discriminative losses long2018conditional , or entropy minimization vu2019advent ; chen2019domain to adapt a deep learning model to a new domain. Another approach is to rely on confident predictions in the new domain, for example using pseudo-labeling lee2013pseudo , FixMatch sohn2020fixmatch , or Noisy Student xie2020self . In the case of spatial domain adaptation, spatial awareness can be incorporated into the model by leveraging geographical metadata, as demonstrated in marsocci2023geomultitasknet . StandardGAN tasar2020standardgan and StyleAugment chun2021styleaugment take a different approach by modifying the data distribution itself with image translation. Recently, self-supervised learning has emerged as a powerful tool for domain adaptation, where models are trained on large-scale unlabeled data in a self-supervised way and on labeled data manas2021seasonal ; saito2020universal ; caron2020unsupervised . In that sense, recent Earth observation foundation models like DOFA xiong2024neural , pretrained on datasets covering a significant portion of the globe, can be seen as domain adaptation tools. Domain Generalization for Earth Observation. Unlike domain adaptation, which relies on unlabeled data from the target domain, generalization approaches must learn robust representations from source data alone. The features can be trained to be invariant to spectral and temporal transformations through augmentation like color jittering, image mixing olsson2021classmix ; illarionova2021mixchannel ; he2022classhyper or manipulations of time series nyborg2022timematch ; garnot2022multi ; yuan2025empirical . This can also be achieved through the design of the features themselves, such as transformation-invariant prototypes vincent2023pixel , or through loss functions. For example, contrastive losses align features of spatially or temporally distant images mall2023change , or between an image and its distorted version zhao2021contrastive . In contrast to these methods that focus on learning a single robust model, our approach trains and combines multiple domain-specific networks, following the idea of multi-expert models. tile x T Backbone h Pred z (a) Baseline Patch x_{1} Patch x_{2} Patch x_{3} T Backbone h_{1} h_{2} h_{3} Pred z_{1} Pred z_{2} Pred z_{3} (b) Multi-Model Patch x_{1} T Backbone h_{1} h_{2} h_{3} Pred z \mathcal{L}_{\text{domain}} Affinity \mathcal{L}_{\text{con}} (c) Multi-Model Training Figure 2 : Multi-Domain Training. We present the different multi-domain training approaches explored in this paper. In , we train a single model on all training domains. In , we train one model per training domain; all models share the same backbone network, and only see data from their domain. In , we add a consistency loss ensuring that the prediction of models associated to similar domains—as defined by a learnable affinity matrix—also produce accurate results. indicates vector multiplication and a module with tunable parameters. Multi-Experts Models. Multi-expert models aggregate predictions from multiple expert learners. Each expert may specialize in certain domains chen2025lfme or classes zermatten2024land . Experts may also be encouraged to diversify their predictions through balancing losses and different initializations shazeer2017outrageously . Strategies for combining expert predictions at inference when given an out-of-domain input vary. In particular, D 3 G yao2024improving aggregates predictions from domain-specific models using weights predicted as a function of domain metadata. Instead, our proposed expert selection module only relies on input features and does not require any metadata at test time. 3 Method We propose CoDEx, a spatial generalization framework for satellite image analysis. Like domain