Robustness to Geographic Distribution Shift using Location Encoders
Ruth Crasto · 2025
Read Robustness to Geographic Distribution Shift using Location Encoders by Ruth Crasto (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02036.txt.
Introduction
Ruth Crasto and Esther Rolf tackle, in twenty twenty-five, geographic distribution shift: models trained on data from some places often fail in others. Standard training yields uneven accuracy across continents or biomes. Most fixes use discrete group labels and ignore the coordinates that geo-tagged data already carry. Location-aware models boost overall scores, but their effect on worst-group performance was unstudied. The authors propose a framework that models domain as a continuous latent variable. A location encoder learns that latent from coordinates, and the main predictor conditions on it.
Tests on four geo-tagged image data sets with varied group splits show clear gains in worst-group performance. The framework beat domain adaptation and location-aware baselines. It set new state-of-the-art results on two WILDS benchmark data sets.
Catalog record
| CREATOR | Ruth Crasto |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-02036
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robustness to Geographic Distribution Shift using Location Encoders Ruth Crasto Abstract Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at test time. The most common approaches to tackling geographic distribution shift treat regions delimited by administrative boundaries such as countries or continents as separate domains and apply standard domain adaptation methods, ignoring geographic coordinates that are often available as metadata. This paper proposes the use of location encoders for training models that are more robust to geographic distribution shift. We show how both simple sine-cosine encoders and pre-trained location encoders can be used to improve standard domain adaptation methods for the special case of geographic distribution shift. Our proposed methods achieve state-of-the-art results on geo-tagged imagery datasets from the WILDS benchmark. 1 Introduction Empirical risk minimization (ERM) assumes a set of independent and identically distributed ( i.i.d ) training examples. The learned predictor is then expected to generalize well to unseen data at inference time with the assumption that this data is drawn independently from the same distribution. In many real-world applications, these assumptions do not hold ( Dundar et al. 2007 ) . In this paper, we focus on a particular way of violating these assumptions known as subpopulation shift ( Koh et al. 2021 ) . In this setting, 1) the training data is not i.i.d but rather drawn from many different distributions (domains), and 2) the inference data is drawn from a different mixture of the same domains. Subpopulation shift arises naturally in many remote sensing applications ( Ekim et al. 2024 ) , where training and inference data may be drawn from different mixtures of geographic regions. We refer to this setting as geographic distribution shift . A common approach to learning a predictor that is robust to geographic distribution shift is to treat different regions delimited by administrative boundaries such as countries or continents as different domains and apply standard domain adaptation methods ( Koh et al. 2021 ) . However, this approach may ignore intra-regional diversity and inter-regional similarities. Moreover, geographic coordinates that are often available as metadata are discarded. The central idea of this paper is to use location encoders to model an underlying, continuous domain-assigning function in place of discrete region labels. Location encoders are parametric functions that map geographic coordinates into a learning-friendly higher-dimensional latent space ( Mai et al. 2023b ) . With the rise of geo-tagged image datasets ( Tang et al. 2015 ) , location encoders have become a widely applicable tool and can be used to encode a rich domain-specific signal. In particular, geographic coordinates have proven to be a useful input for a variety of prediction tasks, including geo-localization ( Vivanco et al. 2023 ) , image classification ( Aodha et al. 2019 ) , regression ( Klemmer et al. 2023 ) , and super-resolution ( Panangian & Bittner 2025 ) . In this paper, we show how location encoders can be naturally integrated into various domain adaptation methods for improved robustness to geographic distribution shift. We conduct experiments using two remote sensing datasets from the WILDS benchmark: FMoW ( Christie et al. 2018 ) and PovertyMap ( Yeh et al. 2020 ) . Empirically, we demonstrate that our proposed methods lead to significant improvements on worst-group performance metrics under geographic distribution shift. Notably, we achieve a new state-of-the-art result on the WILDS leaderboard for FMoW. 2 Background 2.1 Subpopulation Shift What can go wrong when learning a predictor f:X\rightarrow Y using ERM in the midst of a subpopulation shift? Intuitively, different domains may have different sets of features that are predictive of the target y , and the learned predictor must rely on the correct set of features for each domain without becoming dependent on spurious correlations. Standard ERM can fail in this setting by either underfitting to predictive features from under-represented domains in the training data or by overfitting to spurious features from over-represented domains. In both cases, the result is a predictor that performs significantly better on some domains than others at inference time. This bias is problematic when the mixture of domains at inference time is significantly different from what is seen during training or when the bias can have unfair or harmful consequences when deployed ( Sagawa et al. 2020 ) . Many approaches to learning a predictor that is robust to subpopulation shift fall into one of three categories. 1) The first seeks to strengthen the reliance of the predictor on domain-specific predictive features by using domain labels to condition the hypothesis space. Examples include feature-wise modulation ( Lee et al. 2021 ) and mixture of experts models ( Yao et al. 2024 ) . 2) The second seeks to reduce the reliance of the predictor on spurious correlations by learning features that satisfy some invariance condition across domains ( Sun & Saenko 2016 ) ( Arjovsky et al. 2020 ) ( Ganin et al. 2016 ) . Note that some recent approaches are more targeted and can be considered part of both categories ( Yao et al. 2022 ) ( Gao et al. 2023 ) . 3) The third category consists of distributionally robust optimization approaches that aim to minimize risk according to an estimated worst-case data distribution ( Sagawa et al. 2020 ) . In this work, we focus on a subset of approaches from the first two categories, which we describe below. 2.2 Conditional Modeling Methods Domain conditional predictors ( Lee et al. 2021 ) The key idea behind domain conditional predictors (DCP) is to learn a latent representation of each domain and to condition the prediction of y on these domain representations using FiLM ( Perez et al. 2018 ) . The latent domain representations are obtained from an intermediate layer in a neural network that is trained to predict the domain label directly from the input x . This network is trained jointly with the predictor f . Please refer to Appendix A for the exact structure of the DCP loss function. D 3 G ( Yao et al. 2024 ) Given domain labels at training time, D 3 G trains separate prediction heads for each domain in the training data, and jointly trains another model to predict pairwise similarities between domains (called domain relations) from metadata. At inference time, the predictions output from various heads are weighted by their relation to the input domain. The domain relation predictor is of the form: \frac{1}{R}\sum_{r=1}^{R}S_{C}\left(~w_{r}\cdot g(m_{i}),~~w_{r}\cdot g(m_{\text{head {j}}})~\right) where S_{C} denotes cosine similarity, m_{i} , m_{\text{head {j}}} is metadata representing domain i and the domain of the head j respectively, {w_{r}} is a set of learnable vectors, and g is a neural network. When applied to geographic distribution shift, D 3 G uses continent-level labels as the domain metadata input to g . 2.3 Invariance-based methods Invariance-based domain adaptation methods seek to learn features that satisfy some invariance condition across domains during training. In this work, we focus on two methods that enforce invariance via a regularization term in the training loss: IRM ( Arjovsky et al. 2020 ) The IRM regularizer encourages features such that a simple classifier common across domains on