What’s in an Earth Embedding? An Explainability Analysis of Location Encoders

Livia Betti 1,∗ Sebastian Ricke 1,∗ Ivica Obadic 2,3,∗ Adam J. Stewart 2 Esther Rolf 1 1 University of Colorado Boulder 2 Technical University of Munich 3 Munich Center for Machine Learning ∗ Equal Contribution · 2026

Read What’s in an Earth Embedding? An Explainability Analysis of Location Encoders by Livia Betti 1,∗ Sebastian Ricke 1,∗ Ivica Obadic 2,3,∗ Adam J. Stewart 2 Esther Rolf 1 1 University of Colorado Boulder 2 Technical University of Munich 3 Munich Center for Machine Learning ∗ Equal Contribution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24997.txt.

Introduction

Livia Betti and four colleagues open up location embeddings to ask what geographic knowledge they contain. Geographic neural models map any coordinate on Earth to a vector, absorbing geospatial data into their weights. Such embeddings are used off the shelf as general purpose features, yet users lacked a principled audit. The authors decompose the embeddings three ways. Sparse autoencoders yield latent concepts. Sparse linear concept embeddings over a geospatial dictionary recover natural language concepts. Saliency maps give visual features.

The decompositions keep high reconstruction ability while exposing readable structure. Forests, deserts, and urban features appear as distinct components. Sparse versions also reveal clear differences between encoders: some emphasise urban structures, others broader biome and climate signals. Saliency maps from the pretraining space highlight other features such as roads and landmarks. Betti and colleagues offer the analysis as an audit toolkit: check what the vectors encode before trusting them blind.

Catalog record

CREATORLivia Betti 1,∗ Sebastian Ricke 1,∗ Ivica Obadic 2,3,∗ Adam J. Stewart 2 Esther Rolf 1 1 University of Colorado Boulder 2 Technical University of Munich 3 Munich Center for Machine Learning ∗ Equal Contribution
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24997

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What’s in an Earth Embedding? An Explainability Analysis of Location Encoders Livia Betti 1,∗ Sebastian Ricke 1,∗ Ivica Obadic 2,3,∗ Adam J. Stewart 2 Esther Rolf 1 1 University of Colorado Boulder 2 Technical University of Munich 3 Munich Center for Machine Learning ∗ Equal Contribution Abstract Geographic implicit neural representations (INRs) learn to map any coordinate on Earth to a location embedding, implicitly encoding geospatial data into the weights of a neural network. Location embeddings are widely used off the shelf as general-purpose geospatial representations, yet users lack principled tools to audit what geographic or semantic information these embeddings capture. In this work, we analyze the information content of geographic INRs through their location embeddings. We decompose these embeddings into human-interpretable features—namely, (i) sparse latent concepts, (ii) natural language concepts, and (iii) visual features. The latent concept embeddings are learned using sparse autoencoders. To recover natural language concepts, we apply sparse linear concept embeddings (SpLiCE) over a predefined geospatial dictionary. Finally, visual features are extracted using saliency maps derived from CLIP Surgery. We show that location embeddings can be decomposed into human-interpretable representations while retaining high reconstruction capability, revealing interpretable geographic structures such as forests, deserts, and urban features. Across methods, sparse decompositions expose systematic differences in encoded information, ranging from urban structures to broader biome and climate signals, and pretraining-space saliency maps further highlight complementary features such as roads and landmarks. We hope this work provides a first step toward interpretable geospatial representations. 0 0 footnotetext: Correspondence to: [email protected] 1 Introduction The archive of geospatial data is large and growing, including remote sensing images, meteorological measurements, and geotagged social media posts [ 58 ] . The availability of this data across space and time enables a range of tasks such as weather forecasting [ 27 ] , tree canopy mapping [ 51 ] , and disaster response [ 22 ] . The massive amount of geospatial data—generally considered a barrier-to-entry for those without resources—has encouraged the use of machine learning to develop compact, general-purpose geospatial representations known as Earth embeddings . These representations can be learned either directly from Earth observation data or indirectly through geographic implicit neural representations (INRs) [ 26 ] . In this work, we focus on geographic INRs, which encode geospatial data in the weights of a neural network called a location encoder that maps geographic coordinates (latitude, longitude) to a representation called a location embedding [ 35 , 26 ] . Location embeddings serve as succinct representations of the geospatial information at a given location, and are increasingly used in downstream geospatial tasks, such as temperature mapping [ 25 ] , air quality prediction [ 55 ] , and species presence and identification [ 10 ] . However, the information content of location embeddings is particularly hard to interpret as these embeddings do not correspond to a single input image, but rather to a specific latitude/longitude coordinate, and currently, there is no principled way to determine what information these representations encode. Explainability research in remote sensing has largely focused on traditional supervised image models, leaving geographic INRs underexplored despite the fundamental differences inherent to training such architectures . For geographic INRs, the dominant method for assessing embedding quality relies on predictive performance on benchmark tasks, which does not address why location embeddings perform well, or when they may fail on unseen prediction tasks. For example, in applications such as poverty mapping, it can be unclear whether predictions derived from Earth embeddings use meaningful indicators of poverty or instead rely on more predictable proxies such as infrastructure, which is seen more readily in satellite imagery [ 2 ] . To address this ambiguity, we require more direct ways of interrogating what information location embeddings contain. We aim to interpret the information content of location embeddings through the decomposition into human-interpretable features, providing three perspectives through 1) latent concepts, 2) natural language concepts, and 3) visual features ( Figure 1 ). We first extract latent concepts using sparse dictionary learning methods and find that the resulting sparse decompositions can differentiate between geographic concepts while reliably reconstructing the original location embedding ( Section 3 ). We then extend these explanations to use natural language concepts in an aligned location–text space. Qualitative analysis emphasizes fine-grained urban signals for some location encoders, and broad geographic attributes like climate or biome for others ( Section 4 ). Finally, we examine the visual features learned from the training data by using saliency maps, highlighting the differences in attention between natural and satellite imagery ( Section 5 ). Taken together, these three explainability methods provide complementary but consistent interpretations of the types of information contained within location embeddings. We conclude in Section 6 with a discussion of what this means for the current landscape of explainability methods that can be readily applied to understand Earth embeddings and location encoders, and where gaps exist that future work should address. Location Encoder pretrained geographic INR Location Embedding \left[\begin{array}[]{r}0.21\\ -0.44\\ 0.78\\ \lx@intercol\hfil\vdots\hfil\lx@intercol\\ \end{array}\right] Downstream task [lat lon] Feature attribution Visual features extracted from saliency maps. Text decomposition Decomposition into a predefined set of concepts in aligned location–text space. city park streetlight vegetation concept weight Sparse Latent Concepts Learning an embedding dictionary with a sparse autoencoder. \left[\begin{array}[]{r}0.21\\ -0.44\\ \lx@intercol\hfil\vdots\hfil\lx@intercol\\ \end{array}\right] location embedding Enc. \left[\begin{array}[]{r}0.0\\ \color[rgb]{1,0.5,0}{1.3}\\ \lx@intercol\hfil\vdots\hfil\lx@intercol\\ \end{array}\right] sparse embedding Dec. (A) Generation of location embeddings from coordinate inputs (B) Three complementary explainability methods Figure 1 : Overview of our decomposition framework for geographic INRs. A geographic INR maps coordinate inputs to a location embedding (top). We aim to interpret pretrained location encoders through three complementary explainability methods (bottom): sparse latent concepts, text decomposition, and feature attribution. 2 Related Work We situate our work within the literature of geographic INRs and explainability. For the explainability methods, we discuss in greater depth the methods that are most relevant to this work. 2.1 Location Encoders and Location Embeddings A location encoder serves both as the model as well as a compact, queryable database of geospatial information [ 26 ] . Location encoders typically pass a latitude–longitude coordinate to a positional encoding followed by a (small) neural network [ 35 ] . Existing location encoders have leveraged various positional encodings, including sinusoidal encodings (e.g., SINR and Climplicit [ 34 , 10 , 13 ] ), random Fourier features (RFFs) (e.g., GeoCLIP [ 54 ] ), and spherical harmonics basis functions (e.g., SatCLIP [ 45 , 25 ] ). Popular choices for the neural network that follows the positional encoder include feedforward MLPs, SIREN [ 48 ] or RESIREN [ 13 ] architectures. 2.2 Explainability Methods for Geospatial ML The growing adoption of ML methods for geospatial data analysis has motivated increasing interest in explaining geospatial ML models [ 19 ] . Common explanation methods for image-based geospatial models include class activation mapping (CAM) [ 57 ] and Grad-CAM [ 46 ] , Local Interpretable Model-agnostic Explanations (LIME) [ 44 ] , SHapley Additive exPlanations (SHAP) [ 33 ] , and the use of attention mechanisms [ 3 , 53 ] . Beyond image-based models, 23 integrate concept-bottleneck models to design interpretable geolocalization models. While image-based remote sensing models and geolocalization frameworks have attracted some attention in explainability research, geographic

Read the complete text