GeoSANE: Learning Geospatial Representations from Models, Not Data

Joëlle Hanna, Damian Falk, Stella X. Yu, Damian Borth · 2026

Read GeoSANE: Learning Geospatial Representations from Models, Not Data by Joëlle Hanna, Damian Falk, Stella X. Yu, Damian Borth (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23408.txt.

Introduction

Hanna and three co-authors build GeoSANE, a foundry that learns geospatial skill from model weights, not data. Remote sensing now has many foundation models, each strong in one corner. Their strengths stay split rather than merged. GeoSANE distills many models into one shared representation. Given a target design, it generates weights ready for fine-tuning. The models serve classification, segmentation, and detection across sensing modes. On ten datasets and GEO-Bench, they beat models trained from scratch. They top pruning and distillation routes for light networks.

Catalog record

CREATORJoëlle Hanna, Damian Falk, Stella X. Yu, Damian Borth
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55222
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23408

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GeoSANE: Learning Geospatial Representations from Models, Not Data Joëlle Hanna, Damian Falk, Stella X. Yu, Damian Borth Abstract Recent advances in remote sensing have led to an increase in the number of available foundation models; each trained on different modalities, datasets, and objectives, yet capturing only part of the vast geospatial knowledge landscape. While these models show strong results within their respective domains, their capabilities remain complementary rather than unified. Therefore, instead of choosing one model over another, we aim to combine their strengths into a single shared representation. We introduce GeoSANE, a geospatial model foundry that learns a unified neural representation from the weights of existing foundation models and task-specific models, able to generate novel neural networks weights on-demand. Given a target architecture, GeoSANE generates weights ready for finetuning for classification, segmentation, and detection tasks across multiple modalities. Models generated by GeoSANE consistently outperform their counterparts trained from scratch, match or surpass state-of-the-art remote sensing foundation models, and outperform models obtained through pruning or knowledge distillation when generating lightweight networks. Evaluations across ten diverse datasets and on GEO-Bench confirm its strong generalization capabilities. By shifting from pre-training to weight generation, GeoSANE introduces a new framework for unifying and transferring geospatial knowledge across models and tasks. Code is available at hsg-aiml.github.io/GeoSANE/ . Figure 1 : Instead of pretraining geospatial (foundation) models from satellite data (top), GeoSANE proposes to leverage publicly available geospatial (foundation) models to train a shared latent representation encapsulating their knowledge to generate model weights tailored for specific downstream task (bottom). 1 Introduction Foundation models have transformed computer vision and remote sensing by providing strong, task-agnostic representations capable of adapting towards a diverse set of downstream tasks. In remote sensing, foundation models Cong et al. 2022 ; Reed et al. 2022 ; Jakubik et al. 2023 ; Szwarcman et al. 2025 ; Xiong et al. 2024 ; Hanna et al. 2026 ; Guo et al. 2023 ; Jakubik et al. 2025 ; Danish et al. 2025 ; Fuller et al. 2023 ; Astruc et al. 2024 have demonstrated that large-scale pretraining on multispectral and multimodal satellite data yields transferable representations for classification, segmentation, and detection. However, despite their success, the landscape of remote sensing foundation models (RSFMs) remains fragmented: each model specializes in a subset of sensors, spatial resolutions, or objectives, with many models being complementary and some being more comprehensive than others. Recent surveys Xiao et al. 2025 ; Lu et al. 2024 count more than 70 RSFMs, with more RSFM joining this list. As a result, users must repeatedly decide which RSFM to select or retrain for a new task, despite the fact that the union of all these models probably encapsulates a broader range of geospatial knowledge than any single RSFM alone. In this work, we propose to take a fundamentally different perspective. Instead of learning yet another foundation model from remote sensing data, we propose to learn from existing models themselves — directly from their parameters in weight space. Inspired by recent advances in weight space learning Schürholt et al. 2021 ; Schürholt et al. 2022a ; Peebles et al. 2022 ; Schürholt et al. 2024b ; Wang et al. 2024 ; Soro et al. , we treat the weights of trained neural networks as input modality to learn a single shared latent representation of a given population of neural network models Schürholt et al. 2024a ; Han et al. 2026 . This approach would allow us to combine the knowledge encoded in multiple pretrained neural networks such that one could efficiently generate new model weights, being more suitable for task-specific fine-tuning but without the cost of large-scale pretraining. We introduce GeoSANE, a s equential a utoencoder for n eural e mbeddings acting as a geospatial model foundry that learns a shared latent representation across diverse RSFMs and task-specific remote sensing models. GeoSANE leverages a transformer-based encoder-decoder in weight space to embed these heterogeneous neural networks spanning different architectures, sensing modalities, and objectives, into a shared latent manifold. From this manifold, GeoSANE can sample new weights to generate entire models for a target architectures and a given remote sensing downstream task. In doing so, GeoSANE shifts the paradigm from data-centric pretraining to weight-centric generation of remote sensing models (Fig. 1 ) The proposed approach is motivated by three key points: (i) The availability of open-source geospatial models on platforms such as Hugging Face provides a rich collection of pretrained models capturing a vast amount of domain-specific knowledge. (ii) Operating directly in weight space decouples knowledge transfer from data availability, enabling efficient adaptation across sensors, modalities, and tasks. (iii) Pretrained models constrain their task-specific models to be of similar architecture and size demanding an additional distillation step to build lightweight models. GeoSANE aims to address all the points above, as it collects a heterogeneous population of existing geospatial models, tokenizes their parameters, and learns a shared latent embedding across them. Given a target architecture (being small or large), GeoSANE samples from this latent space to produce functional models whose weights encode the aggregated knowledge of the full population. We evaluate GeoSANE on 10 remote sensing datasets spanning optical, multispectral, and radar modalities, and across classification, segmentation, and detection tasks. Generated models consistently outperform training from scratch, match or exceed leading foundation models, and outperform pruning and distillation baselines when used to create lightweight neural networks. These results demonstrate strong generalization and the feasibility of model generation in weight space for geospatial domains. In summary, our contributions are threefold: • A new paradigm for remote sensing pretraining. We propose to learn from existing geospatial models in weight space rather than from remote sensing data. • GeoSANE, a scalable encoder-decoder approach that trains from heterogeneous models and enables on-demand weight generation for arbitrary architectures, modalities, and tasks. • Comprehensive empirical validation across multiple tasks, sensors, and datasets, establishing weight space learning as a viable alternative to regular pretraining. Together, these results indicate that learning from existing models in weight space provides a novel path to harness the rich landscape of geospatial foundation models. Figure 2 : Overview of our approach. (A) A heterogeneous collection of models, including ViTs, Swins, ResNets, UNets, and vision-language models, is gathered from HuggingFace. (B) A weight-space autoencoder is trained to reconstruct and embed these models into a shared latent representation. (C) From this latent space, GeoSANE can generate new models on demand for specific downstream tasks such as flood segmentation, object detection, or land-cover classification. 2 Related Work Remote Sensing Foundation Models. Recent progress in remote sensing foundation models (RSFMs) enabled the reuse of pretrained models for many different satellite image analysis tasks Scheibenreif et al. 2022 ; He et al. 2025 ; Hanna and Borth 2025 . Early models such as SeCo Mañas et al. 2021 , SSL4EO-S12 Wang et al. 2023 , self-supervised ViT Scheibenreif et al. 2022 and SatMAE Cong et al. 2022 demonstrated the benefits of large-scale pretraining on Sentinel imagery Torres et al. 2012 ; Drusch et al. 2012 for downstream classification and segmentation. Later works have greatly expanded model capacity and data diversity. ScaleMAE Reed et al. 2022 introduced scale-aware pretraining for multi-resolution data, while Prithvi-EO Jakubik et al. 2023 and its successor Prithvi-EO-2.0 Szwarcman et

Read the complete text