SatDINO: A Deep Dive into Self-Supervised Pretraining for Remote Sensing
Jakub Straka, Ivan Gruber · 2025
Read SatDINO: A Deep Dive into Self-Supervised Pretraining for Remote Sensing by Jakub Straka, Ivan Gruber (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-21402.txt.
Introduction
Jakub Straka and Ivan Gruber adapted a self-teaching vision method for satellite imagery in a 2025 paper. Earth observation holds mountains of unlabeled pictures, so pretraining without labels is a natural fit. Their model, SatDINO, tunes a contrast-based method to the quirks of orbital views.
Across many data sets and test setups, it beat the masked rebuilding models that dominate the field and matched leaders on several benchmarks. A careful ablation study weighed each design choice on its own. The team also added two upgrades: encoding the ground size of each pixel, and smarter sampling of views. Both upgrades can travel to other models. Code and trained weights are public.
Catalog record
| CREATOR | Jakub Straka, Ivan Gruber |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-21402
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SatDINO: A Deep Dive into Self-Supervised Pretraining for Remote Sensing Jakub Straka, Ivan Gruber Abstract Self-supervised learning has emerged as a powerful tool for remote sensing, where large amounts of unlabeled data are available. In this work, we investigate the use of DINO, a contrastive self-supervised method, for pretraining on remote sensing imagery. We introduce SatDINO, a model tailored for representation learning in satellite imagery. Through extensive experiments on multiple datasets in multiple testing setups, we demonstrate that SatDINO outperforms other state-of-the-art methods based on much more common masked autoencoders (MAE) and achieves competitive results in multiple benchmarks. We also provide a rigorous ablation study evaluating SatDINO’s individual components. Finally, we propose a few novel enhancements, such as a new way to incorporate ground sample distance (GSD) encoding and adaptive view sampling. These enhancements can be used independently on our SatDINO model. Our code and trained models are available at: https://github.com/strakaj/SatDINO . 1 Introduction Remote sensing is a field of research where it is relatively easy to acquire large amounts of unlabeled data from diverse sources. These sources can vary in resolution, ground sample distance (GSD), capture method (satellite, aerial, or UAV), and the underlying technology, such as RGB imagery, multi-spectral imaging (MSI), synthetic aperture radar (SAR), or LiDAR. In recent years, foundation models have become a standard tool in many machine learning tasks, including natural language processing and computer vision. The abundance of unlabeled data in remote sensing presents a significant opportunity for leveraging such models. Foundation models are pre-trained in an unsupervised manner on large, unlabeled datasets. These models are then fine-tuned for specific downstream tasks. Their primary advantages include faster training times and improved performance on these downstream applications. In computer vision, unsupervised pretraining methods can be broadly classified into generative and contrastive approaches. Generative methods, such as masked image modeling (MIM), involve masking portions of an input image and using a decoder to reconstruct the missing parts, with the loss calculated between the original and reconstructed outputs. Masked Autoencoders (MAE [ 1 ] ) are a main example of this approach and are widely adopted for remote sensing tasks. On the other hand, contrastive training methods focus on learning representations by comparing encoded outputs from different inputs, encouraging similarity between related data points and dissimilarity between unrelated ones. Common contrastive methods in remote sensing include CLIP [ 2 ] (e.g., GeoCLIP [ 3 ] , CRISP [ 4 ] ) and MoCo [ 5 ] (e.g., SeCo [ 6 ] ). (a) Original image (b) Attention heads (c) PCA components Figure 1 : Visualization of the SatDINO model’s feature representations . (a) Original input image. (b) Attention map from the last layer, where different colors represent individual heads, and the head with the highest attention is shown for each patch. (c) PCA projection of patch embeddings. One notable recent contrastive method is DINO [ 7 ] , which has demonstrated strong feature representation capabilities. Except [ 8 ] , only a few works have explored DINO in the context of remote sensing. In this paper, we argue that DINO is better suited than MAE for pretraining on multi-scale data, as it inherently utilizes multiple scales of an image during training. We demonstrate that our proposed approach, SatDINO, learns more robust features compared to MAE-based methods. Our key contributions are: 1. We introduce uniform view sampling and GSD encoding , two modifications to DINO designed to better capture image scale information. 2. We conduct a comprehensive ablation study on DINO pretraining on the functional Map of the World (fMoW-RGB) [ 9 ] dataset. 3. We compare SatDINO to MAE-based models, showing that DINO pretraining is more effective for multi-scale representation and produces stronger features. 2 Related Work Generative Models. Masked Image Modeling (MIM) is one of the most widely used pretraining tasks and serves as the foundation for the MAE framework. Many remote sensing foundation models are pre-trained using this approach. SatMAE [ 10 ] was among the first models trained on the remote sensing dataset fMoW. Beyond the standard MAE framework, SatMAE integrated temporal information and spectral bands alongside positional encoding. ScaleMAE [ 11 ] , another MAE-based model trained on the fMoW-RGB dataset, introduced ground sample distance (GSD) encoding combined with positional encoding to enhance scale awareness. It also utilized upsampling and Laplacian blocks to generate and combine low- and high-frequency features. Cross-Scale MAE [ 12 ] , also trained on the fMoW-RGB dataset, focused on learning multi-scale features. The model enforced consistency between outputs of an image at different scales, encouraging the model to develop a robust understanding of scale variations. Contrastive models. Contrastive learning is another popular approach for pretraining, where the outputs of two views (or modalities) are compared to encourage similarity between related data points and dissimilarity between unrelated ones. An example of this approach is the DINO framework, which aligns the representations of local and global views of the same image, encouraging consistency across these views. In DINO-MM [ 13 ] , the DINO framework is extended to align RGB data with SAR data, enabling self-supervised learning across multiple modalities. Similarly, SkySense [ 14 ] employs contrastive training to align representations from multiple modalities. DINO-TP and DINO-MC [ 8 ] further extend the DINO framework by introducing temporal augmentations and multi-size crops, creating a more challenging pretraining task to improve feature learning. 3 Methodology Our primary objective is to train the DINO model and compare its performance with MAE models [ 10 , 11 , 12 ] trained on the same dataset. This section outlines the proposed adjustments to the DINO framework, discusses alternative approaches, details the datasets used, and presents the evaluation metrics. We show detailed experiments of the individual aspects of the model in Section 5 . 3.1 SatDINO Our model, SatDINO, builds upon the DINO framework with modifications designed for remote sensing data. We use a Vision Transformer [ 15 ] (ViT) as the backbone and explore both small and base model variants. For the small version, we experiment with patch sizes of 16 and 8, referring to these models as SatDINO-small 16 and SatDINO-small 8 , respectively. For the base version, we use only a patch size of 16, denoted as SatDINO-Base. The core idea of DINO is to enforce alignment between local and global views of an image. Both local and global views are randomly sampled from the input image, but they differ in size. Global views cover a larger portion of the image, typically between 25% and 100% of the total area. Local views occupy a smaller region, ranging from 5% to 25% of the image. However, this aspect of the framework raises several important questions: How many views should be used? How should these views be sampled from the image? Additionally, remote sensing brings some differences to standard datasets such as ImageNet [ 16 ] . In ImageNet, objects are typically centered and visually distinct. In contrast, satellite imagery often requires identifying features that occupy only a small portion of the image to differentiate between certain classes. Therefore the size of the local and global crops is critical, as is the strength of augmentations, which, if too aggressive, may negatively impact performance. To