Earth-Adapter: Bridge the Geospatial Domain Gaps with Mixture of Frequency Adaptation
Xiaoxing Hu Ziyang Gong Yupei Wang Yuru Jia Gen Luo Xue Yang · 2025
Read Earth-Adapter: Bridge the Geospatial Domain Gaps with Mixture of Frequency Adaptation by Xiaoxing Hu Ziyang Gong Yupei Wang Yuru Jia Gen Luo Xue Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06220.txt.
Introduction
Xiaoxing Hu and co-authors build Earth-Adapter, a light fine-tuning method that helps big vision models read satellite and aerial images. Standard light tuning was shaped for normal photos and copes badly with the flaws and noise that mark remote sensing images. Those flaws can smear the traits the model needs to see.
Earth-Adapter splits image traits by frequency with a Fourier transform, which parts flaws from true content. A bank of small adapter units then blends the parts, with weights set on the fly for each input. Tests on land cover mapping under domain shift show clear gains over past light tuning routes. The method tops prior scores on both adaptation and generalization tests. It gives map makers a cheap way to retune strong models for new regions and sensors.
Catalog record
| CREATOR | Xiaoxing Hu Ziyang Gong Yupei Wang Yuru Jia Gen Luo Xue Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06220
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Earth-Adapter: Bridge the Geospatial Domain Gaps with Mixture of Frequency Adaptation Xiaoxing Hu Ziyang Gong Yupei Wang Yuru Jia Gen Luo Xue Yang Abstract Parameter-Efficient Fine-Tuning (PEFT) is a technique that allows us to adapt powerful Foundation Models (FMs) to diverse downstream tasks while preserving and unleashing their inherent capabilities. However, we have observed that existing PEFT methods, which are often designed with natural imagery in mind, struggle when applied to Remote Sensing (RS) scenarios. This is primarily due to their inability to handle artifact influences, a problem particularly severe in RS image features. To tackle this challenge, we introduce Earth-Adapter, the first PEFT method specifically designed for RS artifacts conquering. Earth-Adapter introduces a novel Mixture of Frequency Adaptation process that combines a Mixture of Adapter (MoA) with Discrete Fourier Transformation (DFT). By utilizing DFT, Earth-Adapter can decompose features into different frequency components, precisely separating artifacts from original features. The MoA then dynamically assigns weights to each adapter expert, allowing for the combination of features across various frequency domains. These simple-yet-effective approaches enable Earth-Adapter to more efficiently overcome the disturbances caused by artifacts than previous PEFT methods, significantly enhancing the FMs’ performance on RS scenarios. Experiments on Domain Adaptation (DA), and Domain Generalization (DG) semantic segmentation benchmarks showcase the Earth-Adapter’s effectiveness. Compared with baseline Rein, Earth-Adapter significantly improves 9.0% mIoU in DA and 3.1% mIoU in DG benchmarks. Our code will be released at Earth-Adapter . 1 Introduction Tremendous last year breakthroughs in Foundation Models (FMs) [ 14 , 45 , 54 , 40 , 25 , 55 , 22 , 3 ] have ignited transformative progress in Computer Vision (CV), demonstrating unprecedented capabilities across both high-level and low-level vision tasks. Based on these FMs, considerable Remote Sensing (RS) research groups have also constructed large-scale, state-of-the-art (SOTA), and impressive Geospatial Foundation Models (GFMs) [ 5 , 51 , 21 , 65 , 70 , 43 , 36 , 23 , 50 , 38 ] , significantly promoting the development of RS imagery interpretation field. However, when adapting these FMs to downstream tasks, how to efficiently keep and unleash the power of FMs becomes a key problem. Under this context, Parameter-Efficient Fine-Tuning (PEFT) methods [ 31 , 37 , 28 , 8 , 20 ] become the pivotal method due to their superior parameter-performance trade-off. Existing PEFT methods designed for language or nature imagery have made great progress with excellent works, such as LoRA [ 31 ] , Visual Prompt Tuning (VPT) [ 37 ] . However, most of them show performance drops in RS cross-domain experiments. We argue the main reason lies in the influences of artifacts in the features. As shown in Figure 1 (a), we show the PCA visualization of features of DINOv2-L, which contains obvious redundant artifacts. Although a part of existing PEFT methods also are shown to be capable of handling artifacts [ 12 ] , they still underestimate the artifact disturbances in RS imagery. The difference in the distribution of artifacts between natural and RS images is significant. In natural images, artifacts typically surround foreground objects [ 12 ] , such as humans or animals, and the disturbances they cause are relatively limited. In contrast, RS images, due to their overhead perspective, lack centralized subjects and contain multiple coexisting multi-scale targets. For example, a single RS image may simultaneously include large-scale agricultural regions and fragmented road networks. As a result, artifacts are almost situated everywhere in RS images shown in Figure 1 (a), causing severe interference to domain-invariant representation learning, which is pivotal for cross-domain scenarios. Figure 1 : Motivation and Structure Details of Earth-Adapter (a) points out the artifact problems in existing PEFT methods. (b) illustrates how Earth-Adapter divides and conquers the artifacts by frequency-guided strategy and MoA framework. \scriptsize{1}⃝, \scriptsize{2}⃝, and \scriptsize{3}⃝ show the sequence of each step in the DFT operation. (c) introduces the details of the Earth-Adapter component structures. In our view, to address the influence of artifacts, one of the core ideas is to ‘ divide-and-conquer ’. Drawing on the principle that high-frequency ( HF ) signals encode local details (e.g., edge, contour) while low-frequency ( LF ) signals encode global structure (e.g., object surface), we leverage Discrete Fourier Transformation (DFT) as the ‘ divide ’ step. As illustrated in Figure 1 (b), we successfully leverage the DFT effectively to isolate artifacts into HF signals and splits coherent global features into LF signals. Subsequently, to ‘ Conquer ’ artifact-related issues, we adopt a Mixture of Adapter (MoA) architecture for PEFT design. The MoA router dynamically assigns weights to adapter experts, selecting the most relevant features for processing in each iteration. In this way, all features are aggregated into optimized representations, mitigating artifacts disturbances. Based on our motivation and findings, we further present Earth-Adapter , a simple-yet-effective RS-specialized PEFT method designed for RS artifact conquering. Specifically, Earth-Adapter consists of a novel Mixture of Frequency Adapter architecture consisting of Mixture of Adapter (MoA) with Discrete Fourier Transformation (DFT). Earth-Adapter first disentangles geospatial features by DFT, and leverages multiple experts to conquer artifacts by adaptively aggregating and learning features with suitable frequency. In this fashion, Earth-Adapter can effectively alleviate the artifacts’ disturbances for robust domain-invariant feature learning. Then gradually introduces FMs to cross the geospatial gaps from the frequency perspective. In experiments, we meticulously test Earth-Adapter on Domain Adaptation (DA), and Domain Generalization (DG) semantic segmentation tasks across five widely-used datasets. Comparing with existing PEFT methods, Earth-Adapter achieves State-Of-The-Art (SOTA) performance on DA and DG benchmarks. In DA and DG benchmarks, Earth-Adapter outperforms our baseline Rein with 8.9% and 3.2% mIoU, respectively. Additionally, we also conduct in-depth analysis of the potential of Earth-Adapter. The core contributions can be summarized as follows: • We propose a novel perspective to alleviate artifact-disturbance problems in RS imagery by frequency-guided divide-and-conquer strategy. • We introduce a simple-yet-effective PEFT method, Earth-Adapter. It is also the first RS-specialized PEFT approach designed for cross-domain semantic segmentation tasks. • Extensive comparisons validate the SOTA performance of Earth-Adapter on both DA and DG benchmarks. More ablation studies also demonstrate the high efficiency, robustness, and explainability of Earth-Adapter. 2 Related Work 2.1 RS Cross-Domain Semantic Segmentation As a classical and fundamental task in the realm of computer vision, semantic segmentation [ 46 , 57 ] not merely holds profound practical significance, but also provides an interface for researchers to dissect the high-level semantic representation of images. With the growing need for applying models to out-of-domain data, cross-domain segmentation, including domain adaptation (DA) [ 29 , 30 , 19 , 41 , 33 ] and domain generalization (DG) [ 67 , 21 ] , has gained prominence. DA and DG are the two main paradigms, where DA aims to adapt a model from a labeled source domain to an unlabeled target domain, while DG focuses on training a model on only the source domain to generalize to unseen target domains. In the RS field, cross-domain task is crucial due to the diversity of data, and lots of DA methods have been applied to improve the generalization ability of segmentation models, with applications in urban planning [ 56 ] , land resource management [ 60 ] , and environmental protection [ 58 ] . Compared