Mind the Gap: Bridging Prior Shift in Realistic Few-Shot Crop-Type Classification
Joana Reuss 1,, Ekaterina Gikalo 1, Marco Körner 1,2,3 · 2025
Read Mind the Gap: Bridging Prior Shift in Realistic Few-Shot Crop-Type Classification by Joana Reuss 1,, Ekaterina Gikalo 1, Marco Körner 1,2,3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16218.txt.
Introduction
Joana Reuss, Ekaterina Gikalo, and Marco Körner tackle a mismatch that hurts crop mapping from few examples. Real farm data follow a long tail, with a few common crops and many rare ones, yet training sets are often built evenly balanced. A model trained that way meets a shifted label mix in the field and loses accuracy.
Their answer is Dirichlet Prior Augmentation, which trains the model under random label skews drawn from a Dirichlet distribution, mimicking the unknown real mix in advance. Tests show the method moves the decision boundary in the right way and steadies training. It acts like a dynamic feature regularizer and improves how few-shot crop classifiers handle real conditions.
Catalog record
| CREATOR | Joana Reuss 1,, Ekaterina Gikalo 1, Marco Körner 1,2,3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16218
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mind the Gap: Bridging Prior Shift in Realistic Few-Shot Crop-Type Classification Joana Reuss 1,, Ekaterina Gikalo 1, Marco Körner 1,2,3 Abstract Real-world agricultural distributions often suffer from severe class imbalance, typically following a long-tailed distribution. Labeled datasets for crop-type classification are inherently scarce and remain costly to obtain. When working with such limited data, training sets are frequently constructed to be artificially balanced—in particular in the case of few-shot learning—failing to reflect real-world conditions. This mismatch induces a shift between training and test label distributions, degrading real-world generalization. To address this, we propose Dirichlet Prior Augmentation (DirPA) , a novel method that simulates an unknown label distribution skew of the target domain proactively during model training. Specifically, we model the real-world distribution as Dirichlet -distributed random variables, effectively performing a prior augmentation during few-shot learning. Our experiments show that DirPAsuccessfully shifts the decision boundary and stabilizes the training process by acting as a dynamic feature regularizer. \robustify keywords few-shot learning, time-series, prior shift, Dirichlet distribution, crop-type classification, EuroCropsML. 1 Introduction In light of the increasing risk factors associated with food security, accurate agricultural monitoring is becoming increasingly crucial. While machine learning (ML) methods have achieved state-of-the-art performance on multi-spectral (time series) crop-type data ( Qi et al., 2023 ; Saini and Ghosh, 2018 ) , their reliability in real-world scenarios remains critically hindered by data scarcity and distributional shifts. Real-world label distributions in crop-type classification are often highly skewed. For instance, common crops like wheat dominate the landscape, while rare ones like parsley are heavily underrepresented. Compounding this issue, the high costs and labor required to acquire accurate crop-type labels often limit the available data to only a few examples per class, making few-shot learning (FSL) a practical approach for this domain. Frequently, FSLis equated with the concept of meta-learning but it can also simply be used in order to describe the low-data constraint in isolation. We use FSLto refer to the latter, noting that recent work has shown that regular transfer learning via pretraining and fine-tuning can receive competitive results to complex meta-learning algorithms ( Reuss et al., 2025a ; Chen et al., 2019 ) . However, labeled training (support) datasets in FSLare often constructed with a balanced label distribution. This reflects an idealized scenario where, given data scarcity, samples are deliberately collected to stabilize learning and ensure a fair representation across all classes. In order to reflect realistic scenarios, the standard practice of using a balanced FSLtest (query) set has been criticized as being unrealistic, with studies recommending the use of arbitrary and imbalanced test sets ( Veilleux et al., 2021 ; Ochal et al., 2023 ; Mohammadi et al., 2024 ) . Consequently, the training class prior p_{\text{train}}(y) is not representative of the real-world test prior p_{\text{test}}(y) . As a result, during the testing or inference phase, the model is exposed to a distributional shift, leading it to learn a strong, incorrect bias. This typically results in poor generalization performance, especially when the dataset is small or long-tailed ( Reuss et al., 2025a ) . While most existing methods address such label or prior shifts post-hoc after training by correcting the predicted class probabilities at inference time ( Lipton et al., 2018 ; Kluger et al., 2021 , cf. Section 2 ) , we propose to model the prior uncertainty proactively during the training process. Specifically, we leverage the Dirichlet distribution to sample a vast range of class distributions. This exposes the model to various realistic label distributions, ultimately leading to a classifier with superior robustness to prior shift during inference without any knowledge of the actual test skew. This is particularly critical when generalizing from a few labeled samples. The main contributions of this work are: 1. Prior-agnostic representation learning: We introduce Dirichlet Prior Augmentation, a novel method that trains models on balanced few-shot datasets using prior augmentations in order to make the model invariant to the class prior p(y) . 2. Enhanced regularization and robustness: We demonstrate that our proposed method acts as an effective regularizer, stabilizing the training process and improving robustness on severely imbalanced target domains, in particular in low-shot regimes. 2 Related work 2.1 Few-shot learning paradigm Most supervised MLmethods require large amounts of labeled data in order to achieve reasonable performance. few-shot learning, on the contrary, deals with the scenario where only a very limited number of labeled samples is available. 2.1.1 FSL as transfer vs. meta-learning A common framework in FSLis meta-learning (MTL) . In fact, both terms are often used interchangeably. The core goal of MTLis to learn entire function spaces in order to quickly adapt to unseen, related tasks using only a few labeled samples. Therefore, it is also commonly referred to as learning-to-learn . One of the most prominent MTLalgorithms is model-agnostic meta-learning (MAML; Finn et al., 2017 ) and its variants ( Raghu et al., 2019 ; Tseng et al., 2022 ) . Transfer learning , on the other hand, consists of training a model on a rather large set of labeled data before transferring it to a second, often unrelated, target task with subsequent fine-tuning. This concept has been widely used across various fields ( Kurian et al., 2024 ; Alem and Kumar, 2022 ; Rouba and Larabi, 2023 ) . Chen et al., 2019 provide a comprehensive evaluation of existing FSLapproaches. They find that traditional transfer learning achieves comparable or even superior performance on few-shot tasks compared to state-of-the-art meta-learningapproaches. 2.1.2 FSL in remote sensing FSLhas been widely applied to the field of remote sensing ( Reuss et al., 2025a ; Tseng et al., 2022 ; Rußwurm et al., 2020 ; Wang et al., 2020 ; Tseng et al., 2021 ) . Tseng et al., 2022 extended the concept of the original MAMLalgorithm explicitly for agricultural monitoring by taking into account additional metadata such as the spatial coordinates. Reuss et al., 2025a provide a comprehensive cross-regional benchmark study using the few-shot crop-type dataset EuroCropsML ( Reuss et al., 2025b ) . Their findings show that, while meta-learningachieves superior performances compared to regular transfer learning and self-supervised learning, it comes at the expense of increased computational costs. Moreover, they highlight that none of the evaluated methods were capable of overcoming the discrepancy in distribution between the balanced train set and the imbalanced test set. 2.1.3 Class imbalance and prior shift in FSL Ochal et al., 2023 provide a detailed evaluation and comparison of various existing few-shot learningmethods under class imbalance. They found that random oversampling during balanced training significantly improves performance and outperforms rebalancing loss functions, e.g. , the focal loss (FL; Lin et al., 2020 ) . Prior distribution shift correct at inference-time Recent studies address the problem of prior distribution shifts often at inference time. Black Box Shift Estimation (BBSE; Lipton et al., 2018 ) estimates the test distribution p_{\text{test}}(y) to improve generalization for symptom-diagnose detection. Kluger et al., 2021 directly tackles the problem of label (prior) and feature (covariate) distribution shift in few-shot crop-type classification using crop statistics, assuming that the distribution of the test set is known. Specifically, to address the prior distribution shift, they reweigh the posterior probabilities. Sipka et al., 2022 present a novel prior estimation approach based on