An assessment of data-centric methods for label noise identification in remote sensing data sets
Felix Kröber 1, 2, Genc Hoxha 2, Ribana Roscher 2 · 2026
Read An assessment of data-centric methods for label noise identification in remote sensing data sets by Felix Kröber 1, 2, Genc Hoxha 2, Ribana Roscher 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16835.txt.
Introduction
Kröber, Hoxha, and Roscher assess data-centric methods that find wrong labels in remote sensing datasets. Bad labels are common in real data and can badly limit deep learning models. The team tests three methods that flag and isolate noisy labels, not just cope with them. They inject label noise from 10 to 70 percent into two benchmark datasets, in several noise patterns. They track how well each method filters noise and how task scores change. Their results show which method fits which setting, and where more research is needed.
Catalog record
| CREATOR | Felix Kröber 1, 2, Genc Hoxha 2, Ribana Roscher 2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44177 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16835
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An assessment of data-centric methods for label noise identification in remote sensing data sets Felix Kröber 1, 2, Genc Hoxha 2, Ribana Roscher 2 Abstract Label noise in the sense of incorrect labels is present in many real-world data sets and is known to severely limit the generalizability of deep learning models. In the field of remote sensing, however, automated treatment of label noise in data sets has received little attention to date. In particular, there is a lack of systematic analysis of the performance of data-centric methods that not only cope with label noise but also explicitly identify and isolate noisy labels. In this paper, we examine three such methods and evaluate their behavior under different label noise assumptions. To do this, we inject different types of label noise with noise levels ranging from 10 to 70% into two benchmark data sets, followed by an analysis of how well the selected methods filter the label noise and how this affects task performances. With our analyses, we clearly prove the value of data-centric methods for both parts – label noise identification and task performance improvements. Our analyses provide insights into which method is the best choice depending on the setting and objective. Finally, we show in which areas there is still a need for research in the transfer of data-centric label noise methods to remote sensing data. As such, our work is a step forward in bridging the methodological establishment of data-centric label noise methods and their usage in practical settings in the remote sensing domain. keywords Data-centric Learning, Label Noise, Area under the Margin, Topological Noise Filtering, Confident Learning, Remote Sensing 1 Introduction Figure 1: High-level overview of using data-centric methods to filter label noise and obtain a cleaned data set for model training. Scene classification is a fundamental task in RS ( RS ) aiming at assigning single labels, such as land use land cover categories, to images. Recent advances in RS scene classification are driven by state-of-the-art deep learning methods ( 8 ) . However, the effectiveness of deep neural networks heavily depends on the availability of large amounts of training data carefully annotated by human experts. The annotation process is both time-consuming and costly. To mitigate this cost, researchers often rely on crowdsourcing or publicly available thematic products such as the CORINE Land Cover map ( 6 ) , GLC2000 ( 4 ) or GlobCover ( 2 ) . While less costly, these labeling strategies frequently introduce noise. In the case of crowdsourcing, non-expert annotators may mislabel images due to limited domain knowledge, whereas the use of thematic products can introduce noise due to imprecise mapping or outdated information. Because over-parameterized neural networks can memorize such noisy labels ( 37 ) , performance may subsequently degrade depending on noise type and level as well as data set characteristics such as size and number of classes ( 7 ; 16 ; 24 ) . To address this challenge, numerous approaches have been developed to improve model performance under noisy labels ( 28 ) . These approaches can be broadly characterized into model-centric or data-centric strategies. Model-centric approaches focus on developing noise-robust models by introducing architectural modifications, designing noise robust loss functions, or incorporating regularization techniques. On the other hand, data-centric approaches aim to improve the quality of the training data by detecting and removing noisy samples and (re-)training the deep learning model on the cleaned data set. In the RS domain, most of the currently used approaches are model-centric ( 9 ; 15 ; 5 ) . While effective, these approaches do not explicitly detect and filter out the noisy samples and thus do not yield a cleaned data set. However, explicit consideration of data quality and automated methods for determining an improved data set is highly relevant for the sustainable further development of machine learning for RS ( 27 ) . In this paper, we adopt a data-centric perspective to tackle label noise in RS benchmark data sets (Figure 1 ). We compare and evaluate a range of methods that detect and filter the noisy samples and (re-)train the model on the cleaned data to assess their impact on scene classification performance. Beyond potential classification improvements, the data-centric methods analyzed in this paper offer two additional advantages: (i) they have the potential to construct reusable, noise-reduced benchmark data sets, and (ii) they allow to analyze label noise properties present in existing data sets explicitly. Using a controlled experimental setup with synthetically generated noise, we present a framework to assess those benefits and insights gained by data-centric label noise identification methods, which cannot be obtained by noise robust model-centric approaches. Our specific contributions are as follows: 1. To the best of our knowledge, we are the first ones to provide a benchmark of state-of-the-art data-centric methods for label noise identification on two RS data sets. 2. Under a wide regime of noise types and levels, we decompose the performances of the methods into two sub-aspects by providing a) in-depth analyses of filtering performances patterns and b) an assessment of the impact of removing noisy labels on RS scene classification performance. The remainder of this paper is organized as follows: Section 2 briefly summarizes existing works for handling label noise. Data and methods used in our work are detailed in Section 3 . The analysis of results takes place in Section 4 . Finally, Section 5 concludes with a summary of the main findings. 2 Related works Methods for handling noisy labels in the computer vision community can be broadly categorized into model-centric and data-centric approaches. Model-centric approaches address label noise through: i) the development of deep learning architectures that explicitly model noise, ii) the design of noise robust loss functions and iii) the employment of regularization strategies. Architectural methods focus on estimating the latent clean label distributions and learning a noise-transition function that maps latent clean labels to the observed noisy labels. For example, ( 29 ) introduce an additional linear layer on top of a convolutional neural network to map clean labels to noisy labels. ( 36 ) propose a contrastive-additive noise network that first estimates the quality of labels and then aggregates the class predictions and noisy labels. The second category of methods focus on designing robust loss functions to alleviate the noise effects ( 10 ) . ( 39 ) introduce the generalized CE ( CE ) loss function as an interpolation between the cross-entropy loss and mean absolute error to improve the robustness to noisy labels. ( 31 ) propose a symmetric CE loss function to address the problem of overfitting of noisy labels for easy samples and the under-learning for hard samples. This is achieved by combining the standard CE loss function with a reverse CE term. The former provides strong optimization and convergence properties, while the latter enhances robustness to label noise. Similarly, ( 19 ) propose an Active Passive Loss function that combines active losses (e.g. CE loss) to encourage optimization and convergence properties with passive losses (e.g. Mean Absolute Error) to improve robustness to noisy labels. The third category of model-centric approaches uses regularization strategies to prevent overfitting of the models to noisy labels. Examples of such strategies include