GAMR: Geometric-Aware Manifold Regularization with Virtual Outlier Synthesis for Learning with Noisy Labels Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY 291 CCS: Computing methodologies Computer vision problems

Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Peirong Ma, Xichen Yang, Weiguang Qu, Yanhui Gu · 2026

Read GAMR: Geometric-Aware Manifold Regularization with Virtual Outlier Synthesis for Learning with Noisy Labels Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY 291 CCS: Computing methodologies Computer vision problems by Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Peirong Ma, Xichen Yang, Weiguang Qu, Yanhui Gu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20727.txt.

Introduction

Ningkang Peng and six colleagues propose GAMR, a geometry-aware method for learning from noisy labels. Deep networks degrade when labels are wrong, since they overfit mislabeled data, and simple filtering struggles to tell hard examples from noisy ones. GAMR instead reshapes feature-space geometry by synthesizing virtual outlier samples that build energy barriers between data manifolds. Geometric constraints promote tight within-class grouping and clear between-class separation, sharpening the line between hard and noisy samples.

Catalog record

CREATORNingkang Peng, Jingyang Mao, Xiaoqian Peng, Peirong Ma, Xichen Yang, Weiguang Qu, Yanhui Gu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40969
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20727

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GAMR: Geometric-Aware Manifold Regularization with Virtual Outlier Synthesis for Learning with Noisy Labels Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY 291 CCS: Computing methodologies Computer vision problems Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Peirong Ma, Xichen Yang, Weiguang Qu, Yanhui Gu Abstract . Deep neural networks (DNNs) experience significant performance degradation when processing noisy labels, primarily due to overfitting on mislabeled data. Current mainstream approaches attempt to mitigate this issue by passively filtering clean samples during training. However, simple sample filtering within feature spaces degraded by noise struggles to distinguish between challenging samples and noisy samples, creating a bottleneck for model performance. We highlight for the first time the fundamental importance of actively reshaping feature space geometry for learning from noisy data. We propose a novel Geometry-aware Manifold Regularization Paradigm whose core idea is to explicitly construct energy barriers between data manifolds by actively synthesizing virtual outlier samples. By imposing geometric constraints that promote intra-class compactness and inter-class separation, this approach enhances the discriminability between hard and noisy samples, leading to the learning of more robust representations. Our regularization mechanism exhibits high universality, with effectiveness independent of any prior assumptions about noise patterns. It can be integrated as a standalone mechanism into existing sample selection frameworks, providing stronger robustness against diverse noisy environments. Experiments demonstrate that our paradigm achieves performance surpassing current state-of-the-art (SOTA) methods on multiple benchmarks, including CIFAR-10, with particularly pronounced advantages under more challenging asymmetric noise conditions. Furthermore, this paradigm significantly enhances the model’s capability in Out-of-Distribution (OOD) detection, ensuring superior reliability and safety for deployment in open-world scenarios. 1. Introduction In recent years, DNNs have shown impressive performance in computer vision tasks ( Cao et al. 2024 ) . However, large-scale,high-quality labeled data is necessary for these achievements, while label noise is practically inevitable in practical applications. Models frequently overfit to wrong labels when trained with noisy labels, seriously impairing generalization performance ( Sun et al. 2022 ) . Two major categories can be used to classify current methods for Learning with Noisy Labels (LNL). One class of methods mitigates noise effects by estimating noise transfer matrices or performing statistical corrections ( Zhu et al. 2022 ; Li et al. 2025 ) . Nevertheless, these approaches typically rely on robust distributional assumptions and perform poorly under high noise rates or scenarios with a large number of categories ( Liao et al. 2025 ) . In contrast, the sample selection-based paradigm has emerged as the mainstream approach ( Zhang et al. 2025a ; Kim et al. 2025 ) . The majority of these techniques dynamically divide data into clean and noisy subsets by fitting the distribution of training losses ( Arazo et al. 2019 ) , then use semi-supervised learning (SSL) to optimize these divisions ( Berthelot et al. 2019 ; Fooladgar et al. 2024 ) . Although sample selection-based methods have demonstrated their effectiveness in practice, relying solely on loss or prediction confidence as selection criteria fails to fundamentally distinguish between closely related clean samples and noisy samples. This limitation caps the upper bound of sample selection accuracy and ultimately constrains model generalization. For the first time, this paper shifts the research perspective to actively reshaping the feature space for sample selection, and proposes a Geometry-aware Manifold Regularization Paradigm. Unlike previous methods that directly distinguish samples in a loose feature space, our goal is to actively construct a feature space that is compact within classes and separable between classes ( Khosla et al. 2020 ) . Specifically, we dynamically synthesize virtual outlier samples in low-density regions of the feature space and impose explicit high-energy constraints through energy modeling ( Du et al. 2022 ) . This establishes distinct energy barriers between low-energy class clusters ( Liu et al. 2020 ) . By imposing anisotropic constraints on the real data manifold, we force samples within the same class to cluster tightly around their class centers while separating different classes. As shown in Figure 1 , this structural reshaping of the feature space ultimately enables effective distinction between difficult samples and noisy samples that originally overlapped in distribution. This enhances the diversity of sample selection, allowing the model to learn a more comprehensive and diverse set of difficulty clean samples. Crucially, this geometric correction does not rely on explicit modeling of noise patterns but functions as a universal regularization mechanism that can be integrated into existing sample selection frameworks. Our contributions are summarized as follows: • We propose a novel geometric paradigm for LNL. From a geometric perspective, we reveal that the performance bottleneck of the current mainstream passive selection paradigm stems from operating within a feature space degenerated by noise. This paper pioneers a paradigm shift, redirecting research on learning with noise toward active feature space reshaping. • We design an energy-based universal manifold compactification mechanism. We propose a noise pattern-agnostic regularization mechanism that enhances the noise robustness of sample selection methods by synthesizing high-energy virtual outlier samples in low-density regions of the feature space. • Enhancing convergence efficiency, performance, and trustworthy robustness of noisy training. Extensive experiments substantiate that this paradigm significantly enhances the separability of clean and noisy samples in the feature space, achieving state-of-the-art (SOTA) results on multiple benchmarks, including CIFAR-10/100, especially under challenging asymmetric noise conditions. Furthermore, it guides the model to converge more rapidly onto the clean data manifold, accelerating the overall training process. Crucially, distinguishing our work from prior arts limited to in-distribution (ID) accuracy, we extend the evaluation scope of learning with noisy labels. We reveal, for the first time, that the active geometric reshaping paradigm exhibits exceptional safety against unknown samples, ensuring high generalization capability in open-world scenarios. Figure 1 . Feature Visualization Comparison. (a) Exhibits a loose structure with entangled clean and noisy samples. (b) Shows compact class distributions with effective noise segregation. 2. Related Work 2.1. Labeled Noise Learning Existing sample selection mechanisms in LNL can be broadly categorized into small-loss criterion-based methods and hybrid SSL frameworks ( Cheng et al. 2025 ) . Early approaches leveraged the empirical observation that DNNs prioritize learning clean patterns, thereby selectively retaining reliable samples ( Gui et al. 2021 ) . For instance, Han et al ( Han et al. 2018 ) . proposed a Co-teaching architecture employing two structurally identical DNNs to mutually filter clean samples based on Cross-Entropy (CE) loss ( Ghosh et al. 2017 ) . Recent methodologies, such as DivideMix ( Li et al. 2020 ) , MOIT ( Ortego et al. 2021 ) , and DISC ( Li et al. 2023 ) , have evolved beyond merely discarding residual samples, instead repurposing them as unlabeled data. By integrating strategies like Gaussian Mixture Models, contrastive loss, and dynamic thresholds, these methods optimize training through SSL, achieving significant performance gains. Building on these frameworks, subsequent studies have incorporated more diverse theoretical tools to enhance robustness. For example, Feng et al. ( Feng et al. 2023 ) refined sample selection from the perspective of optimal transport theory, integrating it with the DivideMix pipeline. Although these approaches achieved some success in practical applications, their samples were passively selected within unconstrained, chaotic feature spaces. Consequently, the upper bound

Read the complete text