Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learning
Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Weiguang Qu, Yanhui Gu · 2026
Read Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learning by Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Weiguang Qu, Yanhui Gu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17429.txt.
Introduction
Peng and colleagues recast noisy-label reliability as diagnosis of the label's parameter update, rather than judging samples by loss or confidence alone. The empirical Fisher trace for the classifier layer splits into a prediction-residual part and a feature-response term, capturing update energy beyond scalar loss. Since magnitude alone cannot tell useful from harmful updates, their Relative Geometric Conflict compares the observed gradient with an EMA-teacher reference. That check better preserves hard-clean samples.
Catalog record
| CREATOR | Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Weiguang Qu, Yanhui Gu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35639 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17429
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learning Ningkang Peng, Jingyang Mao, Xiaoqian Peng, Weiguang Qu, Yanhui Gu Abstract Noisy-label methods often estimate sample reliability from forward-space signals such as loss, confidence, or entropy. These signals indicate whether a sample is difficult to predict, but they do not directly test whether its observed label induces a reliable parameter update. This gap matters because hard clean samples and mislabeled samples can have similar loss while inducing different updates. We recast reliability estimation as diagnosis of the observed-label update. The sample-wise empirical Fisher trace gives a backward-space measure of update energy: for the classifier layer, it factorizes into a prediction-residual term and a feature-sensitivity term, so it captures information beyond scalar loss. Trace, however, is still a radial magnitude signal and cannot decide whether a large update is useful or harmful. We therefore propose Relative Geometric Conflict (RGC), which compares the observed-label gradient with a reference gradient induced by an EMA teacher. The conflict term helps distinguish large but aligned hard-clean updates from large conflicting updates caused by corrupted labels. Across synthetic and real-world noisy-label benchmarks, RGC improves hard-clean preservation and accuracy under our evaluation protocol. 1 Introduction Learning with noisy labels (LNL) can be viewed as a problem of unreliable supervision [ 21 , 8 , 17 ] . Most existing methods estimate sample reliability from forward-space quantities such as loss, confidence, or entropy [ 19 , 17 ] . This design also appears in more recent sample-selection and label-refinement frameworks such as ProMix and PSSCL [ 26 , 30 ] . These signals are convenient because they are available during training, but they primarily answer how difficult the current prediction is under the observed label. They leave open the optimization question of whether the update induced by that label is trustworthy. Hard clean samples and mislabeled samples can therefore overlap in forward space, since both may exhibit high loss or low confidence, especially under instance-dependent or feature-dependent noise [ 25 , 31 ] . This observation motivates us to shift the reliability criterion from forward difficulty to parameter-space update behavior. For a sample with observed label \tilde{y}_{i} , the actual training effect is determined by the gradient \mathbf{g}_{i}^{\mathrm{obs}}=\nabla_{\theta}\ell(f_{\theta}(x_{i}),\tilde{y}_{i}) . The sample-wise empirical Fisher trace, which reduces to the squared gradient norm for \mathbf{g}_{i}\mathbf{g}_{i}^{\top} , gives a backward-space diagnostic of this effect [ 1 , 15 ] . For the classifier layer, the trace factorizes as \tau_{i}^{\mathrm{last}}=\|p_{i}-e_{\tilde{y}_{i}}\|_{2}^{2}\|h_{i}\|_{2}^{2} , showing that it captures not only the prediction residual but also how strongly this residual is transmitted into parameter updates through the feature representation. Thus, trace provides information beyond the scalar forward loss and can distinguish samples that have similar loss but different update energy. However, update energy alone is still not reliability. A hard clean sample may induce a large but useful update, while a mislabeled sample may induce a large and misleading update. Therefore, Fisher trace reveals how strongly a sample acts on the model, but not whether the induced update points in a trustworthy direction. This radial ambiguity is one reason magnitude-based criteria can still suppress informative hard clean samples. To address this ambiguity, we introduce relative geometric conflict (RGC), a direction-aware reliability principle. Instead of judging the observed-label update in isolation, RGC compares it with a reference update induced by an EMA teacher [ 24 , 16 ] . If the observed label is correct but the sample is hard, its update can be large while remaining directionally aligned with the reference. If the observed label is corrupted, the update is more likely to conflict with the reference direction. We quantify this inconsistency by C_{i}=1-\cos(\mathbf{g}_{i}^{\mathrm{obs}},\mathbf{g}_{i}^{\mathrm{ref}}) , which turns sample reliability estimation into a relative test of update consistency rather than an absolute test of difficulty or magnitude. Our contributions are: • We reformulate noisy-label reliability estimation as the problem of assessing the reliability of observed-label-induced parameter updates, rather than measuring forward prediction difficulty. • We use the sample-wise empirical Fisher trace as a backward-space diagnostic of update energy and make explicit why magnitude-only reliability criteria remain ambiguous. • We propose relative geometric conflict, which compares observed-label and reference update directions to distinguish conflicting noisy updates from large but aligned hard-clean updates. 2 Related Work Learning with noisy labels. Learning with noisy labels has been addressed by loss correction and robust objectives [ 21 , 7 , 2 , 32 ] , memorization-based sample selection or exchange [ 12 , 8 , 27 ] , and semi-supervised or mixture-based label refinement [ 17 , 5 , 26 , 30 ] . Despite their differences, many methods estimate reliability from forward-space cues such as loss, confidence, entropy, prediction history, or small-loss selection. These cues are useful but primarily measure learning difficulty rather than label reliability, and may therefore confuse hard clean samples with corrupted samples, especially under instance-dependent or feature-dependent noise [ 25 , 31 ] . Representation and gradient geometry. Several methods improve noisy-label robustness by shaping representations rather than only correcting labels. Contrastive learning provides a general tool for representation separation [ 4 , 9 , 14 ] , and noisy-label variants use selective contrastive objectives, uniform selection, or progressive selection to improve feature discriminability [ 13 , 30 ] . These methods use representation geometry through feature similarity, class compactness, or selection confidence, whereas RGC tests whether the observed-label update is directionally consistent with a reference update in parameter space. Information geometry views the Fisher matrix as a local metric, and Fisher/Hessian spectra are widely used to study curvature, sharpness, optimization, and generalization [ 1 , 6 , 11 ] , though empirical Fisher approximations require care [ 15 ] . Our sample-wise empirical trace is a local rank-one convention only for the individual matrix \mathbf{g}_{i}\mathbf{g}_{i}^{\top} , whose trace equals \|\mathbf{g}_{i}\|_{2}^{2} ; it is used as an update-energy diagnostic rather than as a true or population Fisher estimate [ 10 , 23 ] . Teacher and reference targets. Teacher-based learning and self-ensembling average predictions or weights to provide stable targets [ 16 , 24 ] , and are widely used in noisy-label learning for pseudo-labeling, label refinement, and consistency regularization [ 22 , 3 , 17 ] . Here, the EMA teacher is not merely a replacement label source; it defines a reference gradient for testing the geometric reliability of the observed-label update, and we explicitly treat teacher drift as a boundary condition. Figure 1 : Overall motivation of RGC. Conventional forward-space signals mainly measure sample difficulty and confuse hard clean samples with noisy samples. Fisher trace moves the signal into parameter space but remains magnitude-based. RGC further compares update directions and helps identify unreliable samples by their directional conflict with a reference update. 3 Method We propose a geometry-aware noisy-label learning framework that estimates whether the update induced by an observed label is reliable. The method has three ingredients: a temporally smoothed EMA reference target, a Fisher-trace proxy for update magnitude, and relative geometric conflict (RGC) for update direction. Magnitude measures how strongly a sample updates the model, while direction tests whether this update agrees with the reference. 3.1 Problem Setup and Model Definition Given a noisy training set \mathcal{D}=\{(x_{i},\tilde{y}_{i})\}_{i=1}^{N} , the observed label \tilde{y}_{i}\in\{1,\ldots,K\} may