Sebra: Debiasing through Se lf-Guided B ias Ra nking

Adarsh Kappiyath, Abhra Chaudhuri, Ajay Jaiswal, Ziquan Liu, Yunpeng Li, Xiatian Zhu, Lu Yin · 2025

Read Sebra: Debiasing through Se lf-Guided B ias Ra nking by Adarsh Kappiyath, Abhra Chaudhuri, Ajay Jaiswal, Ziquan Liu, Yunpeng Li, Xiatian Zhu, Lu Yin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18277.txt.

Introduction

Adarsh Kappiyath and co-authors present a self-guided way to rank training samples by how much they lean on false cues, in work from 2025. Models often learn shortcuts, such as background, instead of the real signal. Ranking samples by shortcut strength helps un-teach that habit, but ranking used to need human labels.

Their method, Sebra, exploits a pattern: samples with fewer false cues are harder for a model to learn early. By steering training to respect that pattern, the order in which samples are learned yields the ranking on its own. That ranking then drives a contrast method that cuts bias from many sources. Tests on four standard sets beat prior label-free debiasing tools.

Catalog record

CREATORAdarsh Kappiyath, Abhra Chaudhuri, Ajay Jaiswal, Ziquan Liu, Yunpeng Li, Xiatian Zhu, Lu Yin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18277

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sebra: Debiasing through Se lf-Guided B ias Ra nking Adarsh Kappiyath, Abhra Chaudhuri, Ajay Jaiswal, Ziquan Liu, Yunpeng Li, Xiatian Zhu, Lu Yin Abstract Ranking samples by fine-grained estimates of spuriosity (the degree to which spurious cues are present) has recently been shown to significantly benefit bias mitigation, over the traditional binary biased- vs -unbiased partitioning of train sets. However, this spuriousity ranking comes with the requirement of human supervision. In this paper, we propose a debiasing framework based on our novel Se lf-Guided B ias Ra nking ( Sebra ), that mitigates biases (spurious correlations) via an automatic ranking of data points by spuriosity within their respective classes. Sebra leverages a key local symmetry in Empirical Risk Minimization (ERM) training – the ease of learning a sample via ERM inversely correlates with its spuriousity; the fewer spurious correlations a sample exhibits, the harder it is to learn, and vice versa. However, globally across iterations, ERM tends to deviate from this symmetry. Sebra dynamically steers ERM to correct this deviation, facilitating the sequential learning of attributes in increasing order of difficulty, i.e. , decreasing order of spuriosity. As a result, the sequence in which Sebra learns samples naturally provides spuriousity rankings. We use the resulting fine-grained bias characterization in a contrastive learning framework to mitigate biases from multiple sources. Extensive experiments show that Sebra consistently outperforms previous state-of-the-art unsupervised debiasing techniques across multiple standard benchmarks, including UrbanCars, BAR, CelebA, and ImageNet-1K. Code, pretrained models, and training logs are available at https://kadarsh22.github.io/sebra_iclr25/ . 1 Introduction Distribution shifts driven by spurious correlations ( aka biases or shortcuts) are arguably one of the most studied forms of subpopulation shift ( Koh et al., 2021 ; Yang et al., 2023 ) . Models trained on data that have certain easy-to-learn attributes, spuriously correlated with labels, can overly rely on such spurious attributes, resulting in suboptimal performance during deployment ( Geirhos et al., 2019 ) . Both supervised ( Sagawa et al., 2020 ; Idrissi et al., 2022 ) and unsupervised ( Nam et al., 2020 ; Liu et al., 2021 ; Li et al., 2022 ; Park et al., 2023 ) methodologies for making neural networks robust to spurious correlations, a task also known as debiasing , have been developed. To get around the expensive human labor involved in acquiring bias labels for training supervised debiasing algorithms, unsupervised methods typically take a two-stage approach: an initial stage for bias identification and a second stage for bias mitigation. Unsupervised bias identification often relies on certain characteristics of spurious attributes, such as their relative ease of learning compared to target attributes ( Nam et al., 2020 ) , formation of clusters in feature space ( Sohoni et al., 2020 ) , adherence to a low-rank property ( Huh et al., 2023 ) , etc. This is followed by the mitigation step via resampling ( Idrissi et al., 2022 ) , contrastive learning ( Zhang et al., 2022 ) , and pruning ( Park et al., 2023 ) , etc. Existing bias identification methods typically categorize data points into two ( Nam et al., 2020 ; Liu et al., 2021 ) or more discrete groups ( Sohoni et al., 2020 ; Yang et al., 2024 ) . However, they do not offer insights into how the strength of spurious correlations varies across the identified groups, nor do they account for the variation in the strength of spurious correlations across instances within each group. Recent works, such as Singla & Feizi (2022) ; Moayeri et al. (2023) , address these limitations by ranking data points based on spuriosity—the degree to which common spurious cues are present. However, these spuriosity / bias ranking methods rely on human supervision or auxiliary biased models to identify biased features. Furthermore, they heavily rely on the interpretability of neural features extracted from adversarially trained encoders and the effectiveness of the interpretability techniques employed, which limits their applicability. To address these limitations, we present Se lf-Guided B ias Ra nking ( Sebra ), a spuriosity ranking algorithm without the need for human intervention. Sebra is based on the observation of a local symmetry in ERM (Empirical Risk Minimization) training – in a given iteration, the hardness of learning a sample is inversely correlated with the amount of spurious features it contains. In other words, the lower the amount of spurious features, the harder a sample is to learn, and vice versa. We call this, the Hardness-Spuriosity Symmetry ( Assumption 1 ), which consequently gives rise to a corresponding conservation law ( Theorem 1 ) relating the hardness of learning a sample to a measure of its spuriosity. This implies that the spuriosity ranking can be derived by looking at the trajectory (through the sample space) of a model that learns attributes sequentially in increasing order of hardness. We empirically confirm the validity of the Hardness-Spuriosity Symmetry assumption in Section G.2 . However, when training a neural network on samples with varying levels of spuriosity, globally across iterations, ERM tends to deviate from this trajectory due to (a) reliance on spurious features, since higher spuriosity samples are known to inhibit the learning of those with relatively lower levels of spuriosity Qiu et al. (2024) and (b) non-uniform gradient updates received for samples of different levels of spuriosity due to different values of the task loss (influenced by their levels of spuriosity), leading to non-determinism in the order in which samples are learned. Sebra corrects this deviation by steering the optimization pathway of a neural network by dynamically modulating ERM through a pair of controller variables to follow the conservation law corresponding to the Hardness-Spuriosity Symmetry, while minimizing the interference caused by samples of one spuriosity level on the learning of the other, thereby enabling the network to learn attributes in increasing order of difficulty. Consequently, a readout of the order in which samples are learned along this pathway serves as our predicted spuriosity ranking, requiring no human supervision. By leveraging the fine-grained spuriosity rankings obtained through Sebra and incorporating them into a simple contrastive loss, we outperform previous state-of-the-art unsupervised and supervised debiasing techniques across multiple benchmarks, UrbanCars, BAR, CelebA and ImageNet-1K. To summarize, we: ❶ introduce a novel self-guided bias ranking framework, Sebra, to dynamically rank the data points of each class on the decreasing order of the strength of spurious signals, without any human supervision; ❷ utilize these derived rankings to enable debiased learning using a simple contrastive learning framework; ❸ empirically demonstrate the effectiveness of our proposed approach across multiple datasets with spurious correlations, including UrbanCars, CelebA, BAR, MultiNLI and ImageNet-1K. Our method achieves an average improvement of 10% in both UrbanCars and CelebA, and 6% in BAR under subpopulation shift, outperforming state-of-the-art unsupervised debiasing approaches. 2 Related Works Bias Identification: A plethora of methods assume knowledge of bias either in the form of bias labels Lee et al. (2021) ; Idrissi et al. (2022) or type of bias Geirhos et al. (2019) ; Chang et al. (2021) . Even though these methods produce superior debiasing results, obtaining bias annotations for all biases or identifying the type of bias requires significant human efforts. This led to the development of various inductive biases

Read the complete text