A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective
Yeonsung Jung, Jaeyun Song, June Yong Yang, Jin-Hwa Kim, Sung-Yub Kim, Eunho Yang · 2024
Read A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective by Yeonsung Jung, Jaeyun Song, June Yong Yang, Jin-Hwa Kim, Sung-Yub Kim, Eunho Yang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00360.txt.
Description
Abstract Learning generalized models from biased data is an important undertaking toward fairness in deep learning. To address this issue, recent studies attempt to identify and leverage bias-conflicting samples free from spurious correlations without prior knowledge of bias or an unbiased set. However, spurious correlation remains an ongoing challenge, primarily due to the difficulty in precisely detecting these samples.
Catalog record
| CREATOR | Yeonsung Jung, Jaeyun Song, June Yong Yang, Jin-Hwa Kim, Sung-Yub Kim, Eunho Yang |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00360
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective Yeonsung Jung, Jaeyun Song, June Yong Yang, Jin-Hwa Kim, Sung-Yub Kim, Eunho Yang Abstract Learning generalized models from biased data is an important undertaking toward fairness in deep learning. To address this issue, recent studies attempt to identify and leverage bias-conflicting samples free from spurious correlations without prior knowledge of bias or an unbiased set. However, spurious correlation remains an ongoing challenge, primarily due to the difficulty in precisely detecting these samples. In this paper, inspired by the similarities between mislabeled samples and bias-conflicting samples, we approach this challenge from a novel perspective of mislabeled sample detection. Specifically, we delve into Influence Function, one of the standard methods for mislabeled sample detection, for identifying bias-conflicting samples and propose a simple yet effective remedy for biased models by leveraging them. Through comprehensive analysis and experiments on diverse datasets, we demonstrate that our new perspective can boost the precision of detection and rectify biased models effectively. Furthermore, our approach is complementary to existing methods, showing performance improvement even when applied to models that have already undergone recent debiasing techniques. † † footnotetext: *Equal contribution. 1 Introduction Deep neural networks have demonstrated remarkable performance in various fields of machine learning tasks comparable to or superior to humans on well-curated benchmark datasets [ 7 , 4 , 60 , 14 ] . Nevertheless, the efficacy of these models trained on unfiltered, real-world data remains an open question. In this scenario, a significant concern arises due to the presence of dataset bias [ 52 ] , where task-irrelevant attributes are spuriously correlated with labels only in the training set. This can lead to models that rely on misleading correlations rather than learning the task-related features, resulting in biased models with poor generalization performance [ 62 , 10 ] . To prevent models from learning detrimental bias, various methods are proposed to encourage models to prioritize learning task-relevant features. Recent studies enhance task-related features by first identifying bias-conflicting (unbiased) samples through loss [ 40 , 36 ] , gradients [ 1 ] , or bias prediction techniques [ 35 ] during training, using an auxiliary biased model trained with Empirical Risk Minimization (ERM). Then, they amplify bias-conflicting samples by counteracting the bias-aligned (biased) samples through loss weighting [ 40 ] or weighted sampling [ 35 ] . The effectiveness of such methods largely depends on their precision of bias-conflicting sample detection. Specifically, there is a risk of erroneously amplifying malignant bias instead of task-relevant features when bias-aligned samples are inaccurately identified as bias-conflicting. Due to the limited detection performance of previous methods [ 40 , 36 , 1 , 35 ] , it presents a crucial challenge that remains unresolved. In this paper, we address this challenge from a novel perspective of mislabeled sample detection. Inspired by the similarities between mislabeled samples and bias-conflicting samples, we delve into Influence Functions (IF; [ 27 ] ), one of the standard methods for mislabeled sample detection [ 55 , 57 , 29 ] , to identify bias-conflicting samples and propose a simple yet effective approach for biased models by leveraging them. We first conduct a comprehensive analysis to explore the efficacy of Self-Influence (SI) [ 27 ] , a variant of IF, in biased datasets. SI estimates how removing a specific training sample during training influences the prediction of the sample itself with the trained model (see Section. 2.2 ). By measuring SI, we can identify a minority sample that, if removed from the training set, increases the likelihood of incorrect predictions of itself by the trained model due to their discrepancies with the majority samples. In this context, leveraging SI to biased datasets is promising as bias-conflicting samples constitute the minority and contradict the dominant malignant bias learned by the model. However, we observe that unlike in mislabeled settings, directly applying SI to biased datasets is not as effective (Figure 1(a) - 1(d) ). Therefore, we investigate the differences between mislabeled samples and bias-conflicting samples and reveal the essential conditions for SI to effectively identify bias-conflicting samples. Note that we denote SI under found conditions as Bias-Conditioned Self-Influence (BCSI). Building on our analysis, we propose a simple yet effective method for rectifying biased models through fine-tuning. We construct a small pivotal subset with a higher proportion of bias-conflicting samples using BCSI. While not perfect, this pivotal set can serve as an effective alternative to an unbiased set. Leveraging this pivotal set, we rectify a biased model through fine-tuning with only a few additional iterations. Extensive experiments demonstrate that our method can effectively rectify even after models are already debiased by recent methods. Our contributions are threefold: • We conduct a comprehensive analysis to explore the efficacy of SI in biased datasets and reveal the essential conditions for SI to accurately differentiate bias-conflicting samples, leading to Bias-Conditioned Self-Influence (BCSI). • We propose a simple yet effective remedy through fine-tuning that utilizes a pivotal set constructed using BCSI to rectify biased models across varying bias severities. • Our method is complementary to existing methods, capable of further rectifying models that have already undergone recent debiasing techniques. 2 Background 2.1 Learning from biased data We consider a supervised learning setting with training data D=\{z_{n}\}_{n=1}^{N} sampled from the data distribution \textbf{Z}:=(X,Y) , where the input X is comprised of X=(S,B,O) where S is the task-related signal, B is a task-irrelevant bias, and O is the other task-independent feature. Also, Y is the target label of the task, where the label is y\in\{1,\ldots,C\} . When the dataset is unbiased, ideally, a model learns to predict the target label using the task-relevant signal: P_{\theta}(Y|X)=P_{\theta}(Y|S,B,O)=P_{\theta}(Y|S) . However, when the dataset is biased, the task-irrelevant bias B is highly correlated with the task-relevant features S with probability p_{y} , i.e. , P(B=b_{y}|S=s_{y})=p_{y} , where p_{y}\geq\frac{1}{C} . Under this relationship, a data sample x=(s,b,o) is bias-aligned if (b=b_{y})\land(s=s_{y}) and, bias-conflicting otherwise, where \land denotes the logical conjunction. When B is easier to learn than S for a model, the model may discover a shortcut solution to the given task, learning to predict P_{\theta}(Y|X)=P(Y|B) instead of P_{\theta}(Y|X)=P(Y|S) . However, debiasing a model inclines the model towards learning the true task-signal relationship P_{\theta}(Y|X)\approx P(Y|S) . 2.2 Influence Functions Influence Function (IF; [ 11 , 27 ] ) estimates the impact of an individual sample from the training set on the model parameters, which in turn influences model predictions. A brute-force approach to assess the influence of a sample is to exclude the data point from the training set and retrain the model to compare differences in performance, referred to as leave-one-out (LOO) retaining. However, performing LOO retraining for all samples is computationally challenging; as an alternative, influence functions have been introduced as an efficient approximated method. Here, we review the formal definition of influence function. Given a training dataset D=\{z_{n}\}_{n=1}^{N} where z_{n}=(x_{n},y_{n}) , model parameters \theta are learned with a loss function \mathcal{L} : \theta^{*}=\argmin_{\theta}\mathcal{L}(D,\theta)=\argmin_{\theta}\sum_{n=1}^{N}\ell(z_{n},\theta) where \ell(z_{n},\theta)=-\log(P_{\theta}(y_{n}|x_{n})) is the cross-entropy loss for z_{n} with parameter \theta . To measure the impact of a single training sample z on model parameters \theta , we consider the retrained parameter \theta^{*}_{z,\epsilon} obtained by up-weighting the loss of z by