Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions

Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low · 2025

Read Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions by Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07315.txt.

Introduction

Rui Qiao and co-authors offer a label-thrifty way in a 2025 paper to make learning models fair across groups. Models often do well for the big group and poorly for small ones, and the mix shifts in the real world. Past fixes need many costly group labels to work.

Their plan spends the few group labels on a small target set. That set then steers new weights for the vast unlabeled mass of training data. Weight shifts are guided by how much each point sways the target loss. The aim is worst-group strength with far fewer labels to buy. Teams with tight label funds gain a smarter spend.

Catalog record

CREATORRui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07315

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low Abstract Machine learning models often have uneven performance among subpopulations (a.k.a., groups) in the data distributions. This poses a significant challenge for the models to generalize when the proportions of the groups shift during deployment. To improve robustness to such shifts, existing approaches have developed strategies that train models or perform hyperparameter tuning using the group-labeled data to minimize the worst-case loss over groups. However, a non-trivial amount of high-quality labels is often required to obtain noticeable improvements. Given the costliness of the labels, we propose to adopt a different paradigm to enhance group label efficiency: utilizing the group-labeled data as a target set to optimize the weights of other group-unlabeled data. We introduce G roup-robust S ample R eweighting ( GSR ), a two-stage approach that first learns the representations from group-unlabeled data, and then tinkers the model by iteratively retraining its last layer on the reweighted data using influence functions. Our GSR is theoretically sound, practically lightweight, and effective in improving the robustness to subpopulation shifts. In particular, GSR outperforms the previous state-of-the-art approaches that require the same amount or even more group labels. Our code is available at https://github.com/qiaoruiyt/GSR . 0 0 footnotetext: \dagger Partial work done while the author was a visiting scholar at the University of Washington. 1 Introduction Subpopulation shift refers to the change in the proportion of groups (as defined by the class, attributes, or both) in data distribution between the training and deployment phases ( Koh et al. 2021 ; Yang et al. 2023 ) . Due to the nature of subpopulations or the selection bias ( Dwork et al. 2012 ; Zadrozny 2004 ) , the training data is often composed of majority and minority groups that are overrepresented and underrepresented, respectively. Common examples include photos of waterbirds frequently being taken with a water background instead of a land background ( Sagawa et al. 2019 ) and people are more likely to be holding a vacuum than fixing it ( Nan et al. 2021 ) . Such group imbalance can cause some features from the majority group to be spuriously correlated with the labels, leading to possible undesirable shortcuts in training deep neural networks ( Geirhos et al. 2020 ; Hermann et al. 2024 ; Shah et al. 2020 ) . As a result, standard training with empirical risk minimization (ERM) often overly relies on such shortcuts and fails to attend to the minority groups, leading to worsened model generalization under subpopulation shifts, especially when the proportion of the minority groups increases ( Arjovsky et al. 2019 ; Nagarajan et al. 2020 ; Sagawa et al. 2020 ) . Thus, it is important to develop algorithms that are group-robust to subpopulation shifts, experiencing minimal performance degradation as measured by the worst-group accuracy. The group labels can be used to construct balanced groups or minimize the worst-group loss during training ( Idrissi et al. 2022 ; Sagawa et al. 2019 ) . These techniques often lead to improved group robustness compared to ERM. However, group labels can be expensive to obtain, necessitating approaches that maximize the gain in group robustness from limited data. Given a group-labeled dataset {\mathcal{D}}^{\text{L}} , the two mainstream categories are either using {\mathcal{D}}^{\text{L}} for model selection ( Liu et al. 2021 ; Zhang et al. 2022 ) , or using {\mathcal{D}}^{\text{L}} to directly train the model parameters ( Kirichenko et al. 2022 ) . However, these strategies may not always be the best way to exploit the group information, since they either underutilize the group labels, or restrict the most crucial part of the training to only {\mathcal{D}}^{\text{L}} while neglecting the potential of the more accessible data without group labels. Therefore, we advocate an in-between training paradigm: instead of using {\mathcal{D}}^{\text{L}} to train the model parameters directly, we use them to iteratively optimize the weights of a group-unlabeled dataset {\mathcal{D}}^{\text{U}} , which are more realistic to obtain. Then, the model parameters are trained using a weighted ERM objective on these data. Optimizing the sample weights is an established idea that necessitates solving a bilevel optimization problem ( Ren et al. 2018 ) . The inner loop of the bilevel optimization performs standard model training on a weighted objective, while the outer loop optimizes the sample weights. The two main challenges hindering its wider adoption include: (1) the unavoidable trade-off between computational cost and accuracy, and (2) the effectiveness when the model is overparameterized. For (1), calculating the outer loop gradient requires backpropagating through the entire training process, which is computationally prohibitive for deep neural networks. Conventional approaches use a one-step truncated backpropagation that relies only on the last-step gradient of the model training for computational feasibility ( Shaban et al. 2019 ; Zhou et al. 2022 ) . However, this approximation can be imprecise as it fails to account for the curvature of the loss landscape and the training dynamics of the model. For (2), training a weighted objective with overparameterized neural networks is likely to converge to the same solution as with ERM ( Sagawa et al. 2019 ; Zhai et al. 2022 ) . Regularization techniques need to be applied such that training with weighted objectives leads to meaningfully different solutions than training with ERM ( Byrd & Lipton 2019 ; Sagawa et al. 2019 ; Zhai et al. 2022 ) . To address the two challenges, we propose a two-stage method named G roup-robust S ample R eweighting ( GSR ), which iteratively reweights individual training samples to improve group robustness. We utilize last-layer retraining (LLR), a lightweight method that retrains the last linear layer of neural network ( Kang et al. 2020 ; Kirichenko et al. 2022 ) . LLR simplifies the inner loop of the bilevel optimization into a convex optimization problem. Importantly, it facilitates our application of the influence function, a technique that can be derived from implicit differentiation ( Koh & Liang 2017 ; Krantz & Parks 2002 ) , to utilize the Hessian to accurately estimate the gradient of sample weight updates without backpropagating through the entire training trajectory. In contrast to methods that rely on one-step truncated backpropagation approximations ( Zhou et al. 2022 ) , our approach leverages the fact that LLR is both inexpensive even with Hessian computation and effective for enhancing group robustness. To perform GSR , we split the group-unlabeled dataset {\mathcal{D}}^{\text{U}} into a held-out set {\mathcal{D}}^{\text{U-h}} and a remaining set {\mathcal{D}}^{\text{U-r}} . The first stage performs unweighted representation learning on {\mathcal{D}}^{\text{U-r}} . The second stage utilizes the influence function to iteratively optimize the weights of {\mathcal{D}}^{\text{U-h}} for the worst-group loss in {\mathcal{D}}^{\text{L}} achieved through LLR. Our method achieves an average improvement of 1.0% in terms of absolute worst-group accuracy as compared to the state-of-the-art method that uses the same amount of group labels as ours and outperforms methods that require more group labels. The specific contributions of this work include the following: • We propose to better leverage the high-quality group-labeled data for group robustness with an alternative paradigm by using them to reweight other samples instead of directly training on them.

Read the complete text