Model Guidance via Robust Feature Attribution

Mihnea Ghitu [email protected], Matthew Wicker [email protected], Vihari Piratla [email protected] · 2025

Read Model Guidance via Robust Feature Attribution by Mihnea Ghitu [email protected], Matthew Wicker [email protected], Vihari Piratla [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19680.txt.

Introduction

Mihnea Ghitu, Vihari Piratla, and Matthew Wicker guide model training with robust feature attribution to curb shortcut learning, in a paper from 2025. Models often lean on irrelevant cues, which can cause real harm in medicine and language tasks. Guiding training with feature relevance notes is common, but salience signals are unreliable.

Their simplified objective jointly demands robust explanations and blocks shortcut reliance. Theory shows why it should beat prior objectives with similar aims. Across broad experiments, test errors fall by about a fifth versus leading methods. Ablations add a practical lesson: annotation quality beats quantity.

Catalog record

CREATORMihnea Ghitu [email protected], Matthew Wicker [email protected], Vihari Piratla [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-19680

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Model Guidance via Robust Feature Attribution Mihnea Ghitu [email protected], Matthew Wicker [email protected], Vihari Piratla [email protected] Abstract Controlling the patterns a model learns is essential to preventing reliance on irrelevant or misleading features. Such reliance on irrelevant features, often called shortcut features, has been observed across domains, including medical imaging and natural language processing, where it may lead to real-world harms. A common mitigation strategy leverages annotations (provided by humans or machines) indicating which features are relevant or irrelevant. These annotations are compared to model explanations, typically in the form of feature salience, and used to guide the loss function during training. Unfortunately, recent works have demonstrated that feature salience methods are unreliable and therefore offer a poor signal to optimize. In this work, we propose a simplified objective that simultaneously optimizes for explanation robustness and mitigation of shortcut learning. Unlike prior objectives with similar aims, we demonstrate theoretically why our approach ought to be more effective. Across a comprehensive series of experiments, we show that our approach consistently reduces test-time misclassifications by 20% compared to state-of-the-art methods. We also extend prior experimental settings to include natural language processing tasks. Additionally, we conduct novel ablations that yield practical insights, including the relative importance of annotation quality over quantity. Code for our method and experiments is available at: https://github.com/Mihneaghitu/ModelGuidanceViaRobustFeatureAttribution . 1 Introduction Machine learning (ML) has seen tremendous progress in the last decade, culminating in mainstream adoption in a variety of domains. Deep neural networks (DNN) sit at the core of this progress, due to their remarkable performance and ease of deployment ( Goodfellow et al. 2016 ) . With applications in wide-ranging domains ( Bommasani et al. 2021 ) , the promise of impact comes with the potential for substantial harm when deploying models that may be dependent on irrelevant and misleading feature patterns present in their particular training dataset ( Ross et al. 2017 ) . A model misgeneralizing due to its reliance on incidental correlations is often referred to as shortcut learning ( Ross et al. 2017 ; Geirhos et al. 2020 ; Heo et al. 2023 ) . Learning such shortcuts poses a great challenge with deployment in safety-critical domains. For instance, models were documented to exploit dataset-specific incidental correlations such as hospital tags in chest x-rays when diagnosing pneumonia ( Zech et al. 2018 ; DeGrave et al. 2021 ) or bandage in skin lesions when diagnosising skin cancer ( Rieger et al. 2020 ) . In natural language processing, models often rely incorrectly on pronouns and proper nouns when making decisions ( McCoy et al. 2019 ) , leading to bias in downstream tasks such as hiring and loan approvals ( Rudinger et al. 2018 ) . Left unchecked, learning and relying upon such shortcuts may lead to unintended harms at deployment time. Thus, understanding and mitigating shortcut learning has become an important area of research that has accumulated rich benchmarks and methodologies ( Ross et al. 2017 ; Geirhos et al. 2020 ; Singla et al. 2022 ) . The best-performing approaches to mitigating shortcut learning involves the use of feature-level annotations that indicate if a feature in a given input is a core feature or a non-core feature that may represent a shortcut (e.g., the background of an image). Throughout the paper we will refer to non-core features simply as masked features. Methods that make use of such annotations are commonly termed Machine Learning from Explanations (MLX) methods. A variety of MLX approaches have been proposed Lee et al. 2022 ; Heo et al. 2023 , and a common theme across state-of-the-art methods is the use of model explanations to regularize dependence on masked features, pioneered in right for the right reasons ( Ross et al. 2017 ) . The model explanations used in MLX methods come in the form of feature attribution explanations which assign a score to each feature indicating how important the score is to the model prediction. By ensuring that masked features have low importance (achieved via regularizing the loss function) MLX methods mitigate shortcut learning ( Jia et al. 2018 ; Kavumba et al. 2021 ; Heo et al. 2023 ; Ross et al. 2017 ; Jia et al. 2018 ; Kavumba et al. 2021 ; Heo et al. 2023 ) . However, these methods assume that feature attribution explanations provide a faithful signal of model behavior, an assumption increasingly called into question. Recent work shows that the most popular form of feature importance, gradient-based attributions, can be unstable and easily manipulated, even without changing model predictions ( Dombrowski et al. 2019 ; Wicker et al. ) . This fragility stems from the non-linear nature of deep networks, which allows imperceptible input changes to dramatically alter gradient-based explanations—much like adversarial attacks on outputs ( Goodfellow et al. 2014 ) . As a result, using only the gradient at a single input point in conjunction with annotation masks may not reliably suppress shortcut learning because out-of-distribution data might render the explanations unusable. Moreover, prior MLX works largely overlook how annotation quality and availability affect performance and inference-time generalizability, leaving important practical considerations unexplored. In this work, we address these shortcomings by first proposing that mitigating reliance on shortcut features would be substantially more effective if one additionally optimizes for the reliability of the feature saliency explanations. We propose a robust variant of right for right reasons (RRR) that accounts for the noise in feature importance scores, which we dub robustly right for the right reasons ( \text{R}^{4} ). \text{R}^{4} regularizes the feature importance in a high-dimensional ball around the training points rather than regularizing the feature importance at the training point alone. As a result, the objective required an inner optimization over a high-dimensional manifold, which is intractable. Thus, we instantiate three variants of \text{R}^{4} each implementing a different approximate solution to the optimization problem: Rand - \text{R}^{4} takes the maximum over perturbations sampled from the domain of the optimization, Adv - \text{R}^{4} uses first-order optimization to search the domain of the optimization, and Cert - \text{R}^{4} uses convex-relaxations of the problem to compute an upper-bound the solution to the optimization problem. We compare each of these methods with a series of state-of-the-art MLX approaches with various datasets. We employ two synthetic datasets: the well-studied DecoyMNIST dataset ( Ross et al. 2017 ) as well as a novel shortcut learning benchmark derived from a medical image diagnosis problem ( Yang et al. 2023 ) . Through further evaluation on three real-world benchmarks, we demonstrate consistent gains of \text{R}^{4} over the state-of-the-art by a substantial margin (a raw increase of 6% accuracy on average). In summary, this paper makes the following contributions: • We establish a novel, adversarial approach to machine learning from explanations that we name robustly right for the right reasons or \text{R}^{4} . • We propose and implement three (approximate) solutions to the intractable inner optimization of \text{R}^{4} : a statistical approach, a first-order optimization approach, and a convex-relaxation based approach and demonstrate their scaling to models as large as ResNet-18 and BERT. • Through a series of experiments, we demonstrate that \text{R}^{4} outperforms prior state of the art MLX approaches across all datasets and can effectively mitigate

Read the complete text