Rethinking Explanation Evaluation under the Retraining Scheme

Yi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder · 2025

Read Rethinking Explanation Evaluation under the Retraining Scheme by Yi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08281.txt.

Description

Yi Cai, Thibaud Ardoin, Mayank Gulati, and Gerhard Wunder rethink how explanation quality for machine learning models is evaluated under retraining. Feature attribution methods claim to show which inputs drive a decision, yet no ground truth explanations exist. Retraining schemes such as ROAR adapt the model to manipulated data, avoiding distribution shift, but their rankings often clash with theory for respected explainers.

The authors identify a sign issue that leaves residual information in altered inputs and distorts the retraining verdict. A straightforward reframing of the evaluation process removes the problem. New variants built on that fix give a fuller picture of explanation quality and run the evaluation much more efficiently.

Catalog record

CREATORYi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08281

Browse the full library · About the Tower of Babel