Rethinking Explanation Evaluation under the Retraining Scheme
Yi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder · 2025
Read Rethinking Explanation Evaluation under the Retraining Scheme by Yi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08281.txt.
Description
Yi Cai, Thibaud Ardoin, Mayank Gulati, and Gerhard Wunder rethink how explanation quality for machine learning models is evaluated under retraining. Feature attribution methods claim to show which inputs drive a decision, yet no ground truth explanations exist. Retraining schemes such as ROAR adapt the model to manipulated data, avoiding distribution shift, but their rankings often clash with theory for respected explainers.
The authors identify a sign issue that leaves residual information in altered inputs and distorts the retraining verdict. A straightforward reframing of the evaluation process removes the problem. New variants built on that fix give a fuller picture of explanation quality and run the evaluation much more efficiently.
Catalog record
| CREATOR | Yi Cai, Thibaud Ardoin, Mayank Gulati, Gerhard Wunder |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08281