Reliable Explanations or Random Noise? A Reliability Metric for XAI
Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang · 2026
Read Reliable Explanations or Random Noise? A Reliability Metric for XAI by Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05082.txt.
Description
An explanation of a model's choice is only useful if it stays steady when nil key changes. Poushali Sengupta and 4 co-authors built a yardstick for that steadiness in this 2026 machine learning paper. Loved tools such as SHAP and Integrated Gradients rest on sound attribution axioms, yet their outputs can swing under small input shifts, redundant features, or minor model updates.
The Explanation Reliability Index measures steadiness against four axioms: surviving small perturbations, staying consistent when features duplicate information, shifting smoothly as a model evolves. It also holds up under mild shifts in the data. A companion measure covers sequential models over time, and a benchmark called ERI-Bench stress-tests methods on synthetic and real data. The tests found widespread reliability failures in loved explainers, which the authors offer as a base for more trustworthy explainable AI.
Catalog record
| CREATOR | Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 577 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05082