Reliable Explanations or Random Noise? A Reliability Metric for XAI

Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang · 2026

Read Reliable Explanations or Random Noise? A Reliability Metric for XAI by Poushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05082.txt.

Description

An explanation of a model's choice is only useful if it stays steady when nil key changes. Poushali Sengupta and 4 co-authors built a yardstick for that steadiness in this 2026 machine learning paper. Loved tools such as SHAP and Integrated Gradients rest on sound attribution axioms, yet their outputs can swing under small input shifts, redundant features, or minor model updates.

The Explanation Reliability Index measures steadiness against four axioms: surviving small perturbations, staying consistent when features duplicate information, shifting smoothly as a model evolves. It also holds up under mild shifts in the data. A companion measure covers sequential models over time, and a benchmark called ERI-Bench stress-tests methods on synthetic and real data. The tests found widespread reliability failures in loved explainers, which the authors offer as a base for more trustworthy explainable AI.

Catalog record

CREATORPoushali Sengupta, Sabita Maharjan, Frank Eliassen, Shashi Raj Pandey, Yan Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE577 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05082

Browse the full library · About the Tower of Babel