The effect of whitening on explanation performance
Benedict Clark, Stoyan Karastoyanov, Rick Wilming, Stefan Haufe · 2026
Read The effect of whitening on explanation performance by Benedict Clark, Stoyan Karastoyanov, Rick Wilming, Stefan Haufe (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09278.txt.
Introduction
Trait-credit ways often praise traits that carry no real facts, such as masker traits born from trait links. Benedict Clark and three co-authors ask whether whitening, a standard un-linking pre-step, can fix that flaw. Using the XAI-TRIS test set with fake ground truth, they try 16 popular credit ways paired with five distinct whitening twists.
A tiny two-way straight-line sorting puzzle adds theory work on whether whitening can drop masker effects from Bayes-best models. Results are mixed: some whitening tricks lift credit scores, but gains shift a lot across ways and builds. The findings stress a tangled dance among data curves, pre-step quality, and credit faithfulness that no single whitening recipe fixes.
Catalog record
| CREATOR | Benedict Clark, Stoyan Karastoyanov, Rick Wilming, Stefan Haufe |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-09278
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The effect of whitening on explanation performance Benedict Clark, Stoyan Karastoyanov, Rick Wilming, Stefan Haufe Abstract Explainable Artificial Intelligence (XAI) aims to provide transparent insights into machine learning models, yet the reliability of many feature attribution methods remains a critical challenge. Prior research ( 19 ; 39 ; 41 ) has demonstrated that these methods often erroneously assign significant importance to non-informative variables, such as suppressor variables, leading to fundamental misinterpretations. Since statistical suppression is induced by feature dependencies, this study investigates whether data whitening, a common preprocessing technique for decorrelation, can mitigate such errors. Using the established XAI-TRIS benchmark ( 9 ) , which offers synthetic ground-truth data and quantitative measures of explanation correctness, we empirically evaluate 16 popular feature attribution methods applied in combination with 5 distinct whitening transforms. Additionally, we analyze a minimal linear two-dimensional classification problem ( 41 ) to theoretically assess whether whitening can remove the impact of suppressor features from Bayes-optimal models. Our results indicate that, while specific whitening techniques can improve explanation performance, the degree of improvement varies substantially across XAI methods and model architectures. These findings highlight the complex relationship between data non-linearities, preprocessing quality, and attribution fidelity, underscoring the vital role of pre-processing techniques in enhancing model interpretability. 1 Introduction In recent years, there has been a growing focus on empirically validating the performance of so-called explainable artificial intelligence (XAI) methods by examining the accuracy of their explanations ( 37 ; 25 ; 43 ; 4 ; 16 ; 1 ; 29 ; 40 , such as, ) . While some such studies use ground-truth explanations, they often face limitations in their objective assessment of explanation correctness, the variety of XAI methods analyzed, and the complexity of the explanation tasks. Many existing ground-truth problems are designed in a way that avoids realistic correlations between class-related and class-unrelated features (such as image foreground versus background). In real-world scenarios, however, such dependencies can introduce suppressor variables, noisy features that are not directly associated with the prediction target but can be utilized by the model ( 19 , for example, for denoising, e.g.,) . For instance, in image data, background elements representing lighting conditions could act as suppressor variables. A model may leverage this information to adjust for lighting variations, thereby enhancing object detection. More comprehensive discussions on suppressor variables are available in 12 ; 15 ; 19 ; 41 . A common XAI paradigm is to assign an ‘importance’ score to each feature of a given input. It has been shown, though, empirically and theoretically, that various popular feature attribution methods tend to systematically assign importance to suppressor variables even in linear settings ( 39 ; 41 ) . Extending this result, the work of 9 introduces the XAI-TRIS datasets, composed of four binary image classification problems, one linear and three non-linear. In each dataset, different types and combinations of tetrominoes ( 17 ) , geometric shapes consisting of four blocks, need to be distinguished from one another. These tetromino images are overlaid on different types of noisy backgrounds: white noise (WHITE) and correlated (CORR) background; the latter induces a suppression effect through Gaussian smoothing. The tetrominoes then represent discriminative features serving as ground truth explanations. 9 show that contemporary XAI methods fail to highlight tetrominoes consistently and, in some cases, are outperformed by model-ignorant edge detectors. It is assumed that the suppression effect degrades explanation performance, and one potential approach to reduce this impact is to use data whitening techniques. Whitenings are multivariate linear transformations that transform the original features into a new space in which all features are uncorrelated and have unit variance, thus reducing feature redundancy. Notably, some whitening transformation maintain a 1:1 correspondence between original and transformed features, making it possible to visualize importance attributions in input space and assessing their efficacy as explanations. In this paper, we take the XAI-TRIS datasets and use the associated experimental pipeline proposed by 9 to assess whether the use of whitening techniques can improve the performance of XAI methods with respect to correctness of the explanations produced. The data scenario where the WHITE background type gets utilized serves as a baseline due to having no correlations between features of the background, hence we are not applying whitening methods. Then we test if applying whitening methods to the CORR background type can reduce the impact of suppressor variables. Here, we hypothesize explanations to be more aligned with discriminative features, and hence to see improved explanation performance. Finally, also take the existing theoretical framework proposed by 41 , in order to analyze whether whitening methods can analytically remove the impact of a suppressor feature in a two-dimensional classification problem. 2 Methods Our general workflow of applying and benchmarking post-hoc XAI methods follows previous work ( 39 ; 9 ; 8 ) . We take a dataset generated with explicitly known class-related features defining the classification task and the ground truth for explanations, and train a machine learning model. The trained model is then applied to test inputs, for which output explanations are computed by XAI methods. We exclusively consider feature attribution methods, which assign an ‘importance’ score to each feature of the input. We then apply two performance metrics to compare produced explanations and the ground truth explanation for the given sample, giving us measures of the explanation performance of each method. Below, we highlight each of these steps, with more depth and the exact parameterizations given in the appendices. 2.1 Data Generation We utilize the datasets supplied by the XAI-TRIS suite ( 9 ) , providing four binary image classification problems. We make use of the 8\times 8 -px variant with two background types – the uncorrelated (WHITE) and correlated (CORR) backgrounds. The CORR background type takes the WHITE background and smoothes it with a Gaussian filter, inducing correlations between features. This also induces a suppression effect where background pixels overlapping with the placed tetromino are correlated to nearby background pixels. The data generation process is described in full detail in Supplementary materials Section A , however briefly, the four classification scenarios are defined as: 1. Linear (LIN) In the linear case, the classification problem is between a T-shaped tetromino versus an L-shaped tetromino pattern placed at the same fixed positions of the image throughout the entire dataset. 2. Multiplicative (MULT) The multiplicative scenario is similar to the LIN scenario with classifying T- versus L-shaped tetrominoes, however here each tetromino is multiplied with the background to induce non-linearity. 3. Translations and rotations (RIGID) Here, the T- and L-shaped tetromino patterns are not in a fixed position and are randomly translated and rotated anywhere in the sample, and added together with the underlying background. 4. XOR Both of the T- and L- shaped tetrominoes are present in each sample, but the classification problem is defined as the XOR configurations of adding or subtracting both tetrominoes from the background versus adding/subtracting one of each tetromino in the other class. 2.1.1 Data whitening methods Data whitening is achieved by applying a linear transformation that adjusts the direction and scale of the data. The process typically involves eigenvalue decomposition of the covariance matrix and normalizing the eigenvalues ( 21 ) . We study the following five techniques