Seeing What Shouldn’t Be There: Counterfactual GANs for Medical Image Attribution
Shakeeb Murtaza · 2026
Read Seeing What Shouldn’t Be There: Counterfactual GANs for Medical Image Attribution by Shakeeb Murtaza (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05283.txt.
Introduction
Shakeeb Murtaza explains medical image labels by asking what should not be there, using what-if models to attribute a finding to the objects in a scan. Standard display tools highlight only the minimal regions a classifier used, missing other visible objects that shaped the choice. His method instead builds class-based explanations of the form: if this feature had not happened, that outcome would not have followed.
The approach rests on generative adversarial networks with a cycle-consistent loss, producing counterfactual versions of scans for contrast. Tests on test data, TB images, and brain tumour data confirm the method's value. Murtaza also highlights limits of existing counterfactual methods in producing real-looking altered images.
Catalog record
| CREATOR | Shakeeb Murtaza |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05283
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Seeing What Shouldn’t Be There: Counterfactual GANs for Medical Image Attribution Shakeeb Murtaza Abstract Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category. These insights help radiologists to visualize deformities in medical imaging. Most of the existing visualization techniques are based on discriminative models and highlight regions of the input image participating in the decision-making of a classifier. However, these approaches do not take all noticeable objects into account as their objective is to classify the input by using a minimal set of discriminative features. To overcome the issue, a counterfactual explanation (CX) based class-oriented feature attribution method is proposed. A counterfactual explanation (CX) explicates a causal reasoning process of the form: “if X had not happened, then Y would not have happened”. The method is built on generative adversarial networks (GANs) with a cyclical-consistent loss function. We evaluate our method on three datasets: synthetic, tuberculosis and BraTS. All experiments confirm the efficacy of the proposed method. This study also highlighted the limitations of existing counterfactual explanation techniques in producing plausible counterfactual instances (CIs). Accompanying CXs with believable CIs thus provides self-explanatory analogy-based explanations. To this end, a CI generation method is proposed. Also, a novel technique is used to evaluate the quality of CI. The baseline results are produced on the BraTS dataset. 1 Introduction The world is already in the industrial 4.0 era, in which artificial intelligence (AI) has an imprint on every prominent field. With the advent of deep learning, AI has surpassed human intelligence in certain fields, especially in computer vision (CV). A main hurdle in the adoption of deep learning is its black box behaviour. Certain techniques have been devised already to make these models interpretable. In this section, background on deep learning and interpretability methods is presented. 1.1 Deep Learning Deep learning is a branch of machine learning (ML) which provides state-of-the-art solutions in different areas of CV. These advances are greatly impacting medical image diagnostics (MID) with the development of tools and systems. Despite enormous performance-based breakthroughs, the lack of interpretability hinders the reliance on these techniques in MID-type safety-critical domains. Deep learning deals with learning hierarchical representations or features of raw data. Typically, deep learning is performed with artificial neural networks (ANNs). ANNs are based on a parallel processing model that is inspired by the biological neuron, which is the core component of the human brain. The brain is an assemblage of gigantic neurons that collaborate to process information from different senses and define actions in response to that information. Just like a brain’s neuron, ANNs consist of different perceptrons (basic building blocks of neural networks). A simplest neuron network consists of an activation function, a set of weights, and bias represented as \sigma , w and b, respectively. Single perceptron with some inputs and respective weights is shown in Figure 1 (a). Mathematical representation of a perceptron with “n” inputs is given below. \sigma\left(\sum_{i}^{n}\left(w_{i}\right)\ +\ b\right) (1) The perceptrons are stacked together to build layers, and these layers are then stacked to build a deep neural network, as shown in Figure 1 (b). At the output of each layer of perceptron, the activation function scales the output value in a particular range as per its characteristic 29 . Figure 1: Single and Multi Layer Perceptron Studies have established that deep ANN learns hierarchical features that are more effective than low-level features of the swallowed neural network 28 . However, these networks are very hard to train due to the large number of connections in the network, and these are not feasible in high-dimensional tasks such as computer vision. To cope with this issue, convolutional neural networks (CNNs) are introduced. Instead of a dense connection, CNN learns a special relationship by convolving a kernel on the input image, as shown in Figure 2 . At each layer, a set of filters is convolved, and an activation function is applied to generate output. CNNs have turned out to be state-of-the-art models in many computer vision tasks, e.g. image classification, segmentation, localization, object recognition and detection 28 ; 5 ; 45 ; 20 ; 46 . Despite many performance breakthroughs, deep learning is notoriously known for its black-box nature, which hinders its applicability in safety-critical applications such as medical MID. The objective of this research is to devise a method for enabling deep learning to be interpretable. The interpretability is introduced in the Section 1.2 . Figure 2: Illustration of Convolution Neural Network 1.2 Interpretability The interpretable or explainable model is a computational model whose decisions could be understandable to humans and justified logically 36 ; 34 . Although there is no universally agreed-upon single definition of interpretability, different researchers have defined it differently. One of the best definitions provided by an interdisciplinary conference known as FAT (Fairness, Accountability and Transparency) to ensure that the decisions of the model, along with the data that drives those decisions, are explainable to end-users, even if they are non-technical 19 . In 31 , the researcher states that a model is interpretable if it provides trust, causality, transferability, and informativeness to make fair and ethical decisions. A greater extent of interpretability helps us in understanding the reason for a prediction more easily. Interpretability level is deliberated according to the understanding of the prediction by a human being. In recent years, much work has been done in the context of interpretable ML, particularly to address the interpretability and accuracy trade-off 15 ; 16 as shown in the Figure 3 . Figure 3: Accuracy vs Interpretability 1.2.1 Importance The outstanding performance of deep learning-based systems does not ensure the reliability of the model. They are outperforming traditional ML algorithms in certain tasks, but they can’t be trusted unless they provide some human-understandable explanations. Without understanding the decision-making process completely, trusting these models can cost us a lot 55 . Providing justifications or explanations of a model’s decision is vital to gain end-user trust. The dire need for interpretable models has been raised in recent years, particularly when a model which performed very well on training data performs poorly when deployed in the real world. For example, in 55 , a military classifier was used to distinguish between friendly and enemy tanks. It produced excellent results on training and validation data, but performed poorly in a real scenario. Upon investigation, it was found that pictures of friendly tanks were taken on a sunny day, whereas that of enemy tanks was taken on a cloudy day. So, instead of learning the desired features (differentiating between the two tank types), it was classifying on the basis of more prominent features (environmental conditions). A similar situation was faced by the researcher in 44 , when they used a classifier to separate wolves from husky dogs. The classifier was classifying wolves on the basis of background snow rather than other features. In 2016, a study of correctional offender management profiling for alternative sanctions (COMPAS), a widely used criminal profiling tool, showed that the predictions were biased and unreliable 19 . Besides these issues, the European parliament adopted the General Data Protection Regulation (GDPR) 12 in 2018, according to which