Fairness and Robustness of CLIP-Based Models for Chest X-rays
Théo Sourget, David Restrepo, Céline Hudelot, Enzo Ferrante, Stergios Christodoulidis, Maria Vakalopoulou · 2025
Read Fairness and Robustness of CLIP-Based Models for Chest X-rays by Théo Sourget, David Restrepo, Céline Hudelot, Enzo Ferrante, Stergios Christodoulidis, Maria Vakalopoulou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21291.txt.
Introduction
Théo Sourget and five co-authors test fairness and strength in AI models that read chest X-rays with text, in a 2025 paper. Such models score well on scans paired with doctor notes. Yet whether they treat age, sex, and race groups even-handedly was little studied. Shortcut learning, where a model keys on the wrong clue, was also a worry.
Six models were tested on three public scan sets across six chest states. Gaps showed by age, while sex and race results were more even. All models did worse on lung collapse scans without chest drains, a hint they leaned on the drain as a clue. Hidden model codes also carried group traits that plots failed to show.
Catalog record
| CREATOR | Théo Sourget, David Restrepo, Céline Hudelot, Enzo Ferrante, Stergios Christodoulidis, Maria Vakalopoulou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21291
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fairness and Robustness of CLIP-Based Models for Chest X-rays Théo Sourget, David Restrepo, Céline Hudelot, Enzo Ferrante, Stergios Christodoulidis, Maria Vakalopoulou Abstract Motivated by the strong performance of CLIP-based models in natural image-text domains, recent efforts have adapted these architectures to medical tasks, particularly in radiology, where large paired datasets of images and reports, such as chest X-rays, are available. While these models have shown encouraging results in terms of accuracy and discriminative performance, their fairness and robustness in the different clinical tasks remain largely underexplored. In this study, we extensively evaluate six widely used CLIP-based models on chest X-ray classification using three publicly available datasets: MIMIC-CXR, NIH-CXR14, and NEATX. We assess the models fairness across six conditions and patient subgroups based on age, sex, and race. Additionally, we assess the robustness to shortcut learning by evaluating performance on pneumothorax cases with and without chest drains. Our results indicate performance gaps between patients of different ages, but more equitable results for the other attributes. Moreover, all models exhibit lower performance on images without chest drains, suggesting reliance on spurious correlations. We further complement the performance analysis with a study of the embeddings generated by the models. While the sensitive attributes could be classified from the embeddings, we do not see such patterns using PCA, showing the limitations of these visualisation techniques when assessing models. Our code is available at https://github.com/TheoSourget/clip_cxr_fairness 1 Introduction Deep learning models that have been trained on large-scale chest X-ray datasets have achieved performances reaching expert-levels in disease classification of X-ray images [ 10 , 22 ] . However, despite such models obtaining strong benchmark performance, different studies show that they often exhibit performance disparities across patient subgroups, revealing concerning biases. For example, studies like [ 9 , 14 ] show how the performance of convolutional neural networks (CNN) can vary based on demographic attributes such as age, sex, or race, particularly for X-rays. Beyond performance differences, there is growing evidence that deep learning models encode sensitive demographic information in their internal representations. Previous studies like [ 1 , 19 ] are able to predict sensitive attributes from the embedding generated by pretrained models. Similarly, Gichoya et al. [ 8 ] demonstrate that deep learning models can classify patient race, even when the input images are heavily corrupted, raising serious concerns about the implicit encoding of sensitive information and its fairness implications. Additionally, other studies show the impact of artefacts, also called shortcuts, in the classification. Jiménez-Sánchez et al. [ 11 ] and Oakden et al. [ 18 ] show that models for pneumothorax classification have lower performances on images without chest drains, a common treatment for this disease. Moreover, Sourget et al. [ 23 ] demonstrate the ability of the models to obtain good performances in chest X-rays classification while masking out the lungs in the image, showing how these models can rely on non-relevant features. More recently, advances in multimodal and foundation models have led to the development of contrastively trained architectures that jointly leverage chest X-rays and radiology reports [ 2 , 3 , 5 , 24 , 26 , 28 ] . While these vision-language models (VLMs) have demonstrated promising results, recent studies have raised concerns regarding the fairness of VLMs. Luo et al. [ 16 ] assess the fairness of the original CLIP and BLIP2 models on glaucoma classification pretrained with both natural domain and medical data, showing differences across subgroups especially on the natural domain models. Yang et al. [ 27 ] evaluate the fairness of the CheXzero model [ 24 ] for chest X-ray classification, showing the gap in performances between different subgroups. Finally, Fay et al. [ 7 ] compare the performances of multiple zero-shot and training-based strategies for the MedImageInsight model [ 5 ] on pneumonia classification and include an assessment of their fairness, showing that zero-shot techniques present less bias compared to linear probing but still higher than with LoRA or k -NN. In this work, we extend these studies by evaluating a large set of CLIP-based models pretrained on X-ray data, providing complementary analysis of the embedding representations, and assessing the robustness of the models to shortcut learning. Our empirical study, aiming at improving the understanding of the biases of CLIP-based models for chest X-rays classification: 1) evaluates the performance of six widely used CLIP-based vision-language models on the multilabel classification of chest X-rays; 2) assesses the fairness of the architectures on multiple subgroups of patients; 3) studies the potential encoding of sensitive attributes in the embedding of these models with visualisation and classification techniques; 4) compares their robustness regarding shortcuts on pneumothorax classification with and without chest drains. 2 Fairness and Robustness of CLIP-based Models 2.1 Evaluation protocol on zero-shot classification We evaluate the performance of the models on different subgroups in a zero-shot classification setting. Inspired by the setups of [ 7 , 24 ] , we compute for each label the similarities between the embeddings of an image and two templates "Chest {CLASS}" and "Chest No Findings". We then apply a softmax function between the two similarities to obtain the probability of the disease. We evaluate the models across individual diseases and demographic subgroups (sex, race, and age) to assess both overall discriminative performance and subgroup fairness, quantified by performance disparities. We also assess whether the models rely on non-clinically relevant image features. To this end, we evaluate their performance for pneumothorax classification on two groups: one in which all patients with pneumothorax have chest drains, and the other in which they never have one. Finally, we compute calibration curves for this task using the softmax values from the zero-shot classification to examine the reliability of the predicted probabilities. We use the area under the receiver operating characteristic (AUC) and the adjusted area under the precision-recall curve (AUPRC adj ), which is usually adopted to evaluate models in a highly imbalanced scenario [ 17 ] . The AUPRC adj is defined as 1-\frac{log(\text{AUPRC})}{log(\text{AUPRC}_{rng})} with \text{AUPRC}_{rng} being the ratio between the number of positive samples for a class and the total number of samples. 2.2 Encoding of sensitive attributes in the embedding space To further understand how these models work and what they learn in this multimodal contrastive setting, we generate and visualise the obtained image and text embeddings. For textual embeddings, as the text encoders have a limited input size, we only use the "FINDINGS" section from radiology reports, likely to contain the most relevant information. To assess the encoding of sensitive attributes, we use PCA to project the embeddings in two dimensions, revealing potential patterns with respect to patient sex, race, and age. We also train a model to classify the different sensitive attributes from the image embeddings using simple models like a linear probe (LP), a k -nearest neighbours ( k -NN) classifier and a single-hidden-layer multi-layer perceptron (MLP). We split the original test sets in train, validation, and test subsets, ensuring that all images from a given patient are assigned to the same split to prevent data leakage. We used the validation set to tune the models’ hyperparameters: the learning rate in the linear probe, the number of nearest neighbours, and the number of neurons of the MLP hidden layer.