Encoding of Demographic and Anatomical Information in Chest X-Ray-based Severe Left Ventricular Hypertrophy Classifiers
Basudha Pal, Rama Chellappa, Muhammad Umair · 2025
Read Encoding of Demographic and Anatomical Information in Chest X-Ray-based Severe Left Ventricular Hypertrophy Classifiers by Basudha Pal, Rama Chellappa, Muhammad Umair (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03192.txt.
Introduction
Basudha Pal and co-authors audit what chest X-ray heart classifiers secretly learn. Their framework predicts severe left ventricular hypertrophy straight from the chest film. It skips anatomical measurements and demographic inputs entirely, yet scores high on standard accuracy measures. The audit then asks what else the network encodes. A mutual information estimator measures how strongly hidden features carry demographic and anatomical attributes.
The encoding turns out to be clinically meaningful, not random leakage. The network rediscovers body and patient traits that bear on heart size. Making that encoding visible supports transparent interpretation, the authors argue. A black box that grades hearts should be able to show its influences. The study offers a template for such checkups.
Catalog record
| CREATOR | Basudha Pal, Rama Chellappa, Muhammad Umair |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03192
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Encoding of Demographic and Anatomical Information in Chest X-Ray-based Severe Left Ventricular Hypertrophy Classifiers Basudha Pal, Rama Chellappa, Muhammad Umair Abstract While echocardiography and MRI are clinical standards for evaluating cardiac structure, their use is limited by cost and accessibility. We introduce a direct classification framework that predicts severe left ventricular hypertrophy from chest X-rays, without relying on anatomical measurements or demographic inputs. Our approach achieves high AUROC and AUPRC, and employs Mutual Information Neural Estimation to quantify feature expressivity. This reveals clinically meaningful attribute encoding and supports transparent model interpretation. Early detection of left ventricular (LV) abnormalities such as severe hypertrophy (SLVH) is essential for cardiovascular risk management Heidenreich et al. 2022 . Conventionally, echocardiography remains the clinical standard for assessing left ventricular (LV) structure Cheitlin et al. 1997 . However, its use is typically confined to individuals with a high pretest probability, in part due to reliance on specialized equipment and operator expertise Heidenreich et al. 1999 . While cardiac magnetic resonance imaging (MRI) provides accurate and reproducible assessments of myocardial structure and function Khurshid et al. 2021 , its cost, limited availability, and scanning time restricts routine population-level screening. Chest X-rays (CXRs) are widely available in clinical practice, noninvasive, inexpensive, and commonly used as a first-line imaging modality Gurney 1995 . Although chest X-rays (CXRs) lack three-dimensional detail and dynamic imaging capabilities for comprehensive cardiac anatomical assessment, recent deep learning models have demonstrated their ability to extract clinically meaningful information and estimate echocardiographic indices such as IVSDd, LVIDd, and LVPWDd Bhave et al. 2024 . However, directly classifying SLVH from CXRs remains challenging due to the subtle nature of phenotypic changes and 3-dimensional overlap of the modality. Consequently, prior work Bhave et al. 2024 adopts an indirect approach of first performing regression to estimate intermediate anatomical variables such as IVSDd, LVIDd, and LVPWDd, followed by thresholding to determine SLVH status. Additionally, since, clinical thresholds for defining SLVH depend on age and gender, demographic information is explicitly provided to guide a learnable thresholding process and improve predictive alignment with clinical guidelines Lang et al. 2015 . While this strategy can improve predictive performance, it also introduces architectural and conceptual drawbacks. First, it creates vulnerability to error cascading, where inaccuracies in anatomical regression propagate through the model and compromise final classification. Second, explicitly including demographic variables can result in confounding, as these attributes may serve as proxies for the outcome rather than truly independent predictors, thus reducing model transparency and interpretability. These issues make it harder to understand model behavior and raise concerns for clinical deployment, where clarity and robustness are essential. Beyond the risk of error propagation and confounding, from a representation learning perspective, it is preferable to train models directly on the end task Bengio et al. 2013 . A dedicated classification model should learn features for discriminating between SLVH-positive and SLVH-negative cases, potentially offering better alignment with the final diagnostic objective and fewer sources of modeling error while implicitly encoding relevant clinical and demographic attributes. In this work, we propose a simplified yet effective alternative. We introduce a direct classification framework that predicts SLVH status (present or absent) from chest X-rays alone, without relying on intermediate structural predictions or demographic inputs. In this way, we avoid the risks associated with explicitly including anatomical or demographic variables, such as confounding and error propagation, while still aiming for a model that captures clinically meaningful patterns. To verify that our classifier remains aligned with relevant clinical attributes despite not receiving them as inputs, we apply Mutual Information Neural Estimation (MINE) Belghazi et al. 2018 to quantify the relationship between internal feature representations and relevant attributes such as age, sex, IVSDd, LVIDd, and LVPWDd. MINE estimates mutual information by training a neural network discriminator to distinguish joint from independent samples using the Donsker–Varadhan representation Donsker and Varadhan 1975 , making it tractable in high-dimensional settings. This framework has been used to reveal how sensitive attributes are encoded in domains such as face recognition Dhar et al. 2020 and person reidentification Pal et al. 2025 . We adapt it here to examine how clinical and demographic information is encoded across early, mid, and late layers in SLVH classifiers trained without access to those attributes. The resulting score, which we refer to as expressivity, reflects the degree to which each attribute is entangled in the learned representation. Further methodological details are provided in section 1 . This analysis quantifies the extent to which internal feature representations encode key variables such as age, sex, and anatomical measurements like IVSDd and LVPWDd. Although these factors are not part of the model input, they are strongly associated with SLVH and should be reflected in the features learned by an effective model. MINE helps us confirm that the model attends to this underlying structure implicitly, supporting both interpretability and clinical trust without compromising design efficiency or robustness. Our contributions are as follows: • Modeling: We present a direct SLVH classification framework using both convolutional as well as transformer backbones with only chest X-ray images, removing reliance on anatomical regressors and demographic inputs. This improves generalizability and streamlines model design. • Evaluation: We address limitations in prior work by constructing a balanced subset of the CheXchoNet dataset, enabling improved discriminative performance and reliable benchmarking. Performance is assessed using AUROC and AUPRC. • Interpretability: We apply MINE to estimate mutual information between internal features and clinical attributes, enabling quantitative analysis of attribute encoding without requiring explicit supervision. This supports a more interpretable and clinically aligned deployment of deep learning models. To our knowledge, this is the first study to propose a direct classification framework for detecting SLVH from chest X-rays, bypassing the need for intermediate anatomical modeling or demographic inputs. Moreover, we are the first to introduce MINE as a tool for analyzing internal representations in deep learning based cardiac imaging. Beyond the specific application to SLVH classification, MINE represents a generalizable framework for quantifying feature–attribute relationships in deep learning models. Its ability to uncover clinically meaningful correlations makes it particularly well suited for advancing interpretability in cardiac imaging and other domains of clinical computer vision. Figure 1: SLVH classification performance shown via Left: PR and Right: ROC curves for ResNet and ViT backbones. Figure 2: Attribute-wise expressivity across layers for Left: ViT and Right: ResNet backbones. The standard deviation of each of the curves is denoted by the shaded region. We demonstrate that SLVH can be directly classified from chest X-rays using deep neural network backbones without reliance on intermediate anatomical regressors or demographic inputs. The current baseline Bhave et al. 2024 , which predicts SLVH by regressing echocardiographic measurements followed by thresholding, achieves high AUROC (0.79 [95% CI: 0.76–0.81]) but suffers from poor AUPRC (0.19 [95% CI: 0.15–0.22]) due to class imbalance. Fine-tuning pretrained models on our curated class-balanced dataset yields strong performance across both convolutional and transformer-based architectures. Specifically, our pretrained Vision Transformer (ViT) backbone achieves the best AUROC of 0.816 [95% CI: 0.781, 0.850], and an AUPRC of 0.803 [95% CI: 0.755, 0.849], while a ResNet-18 backbone achieves AUROC of 0.760 [95% CI: 0.718, 0.802], and an AUPRC of 0.731[95% CI: 0.669, 0.786] as seen in Fig 1 . These results suggest that the