An Interpretable Representation Learning Approach for Diffusion Tensor Imaging
Vishwa Mohan Singh \midljointauthortext Contributed equally 1,2, Alberto Gaston Villagran Asiares 2, Luisa Sophie Schuhmacher 2, Kate Rendall \midlotherjointauthor 2, Simon Weißbrod \midlotherjointauthor 2, David Rügamer 1,3, Inga Körte 2,4,5 · 2025
Read An Interpretable Representation Learning Approach for Diffusion Tensor Imaging by Vishwa Mohan Singh \midljointauthortext Contributed equally 1,2, Alberto Gaston Villagran Asiares 2, Luisa Sophie Schuhmacher 2, Kate Rendall \midlotherjointauthor 2, Simon Weißbrod \midlotherjointauthor 2, David Rügamer 1,3, Inga Körte 2,4,5 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19110.txt.
Introduction
Brain scans that trace white matter bundles are rich but hard for learning models to read, and harder still for doctors to interpret. A seven-author team turns the problem sideways in 2025: each bundle's quality score becomes one pixel, and the whole scan becomes a tiny nine-by-nine picture. An autoencoder squeezes that picture into a compact code. Special training keeps the code's axes separate, so each one can mean something on its own.
Against one-dimensional baselines the picture code wins clearly, lifting a sex classification score by about 16 percent. It also separates its factors more cleanly than a full 3D version. The authors present the trick as a path to brain models doctors can actually read.
Catalog record
| CREATOR | Vishwa Mohan Singh \midljointauthortext Contributed equally 1,2, Alberto Gaston Villagran Asiares 2, Luisa Sophie Schuhmacher 2, Kate Rendall \midlotherjointauthor 2, Simon Weißbrod \midlotherjointauthor 2, David Rügamer 1,3, Inga Körte 2,4,5 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-19110
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Interpretable Representation Learning Approach for Diffusion Tensor Imaging Vishwa Mohan Singh \midljointauthortext Contributed equally 1,2, Alberto Gaston Villagran Asiares 2, Luisa Sophie Schuhmacher 2, Kate Rendall \midlotherjointauthor 2, Simon Weißbrod \midlotherjointauthor 2, David Rügamer 1,3, Inga Körte 2,4,5 Abstract Diffusion Tensor Imaging (DTI) tractography offers detailed insights into the structural connectivity of the brain, but presents challenges in effective representation and interpretation in deep learning models. In this work, we propose a novel 2D representation of DTI tractography that encodes tract-level fractional anisotropy (FA) values into a 9 × \times 9 grayscale image. This representation is processed through a Beta-Total Correlation Variational Autoencoder ( β \beta -TCVAE) with a Spatial Broadcast Decoder to learn a disentangled and interpretable latent embedding. We evaluate the quality of this embedding using supervised and unsupervised representation learning strategies, including auxiliary classification, triplet loss, and SimCLR-based contrastive learning. Compared to the 1D Group deep neural network (DNN) baselines, our approach improves the F1 score in a downstream sex classification task by 12.64% and shows a better disentanglement than the 3D representation. \jmlrpages \midlauthor \orcid 0000-0003-1672-1390 1 Department of Statistics, Ludwig-Maximilians-Universität München, Germany 2 cBRAIN, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, Ludwig-Maximilians-Universität München, Germany. 3 Munich Center for Machine Learning, Munich, Germany. 4 Psychiatry Neuroimaging Laboratory, Mass General Brigham Academic Medical Centers, Psychiatry Department, Boston, MA, USA. 5 Harvard Medical School, Boston, MA, USA † † proceedings: MIDL: Medical Imaging with Deep Learning † † year: 2025 † † workshop: Short Paper – MIDL 2025 † † editors: Accepted for publication at MIDL 2025 keywords Diffusion Tensor Imaging, Autoencoders, Representation Learning 1 Introduction Diffusion Tensor Imaging (DTI) tractography is a non-invasive technique that models white matter fiber bundles in the brain Buyanova and Arsalidou 2021 ; Jelescu and Budde 2017 . It has become increasingly crucial for studying neurodevelopment, aging, and neurological diseases Sundgren et al. 2004 . However, effectively representing the complex geometry and connectivity information in DTI tractography remains a challenge in analysis. Methodologies using 1-dimensional representation often disregard spatial context, while the complex 3D architecture lacks interpretability (Related works in Appendix B ). To address this, we propose a novel 2D representation of DTI tractography that maintains critical spatial information while remaining amenable to deep learning techniques. Specifically, we transform tract-level fractional anisotropy (FA) values into a 9 \times 9 grid format, where each pixel encodes the FA value of one tract. From this grid, we learn a disentangled class-aware representation using a combination of a Disentangled VAE and representation learning strategies. This representation is meant to be used in a late-fusion multi-modal architecture to analyze different MRI Modalities. 2 Methodology 2.1 Dataset and Representation Data was collected from young adult amateur soccer players with at least 5 years of organized training (46 males and 23 females), and control athletes engaged in non-contact sports (11 males and 25 females). On this, we use sex classification as our downstream task. For postprocessing, we use WMA800 O’Donnell and Westin 2007 ; O’Donnell et al. 2012 to divide the white matter fibers into 74 different anatomical tracts based on the ORG-800FC-100HCP atlas Zhang et al. 2018 . We convert this WMA output to a compact 2D representation of DTI tractography. The 74 tracts are arranged in a 9 \times 9 grid using Multi-Dimensional Scaling Mead 1992 to preserve distance. After finding the grid coordinates, we use the Hungarian algorithm to solve the overlap between several centroids (See Appendix Algorithms D and D ). 2.2 Autoencoder and Representation Learning The core of our model is a variational autoencoder Kingma et al. 2013 . The encoder compresses the 9 \times 9 FA image into a latent vector of size 32 and a spatial broadcast decoder Watters et al. 2019 to make the latent vector retain spatial coherence. The model is trained using a \beta -TCVAE loss, which encourages disentanglement by penalizing total correlation Chen et al. 2018 . To retain class-relevant information in the latent space, we evaluate three strategies: a supervised auxiliary classifier as a proxy for semantic structure, a triplet loss for preserving local class-wise distances Hoffer and Ailon 2015 , and an unsupervised SimCLR loss for learning global latent structure Chen et al. 2020 . The full architecture is shown in Figure . 3 Experiment and Results The following Table shows the results from the models tested. The Disentangled (Dis.) VAE in the table refers to the model using both spatial broadcasting and \beta -TCVAE loss. As controls, we use a 1D deep neural network (DNN), a Grouped DNN, and a 3D Autoencoder, which works on the original centroid position. We compare the separability (Sep) of the latent space using a KNN classifier Dyballa et al. 2024 with k=3 and the metrics from the best classifier from LazyClassifier Pandala and Silva 2019 . We measure the Mutual Information Gap (MIG) Chen et al. 2018 of different regions to evaluate disentanglement. Network Accuracy F1 Sep Recon MIG 1D-DNN 53.90 ( \pm 12.2) 51.15 ( \pm 28.4) - - - 1D Group DNN 65.00 ( \pm 14.0 ) 68.78 ( \pm 15.7) - - - 3D VAE + Aux 82.60 ( \pm 9.4) 82.06 ( \pm 9.7) 77.08 0.0190 0.0344 2D VAE + Aux 80.90 ( \pm 9.5) 80.15 ( \pm 10.1) 81.25 0.0159 0.0503 2D \beta -TCVAE + Aux 81.45 ( \pm 13.5) 81.37 ( \pm 13.4) 83.33 0.0151 0.0535 2D Dis. VAE + Aux 80.09 ( \pm 8.6) 79.74 ( \pm 9.5) 81.25 0.0180 0.0640 2D Dis. VAE + Triplet 77.27 ( \pm 8.6) 77.30 ( \pm 8.1) 81.25 0.0171 0.0739 2D Dis. VAE + SimCLR 81.72 ( \pm 12.0) 81.42 ( \pm 12.3) 70.81 0.0768 0.0588 4 Discussion and Conclusion Along with better disentanglement than 3D, the 2D representation improves over the best 1D model by 12.64% in F1 score, with no significant drop from the 3D equivalent. Interpretation results from SHAP Lundberg and Lee 2017 show that across the subjects, the male subjects show a higher FA value, especially in the left Corona Radiata, Right Superior Longitudinal Fasciculus, and Right Corticospinal Tracts (refer Appendix E Figure ). Some of these align with the findings from previous DL and statistical analyses Menzler et al. 2011 ; Chen et al. 2023 . Further improvements can be made to the architecture’s interpretability by finding a better balance of classification and the Kullback-Leibler term. Additionally, methods like attention Vaswani et al. 2017 or factorization machines Rendle 2010 could be used to model any interactions between the tracts. Appendix A Availability of Code The code used to generate these results is in the following anonymized public repository: https://github.com/SAint7579/DTI_2D_representation Appendix B Related Literature The most common way to pair tractography output with machine learning has been 1D feature-based approaches using models like support vector machines Irimia et al. 2018 . These methods are computationally efficient and interpretable, but suffer from the loss of spatial and geometric information. TractGraphCNN Chen et al. 2023 tries to address this by rearranging the fiber bundles in a graph. More expressive 3D alternatives like TRAFIC Lam et al. 2018 and Deep White Matter Analysis Zhang et al. 2020 representations, on the other hand, make the model harder to interpret. Autoencoders,