Federated Transformer-GNN for Privacy-Preserving Brain Tumor Localization with Modality-Level Explainability

Andrea Protani 1 2 , Riccardo Taiello 1 Marc Molina Van Den Bosch 1 3 , Luigi Serio 1 1 European Organization for Nuclear Research, Geneva, Switzerland 2 Dept. of Neuroscience, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland 3 BCN Medtech, Dept. of Engineering, Universitat Pompeu Fab · 2026

Read Federated Transformer-GNN for Privacy-Preserving Brain Tumor Localization with Modality-Level Explainability by Andrea Protani 1 2 , Riccardo Taiello 1 Marc Molina Van Den Bosch 1 3 , Luigi Serio 1 1 European Organization for Nuclear Research, Geneva, Switzerland 2 Dept. of Neuroscience, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland 3 BCN Medtech, Dept. of Engineering, Universitat Pompeu Fab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15042.txt.

Introduction

Andrea Protani, Riccardo Taiello, and co-authors locate brain tumors without pooling patient scans. Their 2026 arXiv paper deals with a hard fact of medical AI. Models need large, varied datasets, but scans sit locked in separate hospitals under privacy rules.

The team builds a federated learning framework instead. Each site trains on its own scans, and only model updates travel. Their design joins a transformer with a graph neural network. It also explains itself at the level of imaging modality, so users can see which scan type drove each single call.

Catalog record

CREATORAndrea Protani 1 2 , Riccardo Taiello 1 Marc Molina Van Den Bosch 1 3 , Luigi Serio 1 1 European Organization for Nuclear Research, Geneva, Switzerland 2 Dept. of Neuroscience, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland 3 BCN Medtech, Dept. of Engineering, Universitat Pompeu Fab
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15042

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Federated Transformer-GNN for Privacy-Preserving Brain Tumor Localization with Modality-Level Explainability Andrea Protani 1 2 , Riccardo Taiello 1 Marc Molina Van Den Bosch 1 3 , Luigi Serio 1 1 European Organization for Nuclear Research, Geneva, Switzerland 2 Dept. of Neuroscience, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland 3 BCN Medtech, Dept. of Engineering, Universitat Pompeu Fabra, Barcelona, Spain { andrea.protani, riccardo.taiello, marc.molina.van.den.bosch, Luigi.Serio } @cern.ch Abstract Deep learning models for brain tumor analysis require large and diverse datasets that are often siloed across healthcare institutions due to privacy regulations. We present a federated learning framework for brain tumor localization that enables multi-institutional collaboration without sharing sensitive patient data. Our method extends a hybrid Transformer-Graph Neural Network architecture derived from prior decoder-free supervoxel GNNs and is deployed within CAFEIN ® , CERN’s federated learning platform designed for healthcare environments. We provide an explainability analysis through Transformer attention mechanisms that reveals which MRI modalities drive the model predictions. Experiments on the BraTS dataset demonstrate a key finding: while isolated training on individual client data triggers early stopping well before reaching full training capacity, federated learning enables continued model improvement by leveraging distributed data, ultimately matching centralized performance. This result provides strong justification for federated learning when dealing with complex tasks and high-dimensional input data, as aggregating knowledge from multiple institutions significantly benefits the learning process. Our explainability analysis, validated through rigorous statistical testing on the full test set (paired t-tests with Bonferroni correction), reveals that deeper network layers significantly increase attention to T2 and FLAIR modalities ( p < 0.001 p<0.001 , Cohen’s d d =1.50), aligning with clinical practice. 1 INTRODUCTION Brain tumors represent a significant diagnostic challenge requiring accurate localization for treatment planning [ 15 ] . Multimodal magnetic resonance imaging (MRI) provides complementary information through T1-weighted, T1-weighted contrast-enhanced (T1ce), T2-weighted, and T2-FLAIR sequences, each capturing distinct tissue characteristics essential for tumor delineation [ 2 ] . While deep learning has achieved remarkable success in brain tumor segmentation [ 9 ] , developing robust models requires large, diverse training datasets. However, medical imaging data is inherently distributed across healthcare institutions, and sharing patient data raises significant privacy, legal, and ethical concerns [ 21 ] . This data fragmentation limits the development of generalizable AI models and hinders multi-institutional research collaboration. Federated learning (FL) addresses this challenge by enabling collaborative model training without centralizing sensitive data [ 14 ] . Rather than sharing patient records, institutions exchange only model parameters, preserving patient privacy while benefiting from collective learning. This paradigm has shown promise in medical imaging applications [ 26 ] , though challenges remain regarding model interpretability and the impact of data heterogeneity across institutions. Equally critical for clinical adoption is model explainability. Clinicians require transparent AI systems that provide insights into decision-making processes. Attention-based mechanisms in Transformers offer a natural way to understand which input features contribute most to predictions, enabling interpretation of how different MRI modalities influence tumor detection. Building upon previous work on decoder-free supervoxel GNNs for brain tumor localization [ 20 ] , this paper makes two primary contributions: 1. Federated Learning Framework: We deploy our Transformer-GNN architecture using CAFEIN ® [ 4 , 23 ] , CERN’s federated learning platform designed for healthcare applications, demonstrating that federated training significantly outperforms isolated learning on individual client data. While isolated training triggers early stopping due to limited data capacity, federated learning enables continued model improvement, ultimately matching centralized performance. This provides compelling evidence for federated approaches when handling complex medical imaging tasks. 2. Modality-Level Explainability: We analyze Transformer attention patterns with rigorous statistical validation (ANOVA, paired t-tests with Bonferroni correction, full test set) to reveal which MRI modalities the model prioritizes for tumor detection. We demonstrate statistically significant layer-dependent attention shifts toward T2 and FLAIR modalities ( p<0.001 , Cohen’s d =1.50), providing clinically meaningful insights that align with radiological practice. 2 RELATED WORK 2.1 Deep Learning for Brain Tumor Segmentation The Brain Tumor Segmentation (BraTS) challenge has driven significant advances in automated tumor delineation [ 15 , 2 ] . Encoder-decoder architectures dominate current approaches, with nnU-Net [ 9 ] establishing strong baselines through automated architecture search and preprocessing optimization. Myronenko [ 18 ] introduced autoencoder regularization to improve generalization, winning the BraTS 2018 challenge. The emergence of Vision Transformers (ViT) [ 6 ] has catalyzed new approaches in medical imaging [ 25 ] . TransUNet [ 5 ] pioneered the combination of CNN encoders with Transformer layers for medical image segmentation. Swin-UNETR [ 8 ] adapted hierarchical Swin Transformers specifically for brain tumor segmentation, achieving state-of-the-art results on BraTS benchmarks. TransBTS [ 30 ] demonstrated effective multimodal fusion through Transformer attention mechanisms. 2.2 Graph Neural Networks for Medical Imaging Graph-based representations offer advantages for modeling irregular anatomical structures [ 19 ] . Supervoxel methods reduce computational complexity while preserving boundary information: SLIC [ 1 ] provides efficient clustering, while content-aware approaches better capture tissue boundaries [ 27 ] . Graph Attention Networks, particularly GATv2 [ 3 ] , enable dynamic attention over graph neighborhoods, with Laplacian positional encodings capturing topological structure [ 7 ] . Recent approaches have combined patch-level Transformers with supervoxel-level GNNs, demonstrating that decoder-free architectures can achieve competitive localization performance. 2.3 Federated Learning in Healthcare Federated learning enables privacy-preserving collaboration across institutions [ 21 , 10 ] . McMahan et al. [ 14 ] introduced FedAvg for communication-efficient distributed training, where clients perform local optimization and periodically synchronize with a central server. The standard FedAvg protocol aggregates client model updates through weighted averaging: \mathbf{w}^{(t+1)}=\sum_{k=1}^{K}\frac{n_{k}}{\sum_{j=1}^{K}n_{j}}\mathbf{w}_{k}^{(t+1)} (1) where \mathbf{w}_{k}^{(t+1)} represents the updated weights from client k after local training on n_{k} samples. Theoretical analysis established convergence guarantees under non-IID distributions [ 12 ] , while FedProx [ 11 ] addressed heterogeneity through proximal regularization. For brain tumor analysis, Sheller et al. [ 26 ] demonstrated that federated models can match centralized performance while preserving patient privacy, motivating multi-institutional collaboration without data sharing. Recent work has further validated MQTT-based decentralized FL frameworks for brain tumor segmentation in clinical settings [ 28 ] . 2.4 Explainability in Medical AI Clinical adoption of AI requires transparent decision-making [ 22 ] . For convolutional neural networks, Grad-CAM [ 24 ] has become the de facto standard for generating visual explanations through gradient-weighted class activation mapping. Recent work has investigated explainability under differential privacy constraints in federated settings, revealing that privacy-preserving noise can significantly degrade explanation fidelity, particularly for heterogeneous clients [ 17 ] . For Transformer architectures, the self-attention mechanism [ 29 ] provides inherent interpretability by revealing which input tokens influence predictions. In multimodal medical imaging, analyzing attention weights from the CLS token quantifies each modality’s contribution, enabling validation against clinical knowledge about imaging sequence informativeness for specific diagnostic tasks. 3 METHODS 3.1 Supervoxel Graph Representation Figure 1: Supervoxel graph preprocessing pipeline: (a) Input MRI modalities; (b) 3D SLIC supervoxel generation applied to T1; (c) Graph construction connecting each supervoxel to its k-nearest neighbors; (d) Patch extraction within each supervoxel for multimodal feature encoding. We adopt the supervoxel-based graph representation introduced in prior work [ 20 ] , illustrated in Figure 1 . Each BraTS volume comprises four co-registered MRI modalities (T1, T1ce, T2, FLAIR) stored at

Read the complete text