Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification

Thamara Leandra de Deus Melo 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André R. Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz · 2026

Read Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification by Thamara Leandra de Deus Melo 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André R. Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12671.txt.

Introduction

Thamara Leandra de Deus Melo and three co authors, at Brazilian universities, classify brain tumors in MRI scans. Early tumor diagnosis is crucial for good treatment outcomes. Diagnosis is hard because lesions vary a lot and images are complex. The team evaluate convolutional neural networks in a federated learning setting, so data can stay at each hospital.

They compare models trained on original scans against preprocessed ones. Preprocessing includes resizing, grayscale conversion, normalization, filtering, and histogram equalization. They also exploit test time augmentation, a trick that averages views of a scan at test time. The study asks which pipeline choices pay off under federation. Answers guide clinics that cannot pool patient images.

Catalog record

CREATORThamara Leandra de Deus Melo 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André R. Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12671

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification Thamara Leandra de Deus Melo 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André R. Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil { thamara.melo, rodrigo, larissa.f.rodrigues } @ufv.br, [email protected] Abstract Efficient brain tumor diagnosis is crucial for early treatment; however, it is challenging because of lesion variability and image complexity. We evaluated convolutional neural networks (CNNs) in a federated learning (FL) setting, comparing models trained on original versus preprocessed MRI images (resizing, grayscale conversion, normalization, filtering, and histogram equalization). Preprocessing alone yielded negligible gains; combined with test-time augmentation (TTA), it delivered consistent, statistically significant improvements in federated MRI classification ( p < 0.001 p<0.001 ). In practice, TTA should be the default inference strategy in FL-based medical imaging; when the computational budget permits, pairing TTA with light preprocessing provides additional reliable gains. 1 INTRODUCTION Brain tumors are among the most aggressive neurological disorders with high morbidity and mortality. Diagnosis is difficult because lesions exhibit heterogeneous morphologies, variable intensity profiles, and complex appearances on MRI ( MRI ) ( Stupp et al., 2005 ; Louis et al., 2021 ; Carmo et al., 2025 ) . Although MRI is the gold standard for noninvasive assessment, interpretation depends on specialist expertise, which introduces variability and limits scalability in routine clinical practice ( Wen and Butler, 2020 ) . Recent advances in AI ( AI ), particularly in CNN ( CNN )-based models, have improved automated tumor assessment by learning discriminative features directly from images ( Goodfellow et al., 2016 ; Rodrigues et al., 2017 ; Rodrigues Moreira et al., 2025 ) . However, privacy regulations and institutional policies often preclude centralizing of patient data across hospitals. FL ( FL ) addresses this barrier by training shared models locally at each site without exposing raw data, promoting generalization across heterogeneous cohorts while preserving confidentiality ( McMahan et al., 2017 ; Konečný et al., 2016 ; Rodrigues et al., 2025 ) . Despite the growing use of FL in medical imaging, the impact of common preprocessing pipelines on federated performance for brain tumor MRI classification remains unclear. Standard operations (e.g., resizing, grayscale conversion, normalization, filtering, and histogram equalization) may harmonize inputs across clients; however, they can also suppress subtle, clinically relevant cues. At the same time, the potential of TTA ( TTA ) at inference, known to reduce prediction variance in centralized settings, has not been examined under federated conditions, where client heterogeneity (scanners, protocols, and demographics) is the norm ( Wang et al., 2019 ; Islam et al., 2024 ) . TTA is model-agnostic, requires no retraining, and can be deployed unilaterally at inference time by each client, all of which are attractive properties in FL where retraining is costly, communication budgets are tight, and data cannot be pooled. If effective, TTA offers a low-overhead mechanism to improve robustness and stabilize predictions against interclient distribution shifts and small-sample effects without modifying the federated optimization process. Guided by the gaps identified, we raise the following research questions (RQs) to structure our investigation: • RQ1: Does preprocessing help or hinder brain-tumor classification in FL when compared with training on original (minimally processed) MRI images? • RQ2: To what extent does TTA improve prediction robustness and accuracy during federated inference across heterogeneous clients? This study addresses these gaps by proposing an FL framework for brain tumor MRI classification that compares original and preprocessed images and integrates TTA during inference. Our contributions are as follows: (i) we evaluate the influence of preprocessing pipelines on federated performance, (ii) we exploit TTA to enhance prediction stability and accuracy, and (iii) quantify effects via statistical hypothesis testing. Our results show that preserving native MRI characteristics yields better federated performance than aggressively preprocessed inputs and that TTA provides a consistent, low-cost robustness boost. These findings provide practical data-retentive design choices for decentralized medical AI systems. The remainder of this paper is organized as follows. Section 2 reviews related work. Section 3 describes the proposed method, including the MRI dataset, preprocessing pipeline, federated setup, and integration of TTA . Section 4 presents and discuss the experimental results. Finally, Section 5 concludes the paper and outlines future research directions. 2 RELATED WORK The detection and classification of brain tumors in MRI images has been the subject of extensive investigation, given the severity of this condition and the need for early and accurate diagnoses. Machine learning and deep learning techniques have been prominently applied in this context, especially CNNs ( CNNs ), which have proven efficient in extracting discriminative patterns in medical images Solanki et al., 2023 ; Siddique et al., 2022 . Shah et al., 2022 presented a model based on the EfficientNet-B0 architecture for brain tumor classification, combined with fine-tuning techniques and data augmentation. The authors compared the model with traditional architectures such as VGG16, InceptionV3, Xception, ResNet50, and InceptionResNetV2. The proposed model outperformed all baselines, achieving an accuracy of 98.87% and an AUC of 0.988. Khaliki and Başarslan, 2024 compared the performance of conventional CNNs and pretrained models such as VGG19, EfficientNetB4, and InceptionV3 on Kaggle dataset images. The results demonstrated that the use of transfer learning significantly improves classification, particularly in scenarios with limited datasets. Kaur and Mahajan, 2025 explored the use of ResNet152 and GoogleNet for feature extraction, combined with traditional classifiers such as SVM, KNN, CART, and GNB. The pipeline also included preprocessing, PCA, and data augmentation. The study achieved an accuracy of 98.53% and an F1-score of 97.4%, highlighting the relevance of image preparation and architectural choice for consistent results. In the field of FL , Zhou et al., 2024 demonstrated the feasibility of decentralized training across multiple medical institutions using the BRATS dataset. The study evaluated several CNNs, including ResNet50, VGG16, EfficientNet, and AlexNet, achieving accuracy above 95%. Similarly, Albalawi et al., 2024 integrated FL and transfer learning with a modified VGG16, obtaining 98% accuracy and an F1-score above 0.95 while preserving the privacy of sensitive data. Thus, the literature highlights significant advances in brain tumor classification in both centralized and distributed scenarios. Unlike the aforementioned works, this study focuses on comparing original and preprocessed images in a FL environment, using ResNet18 to evaluate the impact of preprocessing on classification performance. Table 1 summarizes the main characteristics of the mentioned studies on brain tumor MRI classification. To improve readability, the table uses a checklist notation: ✓indicates that the feature or technique was explicitly employed in the study, whereas \times indicates its absence. This compact format allows direct comparison of datasets, model backbones, preprocessing, FL usage, and evaluation metrics. Table 1: Comparison with related work. Work Dataset Method Pre/Aug. FL Metrics Shah et al., 2022 BRATS 2015 EfficientNet-B0 ✓ \times Acc, AUC Jiang et al., 2022 BRATS 2019–21 3D Swin Transformer ✓ \times Dice, HD Khaliki and Başarslan, 2024 Kaggle (MRI) VGG19, EfficientNetB4, InceptionV3 ✓ \times Acc, F1, AUC Shaikh et al., 2025 BRATS 2020–23 Ensemble of CNNs ✓ \times Acc, F1, Dice Kaur and Mahajan, 2025 Br35 (Kaggle) ResNet152, GoogleNet ✓ \times Acc, F1 Zhou et al., 2024 BRATS

Read the complete text