Generalizable Hyperparameter Optimization for Federated Learning on Non-IID Cancer Images

Elisa Gonçalves Ribeiro 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André Ricardo Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz · 2026

Read Generalizable Hyperparameter Optimization for Federated Learning on Non-IID Cancer Images by Elisa Gonçalves Ribeiro 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André Ricardo Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12664.txt.

Introduction

Elisa Goncalves Ribeiro and three co authors, at Brazilian universities, study federated learning for cancer images. Deep learning on histopathology images clashes with privacy rules in clinical settings. Federated learning helps by keeping patient data local at each site. Its performance still depends on hyperparameter choices, though.

Client datasets in real federations are not identically distributed. The team ask whether settings tuned on one cancer dataset generalize to others. They test that transfer across non IID federated scenarios. If good settings travel well, hospitals could skip costly local tuning. If not, each site faces its own search. The answer matters for practical medical AI deployment.

Catalog record

CREATORElisa Gonçalves Ribeiro 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André Ricardo Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Braz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12664

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generalizable Hyperparameter Optimization for Federated Learning on Non-IID Cancer Images Elisa Gonçalves Ribeiro 1 , Rodrigo Moreira 1 , Larissa Ferreira Rodrigues Moreira 1 , André Ricardo Backes 2 1 Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil 2 Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil { elisa.ribeiro, rodrigo, larissa.f.rodrigues } @ufv.br, [email protected] Abstract Deep learning for cancer histopathology training conflicts with privacy constraints in clinical settings. Federated Learning (FL) mitigates this by keeping data local; however, its performance depends on hyperparameter choices under non-independent and identically distributed (non-IID) client datasets. This paper examined whether hyperparameters optimized on one cancer imaging dataset generalized across non-IID federated scenarios. We considered binary histopathology tasks for ovarian and colorectal cancers. We perform centralized Bayesian hyperparameter optimization and transfer dataset-specific optima to the non-IID FL setup. The main contribution of this study is the introduction of a simple cross-dataset aggregation heuristic by combining configurations by averaging the learning rates and considering the modal optimizers and batch sizes. This combined configuration achieves a competitive classification performance. 1 INTRODUCTION Cancer remains a leading global health burden, with projections of approximately 28.4 million new cases by 2040, and 35 million by 2050, representing increases of approximately 47% and 77%, respectively. Colorectal and ovarian cancers are particularly relevant, with colorectal cancer accounting for more than 1.9 million new cases and 930,000 deaths worldwide annually. Ovarian cancer causes approximately 314,000 new cases and 207,000 deaths annually and is frequently diagnosed at advanced stages, leading to high mortality rates ( Morgan et al., 2022 ; Roshandel et al., 2024 ; Bray et al., 2024 ) . Deep learning has arisen as an approach for automated cancer diagnosis based on medical images. In histopathology, CNNs ( CNNs ) and other deep architectures, often initialized with ImageNet weights, can achieve expert-level performance in distinguishing cancerous from non-cancerous tissues ( Rodrigues and Backes, 2025 ) . However, the standard centralized training paradigm, in which large image collections are pooled in a single repository, conflicts with privacy regulations and institutional data governance, and the fact that data are naturally distributed across hospitals and laboratories ( Guan et al., 2024 ) . FL ( FL ) has emerged as an alternative that enables collaborative training without sharing raw data. Institutions keep data on-site and periodically send model updates to a coordinating server, which aggregates them into a global server ( McMahan et al., 2017 ; Rodrigues et al., 2025 ) . FL has been applied to several medical imaging tasks, including brain tumor segmentation, chest X-ray classification, and computational pathology, achieving a performance close to centralized training while preserving data locality ( Guan et al., 2024 ; Rodrigues Moreira et al., 2024 ; Barbosa et al., 2025 ) . However, practical deployment in clinical environments remains challenging because institutional datasets are rarely independent and identically distributed (IID). They differ in size, class balance, acquisition protocols, and patient demographics, which leads to strong non-IID ( non-IID ) client partitions and can degrade convergence and generalization ( Rodrigues et al., 2025 ) . In addition, FL models are sensitive to hyperparameter tuning, and hyperparameters tuned for one site or dataset may transfer poorly to others, particularly under non-IID conditions. Existing studies on HPO ( HPO ) for FL often focus on a single dataset or assume fixed, task-specific configurations ( Kuo et al., 2023 ; Kundroo and Kim, 2024 ) ; thus, obtaining hyperparameter configurations that generalize across non-IID federated cancer-imaging scenarios remains an open question. In this paper, we address this gap by studying whether hyperparameters optimized on one cancer imaging dataset can be generalized across non-IID federated scenarios and across tumor types. We designed a two-phase pipeline that (i) performs centralized Bayesian HPO with the TPE ( TPE ) on two binary histopathology tasks (ovarian and colon cancer) and (ii) transfers and combines the resulting configurations in a non-IID FL setup based on FedAvg ( FedAvg ). By comparing multiple CNN architectures under ovary-optimized, colon-optimized, and combined hyperparameter schemes, we assessed how these choices affect federated performance and whether simple combined configurations can act as robust strategies that generalize across non-IID federated cancer scenarios. 2 RELATED WORK In this section we review prior work at the intersection of cancer imaging, HPO and federated or privacy preserving learning. Subramanian et al., 2022 addresses privacy-preserving classification of collaborative cancer models across heterogeneous, non-IID datasets. The authors propose a decentralized FL framework using FedAvg and FedProx, coupled with client-server Bayesian HPO and a selective update rule based on local performance improvement. Evaluating MobileNetV3, XceptionV3, and ResNet201 on CT and MRI data of cervical, lung, and colon cancers, they report accuracy, precision, recall, and F1 scores across varying communication rounds. Khan et al., 2024 addresses automated breast cancer detection under privacy constraints and data scarcity. They proposed a decentralized federated framework where hospitals train CNNs using an ant colony optimization-based bilevel strategy for joint hyperparameter and architecture search, exchanging updates via a circular topology. Using the DDSM dataset distributed across three clients for binary classification, they show that the ant colony scheme outperforms particle swarm optimization (PSO) and grid search baselines in terms of accuracy. Tamanini et al., 2025 focuses on efficient endometrioid ovarian carcinoma detection in histopathology images with limited data. The pipeline extracts radiomics features from hematoxylin and eosin images converted into eight color spaces, applying incremental recursive feature elimination before training traditional classifiers and CNN baselines. The study reports that the YCrCb color space with Random Forest achieves nearly 98% accuracy. Yang et al., 2025 addresses data-scarce skin cancer detection in IoT healthcare settings. The authors propose an active learning framework combining a CNN classifier with a reinforcement learning sample selector and an enhanced artificial bee colony algorithm for HPO . Evaluated on ISIC, HAM10000, and PH2 datasets, the approach shows consistent gains in accuracy and memory usage compared to various machine learning and deep learning baselines. Li et al., 2025 optimizes hyperparameters for breast cancer classification to overcome the instability of existing metaheuristics. The authors introduce the Multi-Strategy Parrot Optimizer (MSPO), enhanced with Sobol initialization and chaotic perturbations, to tune a ResNet18 model. Benchmarked against CEC 2022 functions and applied to the BreakHis dataset, the MSPO-tuned model outperforms untuned versions and alternative algorithms in accuracy, precision, recall, and F1 score. Almelibari, 2025 tackles diabetes prediction while addressing privacy, class imbalance, and communication costs. The framework combines a tree-based and neural ensemble with a PSO-based weighting scheme, extended into a privacy-preserving federated architecture. Using SMOTE for class balancing on a public dataset, the study reports that their proposed weighted aggregation yields higher accuracy and communication efficiency. Table 1: Short comparison of the Related Works. Approach Cancer Task Medical Imaging Histopathology Images Federated Learning Non-IID Clients HPO Focus HPO in FL Multiple Cancer Types Subramanian et al., 2022 Khan et al., 2024 Tamanini et al., 2025 Yang et al., 2025 Li et al., 2025 Almelibari, 2025 Our Approach Phase 1: Centralized HPO Phase 2: Federated Training Ovarian dataset D^{\mathrm{ov}} Colon dataset D^{\mathrm{co}} Bayesian HPO (TPE) \lambda^{\star}_{\mathrm{ov}} (ovary-optimized) \lambda^{\star}_{\mathrm{co}} (colon-optimized) Combined config \bar{\lambda} FL server (FedAvg) Client 2 D_{2} Client 1 D_{1} Client K D_{K} Figure 1:

Read the complete text