Scaling Federated Learning Solutions with Kubernetes for Synthesizing Histopathology Images
Andrei-Alexandru Preda, Iulian-Marius Tăiatu, Dumitru-Clementin Cercel · 2025
Read Scaling Federated Learning Solutions with Kubernetes for Synthesizing Histopathology Images by Andrei-Alexandru Preda, Iulian-Marius Tăiatu, Dumitru-Clementin Cercel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04130.txt.
Introduction
Andrei-Alexandru Preda, Iulian-Marius Taiatu, and Dumitru-Clementin Cercel grow synthetic tissue images across hospitals in a 2025 paper. Pathology slides are costly and private, so single hospitals lack training data. Their pipeline pairs vision transformers with adversarial networks to fake colorectal cancer tissue images. Fake slides added to training lift classifier accuracy in their tests.
The team then reruns the pipeline under federated learning, where hospitals train jointly without sharing slides. A realistic Kubernetes cluster with several nodes hosts the run. Performance matches the centralized setup, they report. The work shows a privacy safe path to bigger medical image pools.
Catalog record
| CREATOR | Andrei-Alexandru Preda, Iulian-Marius Tăiatu, Dumitru-Clementin Cercel |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-04130
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scaling Federated Learning Solutions with Kubernetes for Synthesizing Histopathology Images Andrei-Alexandru Preda, Iulian-Marius Tăiatu, Dumitru-Clementin Cercel Abstract In the field of deep learning, large architectures often obtain the best performance for many tasks, but also require massive datasets. In the histological domain, tissue images are expensive to obtain and constitute sensitive medical information, raising concerns about data scarcity and privacy. Vision Transformers are state-of-the-art computer vision models that have proven helpful in many tasks, including image classification. In this work, we combine vision Transformers with generative adversarial networks to generate histopathological images related to colorectal cancer and test their quality by augmenting a training dataset, leading to improved classification accuracy. Then, we replicate this performance using the federated learning technique and a realistic Kubernetes setup with multiple nodes, simulating a scenario where the training dataset is split among several hospitals unable to share their information directly due to privacy concerns. 1 Introduction Lack of sufficient training data has always been a problem in training machine learning models ( Bansal et al., 2022 ) . This problem has become more pronounced over time, as state-of-the-art models have become larger and more data-hungry, such as the Transformer ( Vaswani et al., 2017 ) family. Augmenting datasets means generating new training samples from existing ones using various techniques. Generative Adversarial Networks (GANs) ( Goodfellow et al., 2014 ) are suitable for generating synthetic samples, especially synthetic images. These networks involve training two neural networks that compete against each other and have produced good results in the past ( Odena et al., 2017 ; Jose et al., 2021 ) . In recent years, the public has become more aware of the importance of data privacy, especially in the medical and telecommunications fields. Federated learning ( McMahan et al., 2017 ) is a technique that allows training models in a non-centralized manner by distributing a model to independent clients, which then train it locally using their private data. In this way, training data do not have to leave the environment where they are safely stored and are prone to being shared. This technique is especially relevant in the medical domain, which deals with sensitive data ( Feki et al., 2021 ; Pfitzner et al., 2021 ) . In this work, we experiment with several GAN variants (i.e., conditional GAN ( Mirza and Osindero, 2014 ) , Wasserstein GAN with gradient penalty ( Gulrajani et al., 2017 ) , and auxiliary classifier GAN ( Odena et al., 2017 ) ) to produce histopathological images and build a system capable of augmenting training datasets. Since the medical domain involves working with sensitive information, we then try to address realistic privacy concerns by incorporating federated learning into the process, simulating a situation where multiple hospitals would train this machine learning model without risking exposing their patients’ data. Finally, we use Kubernetes ( https://kubernetes.io , accessed on 10 March 2025) to test the project in a production-ready environment. The performance of the resulting system is evaluated by analyzing the images it produces. In addition, we assess their usefulness by demonstrating their effectiveness in a downstream task: training a separate classifier for medical images and checking to improve its classification capabilities when adding our synthetic data. Our main contributions are as follows: 1. Comparing several GAN architectures for synthesizing histopathology images of colorectal cancer; 2. To the best of our knowledge, this is the first time the federated setting has been used to train GANs on the TCGA-CRC-DX dataset ( Kather, 2020 ) we use; 3. Experimenting to replicate centralized performance in a production-ready federated setting; 4. Analyzing data produced by GANs to check for common errors and suggest improvements; 5. Publishing our experimental code ( https://github.com/pandrei7/paper-synthesizing-histopathology , accessed on 10 March 2025) for the wider public to ease reproducibility. 2 Related Work 2.1 Generative Adversarial Networks GANs ( Goodfellow et al., 2014 ) refer to a framework for training neural networks capable of producing fake content with a distribution similar to that of real content. The framework uses an adversarial process to train two separate networks: a generator and a discriminator . The objective of the generator is to produce realistic samples when given noise from a fixed distribution as input, while the discriminator tries to discern between real and fake samples. The two networks compete throughout the training process until the discriminator can no longer distinguish between real and fake input. Since their introduction, multiple variants of GAN have appeared. One of these variants is the auxiliary classifier GAN (ACGAN) ( Odena et al., 2017 ) . Unlike the original GAN, the generator of the ACGAN is conditioned on class labels, which later allows the generation of data of multiple specified types. Similarly, the discriminator is tasked with detecting whether a sample is real or fake and predicting the sample’s class label. It should be noted that while GANs have been used in the past ( Mino and Spanakis, 2018 ; Esser et al., 2021 ; Fang et al., 2022 ; Năstăsescu and Cercel, 2022 ) with good results, they tend to be challenging to train, manifesting problems such as overfitting and mode collapse, which refers to the generation of a limited number of types of samples that are exploited by a discriminator weakness ( Xu et al., 2024 ) . 2.2 Vision Transformers The Transformer architecture ( Vaswani et al., 2017 ) was introduced in 2017, initially for the task of machine translation, but has since found many other uses, especially in the domain of natural language processing ( Paraschiv and Cercel, 2019 ; Vlad et al., 2019 ; Tanase et al., 2020 ; Vlad et al., 2020a ; Vlad et al., 2020b ; Paraschiv et al., 2020 ; Echim et al., 2023 ) . Some of its characteristics include the encoder-decoder architecture and an attention mechanism. The vision Transformer (ViT) ( Dosovitskiy et al., 2020 ) brings these ideas to the computer vision domain, splitting images into patches, linearly embedding them, adding position embeddings, and feeding them to a standard Transformer. For example, ViT has been used in medical applications as a component of the MedViT models ( Manzari et al., 2023 ) . 2.3 Federated Learning Federated learning ( McMahan et al., 2017 ) is a machine learning technique that allows training models to use datasets distributed on multiple clients to avoid sharing private information with a centralized server . At a high level, this technique works by having each client train a model on their private dataset and sending these models or only their gradients to the server, where they are aggregated. In this way, the training data never have to leave the clients. The server is in charge of coordinating the process until the training is over. Federated learning is essential in the medical domain, where hospitals or research centers tend to have sensitive data that should not be shared, for example, for ethical reasons. 2.4 Histopathology Image Analysis and Generation Histopathology is the study of tissue disease. An application of machine learning related to histopathology is the diagnosis of diseases by studying images of tissues and cells, which can be formulated as a classification problem. Histopathological images are more diverse, complex, and