A Unified Benchmark of Federated Learning with Kolmogorov–Arnold Networks for Medical Imaging

Youngjoon Lee, Jinu Gong, Joonhyuk Kang · 2025

Read A Unified Benchmark of Federated Learning with Kolmogorov–Arnold Networks for Medical Imaging by Youngjoon Lee, Jinu Gong, Joonhyuk Kang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19639.txt.

Introduction

Youngjoon Lee, Jinu Gong, and Joonhyuk Kang benchmark a new network type inside federated learning for medical imaging in this 2025 paper. Federated learning trains models across separate devices without moving raw data, which protects privacy. The new networks, called Kolmogorov-Arnold networks, replace fixed activations with learnable ones.

Across six federated algorithms on a blood cell image task, the new networks matched or beat classic multilayer models, often with simpler shapes. Grid size and layout mattered, and uneven data across devices shifted the best settings. Wide but shallow designs performed best in the federated setting. The authors present this as the first full benchmark of its kind. They argue the networks suit privacy-preserving medical imaging.

Catalog record

CREATORYoungjoon Lee, Jinu Gong, Joonhyuk Kang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19639

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Unified Benchmark of Federated Learning with Kolmogorov–Arnold Networks for Medical Imaging Thanks: This research was supported by the Institute of Information & Communications Technology Planning & Evaluation (IITP)-ITRC (Information Technology Research Center) grant funded by the Korea government (MSIT) (IITP-2025-RS-2020-II201787). Youngjoon Lee, Jinu Gong, Joonhyuk Kang Abstract Federated Learning (FL) enables model training across decentralized devices without sharing raw data, thereby preserving privacy in sensitive domains like healthcare. In this paper, we evaluate Kolmogorov–Arnold Networks (KAN) architectures against traditional MLP across six state-of-the-art FL algorithms on a blood cell classification dataset. Notably, our experiments demonstrate that KAN can effectively replace MLP in federated environments, achieving superior performance with simpler architectures. Furthermore, we analyze the impact of key hyperparameters—grid size and network architecture—on KAN performance under varying degrees of Non-IID data distribution. Additionally, our ablation studies reveal that optimizing KAN width while maintaining minimal depth yields the best performance in federated settings. As a result, these findings establish KAN as a promising alternative for privacy-preserving medical imaging applications in distributed healthcare. To the best of our knowledge, this is the first comprehensive benchmark of KAN in FL settings for medical imaging task. Index Terms : e-health, federated learning, kolmogorov–arnold networks I Introduction Recent years have seen major progress in AI for healthcare, showing great potential across many medical uses [ 1 , 2 ] . At the same time, growing privacy concerns have restricted access to medical data, leading to more interest in methods that protect privacy [ 3 ] . Federated Learning (FL) is a new approach that allows training on spread-out datasets without sharing the actual data [ 4 , 5 ] . This has made FL popular in healthcare since it meets the strict privacy rules for medical data [ 6 , 7 ] . However, FL performance hinges on the chosen model and its efficiency in distributed settings [ 8 , 9 ] . Therefore, studying effective model designs for FL remains important for advancing medical applications. Fig. 1: Benchmarking results comparing KAN-1 layer (filled circles) and MLP-3 layer (unfilled circles) performance across SOTA FL methods in an IID setting, plotting Convergence Round versus Top-1 Test Accuracy (%). Circle sizes indicate standard deviation in accuracy. The Kolmogorov–Arnold Networks (KAN) [ 10 , 11 ] , recently proposed as a potential alternative to Multi-Layer Perceptrons (MLP) [ 12 ] , can theoretically represent continuous functions without using traditional activation functions like other neural networks. While recent studies have used KAN for various centralized uses [ 13 , 14 ] , research on using them in federated settings is still new, mostly limited to the vanilla FedAvg method or using simple datasets [ 15 , 16 , 17 ] . Current research lacks thorough comparisons of KAN over recent FL methods, which prevents a deeper understanding of their practical use in privacy-sensitive medical settings. Addressing this gap is crucial to fully understand KAN’s potential in complex, spread-out medical data environments. Therefore, comprehensive testing over recent FL methods is essential. To evaluate KAN’s applicability to FL, we compared their performance against MLP-based models across various cutting-edge FL methods, as shown in Fig. 1 . This comparison shows that KAN models, even in their simplest form, perform as well as deeper MLP networks when used with various FL methods in IID setting. Additionally, we examined KAN architectures from multiple perspectives, investigating the impact of key hyperparameters—specifically grid size, number of hidden layers—when integrated within federated frameworks in Non-IID nature. These findings will encourage further exploration of KAN’s wider use in FL, especially for complex medical imaging tasks. The main contributions of this paper are as follows: • We present the first comprehensive benchmark of KAN in FL settings for medical imaging. • We demonstrate that KAN compare favorably with MLP across six state-of-the-art FL algorithms. • We provide empirical evidence of performance patterns that emerge when varying KAN’s key hyperparameters. • Additionally, we examine whether increasing KAN’s depth through additional hidden layers or expanding its width has greater impact. The remainder of this paper is organized as follows. In Section II , we introduce federated setting and process. Section III presents our comprehensive benchmark results across various state-of-the-art FL algorithms. Finally, Section IV concludes with remarks. II Problem and Method II-A Federated Setting We consider a FL system comprising N edge devices and a central server as [ 18 ] . Each device n\in\{1,2,\dots,N\} holds a private dataset \mathcal{D}^{n} , and due to heterogeneous blood-cell type distributions, the overall data union \mathcal{D}=\bigcup_{n=1}^{N}\mathcal{D}^{n} is inherently imbalanced. Consequently, the goal is to learn a global model \theta_{g}\in\Theta without aggregating raw data centrally, thereby preserving privacy [ 19 , 20 ] . Accordingly, FL seeks to minimize the empirical risk across all devices: \min_{\theta_{g}\in\Theta}F(\theta_{g})\;\triangleq\;\frac{1}{N}\sum_{n=1}^{N}f_{n}(\theta_{g})\,, where F denotes the global objective aggregated at the server, and each local objective f_{n} on device n is given by f_{n}(\theta_{n})\;\triangleq\;\frac{1}{|\mathcal{D}^{n}|}\sum_{(x_{i},y_{i})\in\mathcal{D}^{n}}\mathcal{L}\bigl(\theta_{n};x_{i},y_{i}\bigr)\,, with \mathcal{L} representing the per-sample loss (e.g., cross-entropy) for predicting label y_{i} from image x_{i} . II-B Federated Learning Process For clarity and concreteness, we describe the FL framework using the FedAvg algorithm. At each global round g_{r}\in\{1,2,\dots,G\} , the central server randomly selects a subset \mathcal{S}_{g_{r}}\subseteq\{1,2,\dots,N\} of edge devices for participation and broadcasts the current global model parameters \theta_{g}^{(g_{r}-1)} to these selected devices. Each participating device n\in\mathcal{S}_{g_{r}} then performs local training using its private dataset \mathcal{D}^{n} to minimize the local loss function specific to the KAN model. The KAN model computes output h(x) given input x via a Kolmogorov–Arnold representation as follows: h(x)=\sum_{j=1}^{J}c_{j}\phi_{j}\left(\sum_{i=1}^{I}w_{ji}\psi_{i}(x_{i})+b_{j}\right)\,, where I and J denote the dimensions of input and hidden layers, respectively, \psi_{i} and \phi_{j} represent continuous basis functions of input and hidden layers, and w_{ji} , b_{j} , and c_{j} are learnable weights and biases and output scalars. The local training on device n involves minimizing the following local objective through gradient descent [ 21 ] for each local epoch e\in\{1,2,\dots,E\} : \theta_{n}^{(g_{r},e+1)}\leftarrow\theta_{n}^{(g_{r},e)}-\eta\nabla f_{n}(\theta_{n}^{(g_{r},e)})\,, where the local loss f_{n}(\theta_{n}) for a given batch \mathcal{B}\subseteq\mathcal{D}^{n} is explicitly computed as: f_{n}(\theta_{n})=\frac{1}{|\mathcal{B}|}\sum_{(x_{i},y_{i})\in\mathcal{B}}\mathcal{L}\left(h(x_{i};\theta_{n}),y_{i}\right)\,. Once local training concludes, each device n sends its updated local parameters \theta_{n}^{(g_{r},E)} back to the central server. The server then aggregates these parameters from participating devices using a parameter-wise averaging: \theta_{g}^{(g_{r})}\leftarrow\frac{1}{|\mathcal{S}_{g_{r}}|}\sum_{n\in\mathcal{S}_{g_{r}}}\theta_{n}^{(g_{r},E)}\,, where each parameter set \theta_{n} represents set of parameters \{w_{ji},b_{j},c_{j}\} of the KAN model. The aggregated global model \theta_{g}^{(g_{r})} is then broadcasted back to all devices, initiating the next global round. This federated procedure iteratively continues until convergence criteria for the global model \theta_{g} are satisfied. Overall procedure is described in Algorithm 1 . Initialize global model parameters \theta_{g}^{(0)} 1 for global round g_{r}=1,2,\ldots,G do 2 Server randomly selects a subset of devices \mathcal{S}_{g_{r}}\subseteq\{1,2,\ldots,N\} 3 Server broadcasts \theta_{g}^{(g_{r}-1)} to all devices in \mathcal{S}_{g_{r}} 4 5 for device n\in\mathcal{S}_{g_{r}} do in parallel 6 Initialize local model: \theta_{n}^{(g_{r},0)}\leftarrow\theta_{g}^{(g_{r}-1)} 7 8 for local epoch e=0,2,\ldots,E-1 do 9 Sample batch \mathcal{B}\subseteq\mathcal{D}^{n} 10 Compute KAN output for each (x_{i},y_{i})\in\mathcal{B} : 11 h(x_{i})=\sum_{j=1}^{J}c_{j}\phi_{j}\left(\sum_{i=1}^{I}w_{ji}\psi_{i}(x_{i})+b_{j}\right) 12 Compute local loss: 13 f_{n}(\theta_{n}^{(g_{r},e)})=\frac{1}{|\mathcal{B}|}\sum_{(x_{i},y_{i})\in\mathcal{B}}\mathcal{L}(h(x_{i};\theta_{n}^{(g_{r},e)}),y_{i}) 14 Update local model: 15 \theta_{n}^{(g_{r},e+1)}\leftarrow\theta_{n}^{(g_{r},e)}-\eta\nabla f_{n}(\theta_{n}^{(g_{r},e)}) 16 end for 17 18 Device n sends \theta_{n}^{(g_{r},E)} to the server 19 end forpar 20 21 Server aggregates parameters: 22 \theta_{g}^{(g_{r})}\leftarrow\frac{1}{|\mathcal{S}_{g_{r}}|}\sum_{n\in\mathcal{S}_{g_{r}}}\theta_{n}^{(g_{r},E)} 23 end for 24 25 return \theta_{g}^{(G)} Algorithm 1 FL with Kolmogorov-Arnold Networks Fig. 2: Test accuracy comparison

Read the complete text