Enhancing Federated Learning with Kolmogorov-Arnold Networks: A Comparative Study Across Diverse Aggregation Strategies

Yizhou Ma 1 , Zhuoqin Yang 2 , Luis-Daniel Ibáñez 1 · 2025

Read Enhancing Federated Learning with Kolmogorov-Arnold Networks: A Comparative Study Across Diverse Aggregation Strategies by Yizhou Ma 1 , Zhuoqin Yang 2 , Luis-Daniel Ibáñez 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07629.txt.

Introduction

Yizhou Ma, Zhuoqin Yang, and Luis-Daniel Ibáñez swap a new network type into federated learning in a 2025 study. Federated learning trains one model across many sites without pooling private data, and the classic multilayer perceptron is its usual workhorse. A newer design, built on an old representation theorem, promises to fit tangled patterns with fewer units.

Across four datasets, the new networks beat the classic ones in accuracy, steadiness, and speed of settling. They held up as the number of sites grew and as data grew more uneven between sites, the two stresses that usually break federated training. The comparison makes a practical case for upgrading the default model.

Catalog record

CREATORYizhou Ma 1 , Zhuoqin Yang 2 , Luis-Daniel Ibáñez 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07629

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Federated Learning with Kolmogorov-Arnold Networks: A Comparative Study Across Diverse Aggregation Strategies Thanks: Corresponding author: Yizhou Ma. Thanks: This preprint has not undergone peer review or any post-submission improvements or corrections. It was prepared prior to submission to, and has since been accepted at, ICIC 2025. The final Version of Record will be published in the ICIC 2025 proceedings by Springer. Yizhou Ma 1 , Zhuoqin Yang 2 , Luis-Daniel Ibáñez 1 Abstract Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when dealing with complex datasets. Kolmogorov-Arnold Networks (KAN), inspired by the Kolmogorov-Arnold representation theorem, have shown promising capabilities in modeling complex nonlinear relationships. In this study, we explore the performance of KANs within federated learning (FL) frameworks and compare them to traditional Multilayer Perceptrons. Our experiments, conducted across four diverse datasets demonstrate that KANs consistently outperform MLPs in terms of accuracy, stability, and convergence efficiency. KANs exhibit remarkable robustness under varying client numbers and non-IID data distributions, maintaining superior performance even as client heterogeneity increases. Notably, KANs require fewer communication rounds to converge compared to MLPs, highlighting their efficiency in FL scenarios. Additionally, we evaluate multiple parameter aggregation strategies, with trimmed mean and FedProx emerging as the most effective for optimizing KAN performance. These findings establish KANs as a robust and scalable alternative to MLPs for federated learning tasks, paving the way for their application in decentralized and privacy-preserving environments. I Introduction Multilayer Perceptron (MLP) [ 1 ] , as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships [ 2 ] in load data when dealing with complex datasets. In contrast, the Kolmogorov-Arnold Network (KAN) [ 3 ] , based on the Kolmogorov-Arnold Representation Theorem, offers a promising alternative. KAN leverages the theorem to decompose complex multivariate functions into a linear combination of univariate functions, which are further fitted using learnable nonlinear transformation functions, demonstrating exceptional nonlinear approximation capabilities [ 4 ] . Recently, several studies [ 5 , 6 , 7 , 8 ] on federated learning (FL) have been conducted, KAN also has been applied to a variety of tasks, including tabular data [ 9 ] , time series [ 10 ] , and computer vision [ 11 ] , showcasing its robust performance. Nevertheless, while some efforts [ 12 , 13 ] have been made to explore the application and performance of KAN in federated learning and other distributed scenarios, these studies remain incomplete and leave considerable room for further investigation. In our research, we focus on exploring the performance of Kolmogorov-Arnold Networks within a federated learning framework compared to traditional Multilayer Perceptrons. We designed a series of experiments in a multi-client simulated environment. Both models were subjected to identical training and testing pipelines to ensure fairness and consistency in the evaluation process. The experiments covered both binary and multi-class classification tasks, providing a comprehensive assessment of the models’ capabilities. Additionally, we evaluated a range of parameter aggregation strategies to identify the most effective methods for optimizing performance in federated learning scenarios. We identify three key research questions (Q1, Q2, Q3) in exploring the performance of Kolmogorov-Arnold Networks within a federated learning framework and propose feasible solutions. The first research question is (Q1): How to simulate common federated learning tasks across diverse evaluation scenarios? To address this challenge, we selected four widely-used datasets to simulate typical tasks in federated learning environments. These tasks encompass both binary and multi-class classification problems, ensuring a diverse range of evaluation scenarios for model performance. The second research question is (Q2): How to evaluate the feasibility of KANs in federated learning and compare their performance with Multilayer Perceptrons? To tackle this challenge, we designed a series of experiments in a multi-client simulated environment. Both KANs and MLPs were subjected to identical training and testing pipelines to ensure fairness and consistency. Performance comparisons were conducted across classification tasks, providing a comprehensive analysis of their strengths and weaknesses. The third research question is (Q3): How to identify global parameter aggregation strategies that are better suited for KANs in federated learning? To solve this challenge, we evaluated a variety of parameter aggregation strategies for each task. By comparing the performance of these strategies, we aimed to determine the most effective approach for optimizing KANs in federated learning and benchmarked the results against those of MLPs. This systematic exploration provides insights into how different aggregation methods impact the overall effectiveness and adaptability of KANs in distributed environments. Our major contributions are summarized as follows: • We present a comprehensive exploration of Kolmogorov-Arnold Networks in federated learning, providing a preliminary guideline for their broad applicability in diverse evaluation scenarios. This includes validating their robustness and adaptability across binary and multi-class classification tasks. • We perform extensive evaluations to compare the performance of Kolmogorov-Arnold Networks with Multilayer Perceptrons under various FL configurations. • We identify and thoroughly evaluate a range of parameter aggregation strategies to determine the most effective approaches for optimizing KAN performance in federated settings. The remainder of this paper is organized as follows. Section II provides a comprehensive review of related works. Section III details the proposed methodology, outlining the experimental setup, the integration of KANs into the federated learning framework, and the diverse aggregation strategies employed for global model updates. Section IV presents the empirical evaluation, where we conduct extensive experiments across multiple datasets to assess the performance of KANs compared to traditional Multilayer Perceptrons under different federated learning configurations. Finally, Section V concludes the paper and presents the vision for future work. Fig. 1: (a) The proposed framework for Federated Kolmogorov-Arnold Networks (F-KAN), demonstrating the interaction between clients, aggregation strategies, and the global model. The dotted and solid arrows represent bidirectional communication in the federated learning process. (b) Icons representing the four datasets used in this study: Gender Classification, Airline Passenger Satisfaction, Cardiovascular Disease Diagnosis, and Weather Type Classification. (c) Visualization of the two models compared in this research: a standard Multilayer Perceptron on the left and the Kolmogorov-Arnold Network on the right (adopted from [ 3 ] ), highlighting their structural differences. II Background Inspired by the Kolmogorov-Arnold Representation Theorem, Liu et al. [ 3 ] introduced Kolmogorov-Arnold Networks as a novel alternative to Multilayer Perceptrons. Unlike MLPs, which rely on linear weighted connections combined with fixed nonlinear activation functions, KANs replace linear weights with learnable univariate functions parameterized as splines on the edges. Several recent studies [ 12 , 13 , 14 ] have begun to explore the application and performance of KAN in federated learning. Zeydan et al. [ 12 ] proposed Federated Kolmogorov-Arnold Networks (F-KAN), a novel integration of Kolmogorov-Arnold Networks within a federated learning framework. Through experiments conducted on the Iris dataset, they demonstrated that F-KANs significantly outperform Federated Multi-Layer Perceptrons (F-MLP) in terms of accuracy, precision, recall, F1-score, and stability. Specifically, F-KANs achieved 100% accuracy on both the training and test datasets within just seven rounds of federated learning, showcasing their superior learning efficiency and robust performance compared to F-MLPs. However, their study is

Read the complete text