OmniFed : A Modular Framework for Configurable Federated Learning from Edge to HPC Conference: Proceedings of Your Conference Name; Nov. 16–21, 2025; St. Louis, MO Proceedings of The International Conference for High Performance Computing, Networking, Storage, and Analysis DOI: XXXXXXX ISBN: 978-1-4

Sahil Tyagi * Andrei Cozma * Olivera Kotevska Feiyi Wang · 2025

Read OmniFed : A Modular Framework for Configurable Federated Learning from Edge to HPC Conference: Proceedings of Your Conference Name; Nov. 16–21, 2025; St. Louis, MO Proceedings of The International Conference for High Performance Computing, Networking, Storage, and Analysis DOI: XXXXXXX ISBN: 978-1-4 by Sahil Tyagi * Andrei Cozma * Olivera Kotevska Feiyi Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19396.txt.

Introduction

Sahil Tyagi and three co-authors present OmniFed, a software kit for federated learning that is built in pieces. In federated learning, models train where the data live. That suits edge devices and big centers where data cannot be pooled and privacy counts. OmniFed keeps four jobs apart: set-up, control of the run, data transfer, and the training logic itself. Users swap in code only where they need to, and the core stays whole.

The kit supports many network shapes and can mix transfer methods inside one run. Well-known training methods are built in. Privacy add-ons include noise-based privacy, encrypted math, and safe merging, plus tools that shrink what gets sent. The authors test several models and methods to gauge speed and quality. Their claim is practical: one stack will ease federated work across unlike settings.

Catalog record

CREATORSahil Tyagi * Andrei Cozma * Olivera Kotevska Feiyi Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19396

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OmniFed : A Modular Framework for Configurable Federated Learning from Edge to HPC Conference: Proceedings of Your Conference Name; Nov. 16–21, 2025; St. Louis, MO Proceedings of The International Conference for High Performance Computing, Networking, Storage, and Analysis DOI: XXXXXXX ISBN: 978-1-4503-XXXX-X/25/06 Thanks: * These authors contributed equally to this work. Sahil Tyagi * Andrei Cozma * Olivera Kotevska Feiyi Wang Abstract . Federated Learning (FL) is critical for edge and High Performance Computing (HPC) where data is not centralized and privacy is crucial. We present OmniFed , a modular framework designed around decoupling and clear separation of concerns for configuration, orchestration, communication, and training logic. Its architecture supports configuration-driven prototyping and code-level override-what-you-need customization. We also support different topologies, mixed communication protocols within a single deployment, and popular training algorithms. It also offers optional privacy mechanisms including Differential Privacy (DP) , Homomorphic Encryption (HE) , and Secure Aggregation (SA) , as well as compression strategies. These capabilities are exposed through well-defined extension points, allowing users to customize topology and orchestration, learning logic, and privacy/compression plugins, all while preserving the integrity of the core system. We evaluate multiple models and algorithms to measure various performance metrics. By unifying topology configuration, mixed-protocol communication, and pluggable modules in one stack, OmniFed streamlines FL deployment across heterogeneous environments. Github repository is available at https://github.com/at-aaims/OmniFed . 1. Introduction As data becomes increasingly distributed, sensitive, and voluminous, conventional centralized Artificial Intelligence (AI) pipelines are no longer practical today. Federated Learning (FL) and Collaborative Learning (CL) techniques developed over the last decade are crucial to develop Deep Neural Network (DNN) models that learn not just from open, publicly available data, but also from private, sensitive data residing at restricted endpoints. Algorithms like Federated Averaging ( McMahan et al. 2016 ) train over devices with limited compute, skewed data quality/quantity, and slow networks. From a distributed computing perspective, this intuition involves moving the computation instead of moving data ( Dayalan 2008 ; Zaharia et al. 2012 ) . FL emphasizes privacy-preserving training over sensitive or regulated datasets such that data cannot be relocated or reconstructed via model or output inversion attacks. On the other hand, CL focuses on decentralized, in-situ model training where privacy may be less critical, but data locality and institutional boundaries remain key drivers. Together, FL / CL offer a transformational opportunity for the next generation of secure and distributed AI where models are trained or fine-tuned across institutional, geographic, and disciplinary boundaries without relocating the data. Development of novel FL / CL systems and training strategies is thus crucial for scientific collaborations, national security applications, and industrial partnerships. Training models where the data resides: on partner/shared systems, scientific instruments, and secure edge devices, can help advance both open science and protected interests/missions simultaneously. We present OmniFed , a Python-based modular, extensible, configurable, and open-source framework built atop PyTorch ( Paszke et al. 2019 ) with the goal of enabling FL / CL from the edge to High Performance Computing (HPC) systems, spanning scientific and healthcare instruments, edge computing environments, cloud resources, and large-scale HPC systems. Built with layered abstractions and clear separation of concerns, OmniFed works in a plug-and-play and override-what-you-need manner via lifecycle hooks. Hiding the complexity of training topology and underlying communication allows rapid prototyping of new FL / CL algorithms without excessive boilerplate. Thus, the end Machine Learning (ML) user focuses solely on training logic (like algorithm, model architecture, loss computation, optimization strategy, etc.) while the framework handles low-level orchestration details and scaffolding. OmniFed makes it easy to implement and deploy complex, custom training topologies (such as centralized, decentralized, hierarchical, etc.) via Hydra configuration management ( Yadan 2019a ; Yadan 2019b ) . It also comes with built-in privacy features like Differential Privacy (DP) ( Dwork and Roth 2014 ) , Homomorphic Encryption (HE) ( Gentry 2009 ) and Secure Aggregation (SA) ( Bonawitz et al. 2017 ) , gradient compression techniques ( Tyagi and Swany 2023 ; Tyagi 2025 ) , streaming simulation for real-time learning ( Tyagi and Swany 2022 ) , and 10+ FL algorithms. The layout of this article is as follows: § 2 describes prior works in the FL / CL space and the need for secure, distributed AI for collaborative science, healthcare, finance applications, then § 3 explains the design principles and core components of OmniFed along with preliminary results, and § 4 describes our current and future directions of our work. 2. Challenges and Related Work 2.1. Need for Federated AI / ML Systems Language and reasoning models already trained on publicly available internet-scale knowledge have reduced the need for pre-training generic DNN s. The next frontier of computing lies in leveraging these models for private, sensitive, restricted, or distributed datasets for tasks like scientific discovery, healthcare, finance, and other critical applications. Further training or fine-tuning models over such datasets allows for personalized, context-aware intelligence for individual users ( Gunter et al. 2025 ) , and also help organizations working at the intersection of HPC , security, and scientific discovery. The decentralized nature of FL / CL offers a new approach to scientific workflows that have prior relied on centralized data aggregation and monolithic data pipelines. The ever-increasing volume, sensitivity, and distribution of scientific data, ranging from neutron scattering experiments ( Samarakoon et al. 2022 ) to genomic repositories ( Monaco et al. 2021 ) , have created technical, logistical, and ethical barriers to centralization, thus making it infeasible or prohibited. In the realm of open models and sciences, FL enables collaborative AI / ML across research institutions, laboratories, academia, and industry while preserving data governance. This supports efforts like climate modeling, materials science, cyber-threat detection, and energy infrastructure monitoring, while retaining local data control. The integration of FL / CL with edge, cloud, and HPC systems thus creates a new capability tier of privacy and security-aware distributed intelligence operating across layers of the scientific enterprise. In the context of national labs and computing facilities, FL opens up new frontiers in scientific modeling by combining federated models with HPC -powered simulations and developing self-updating digital twins ( Brewer et al. 2024 ) for nuclear reactors, electric grids, materials, and climate systems. The convergence of FL and simulations enables adaptive, real-time modeling at scale, offering breakthrough capabilities for monitoring, control, and prediction in complex systems. (a) (b) (c) (d) Figure 1 . Participants connected under different topological arrangements or configurations (central, ring, p2p, and hierarchical). 2.2. Current Frameworks and Limitations Many frameworks have been developed in recent years, each with distinct pros and cons. For instance, TensorFlow Federated (TFF) ( Bonawitz et al. 2019 ) developed by Google is Python-based with tight TensorFlow ( Abadi et al. 2016a ) integration to simulate FL experiments. Although TFF is excellent for research and experimentation, it lacks scalability so it may not be ideal for real-world deployment. NVFLARE ( Roth et al. 2022 ) developed by NVIDIA is an active and well-documented FL framework supporting TensorFlow and PyTorch that also supports privacy features. However, it faces scalability challenges where performance may drop as the number of active clients rises. Communicating large models between clients and server poses scalability challenges with Google Remote Procedure Call (gRPC) protocol (

Read the complete text