Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation

Inderjeet Singh, Eleonore Vissol-Gaudin, Andikan Otung, Motoyoshi Sekiya · 2026

Read Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation by Inderjeet Singh, Eleonore Vissol-Gaudin, Andikan Otung, Motoyoshi Sekiya (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17133.txt.

Introduction

Inderjeet Singh, Eleonore Vissol-Gaudin, Andikan Otung, and Motoyoshi Sekiya join chatbots in a peer web with no hub. Fine-tune work needs rich data from many sites. Those sites can't share raw text, for law and trust. Hub-based crowd learn has one weak point at its core. That hub can fail, and its acts can be probed. Their 2026 preprint builds a peer-to-peer frame in its place.

Peers trade model steps with no boss node. An orchestrated plan keeps the trades in time. No raw text moves in the scheme at all. Banks and wards could train shared bots this way.

Catalog record

CREATORInderjeet Singh, Eleonore Vissol-Gaudin, Andikan Otung, Motoyoshi Sekiya
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17133

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation Inderjeet Singh, Eleonore Vissol-Gaudin, Andikan Otung, Motoyoshi Sekiya Abstract Fine-tuning Large Language Models (LLMs) for specialized domains is constrained by a fundamental challenge: the need for diverse, cross-organizational data conflicts with the principles of data privacy and sovereignty. While Federated Learning (FL) provides a framework for collaboration without raw data exchange, its classic centralized form introduces a single point of failure and remains vulnerable to model inversion attacks. Decentralized FL (DFL) mitigates this risk by removing the central aggregator but typically relies on inefficient, random peer-to-peer (P2P) pairings, forming a collaboration graph that is blind to agent heterogeneity and risks negative transfer. This paper introduces KNEXA-FL, a novel framework for orchestrated decentralization that resolves this trade-off. KNEXA-FL employs a non-aggregating Central Profiler/Matchmaker (CPM) that formulates P2P collaboration as a contextual bandit problem, using a LinUCB algorithm on abstract agent profiles to learn an optimal matchmaking policy. It orchestrates direct knowledge exchange between heterogeneous, PEFT-based LLM agents via secure distillation, without ever accessing the models themselves. Our comprehensive experiments on a challenging code generation task show that KNEXA-FL yields substantial gains, improving Pass@1 by ≈ 50 % \approx 50\% relative to random P2P collaboration. Critically, our orchestrated approach demonstrates stable convergence, in stark contrast to a powerful centralized distillation baseline which suffers from catastrophic performance collapse. Our work establishes adaptive, learning-based orchestration as a foundational principle for building robust and effective decentralized AI ecosystems. † † footnotetext: † Corresponding author. Code — https://github.com/FujitsuResearch/knexa-fl Figure 1: The KNEXA-FL architecture for orchestrated decentralization. Agents send abstract profiles ( \mathbf{p}_{i} ) to a non-aggregating Central Profiler/Matchmaker (CPM), which provides pairing directives ( K_{rec} ). Paired agents then conduct direct, secure P2P knowledge exchange ( k_{s} ). The agent-side view (right) details local PEFT fine-tuning and the privacy-enforcing Guardrail Filter. Introduction Adapting Large Language Models (LLMs) to specialized domains presents a fundamental dilemma: the need for diverse, cross-organizational data clashes with inviolable principles of data sovereignty, privacy, and security. While Federated Learning (FL) ( McMahan et al. 2017 ) offers a paradigm for collaborative training without raw data exchange, its canonical server-centric form introduces a trusted central aggregator. This entity becomes a single point of failure and a privileged attack surface for sophisticated model inversion attacks that can reconstruct sensitive training data ( Geiping et al. 2020 ; Zhao et al. 2024 ) . Decentralized FL (DFL) addresses this by eschewing a central server in favor of direct peer-to-peer (P2P) communication ( Roy et al. 2019 ; Itahara et al. 2023 ) . However, in removing the central aggregator, DFL architectures typically regress to simplistic interaction strategies, such as random or static peer pairings. This random-walk approach to collaboration is statistically inefficient, blind to agent heterogeneity, and risks negative transfer , where poorly matched peers degrade each other’s performance. It fails to strategically harness the network’s latent collective intelligence. This paper argues that the prevailing dichotomy between a vulnerable central aggregator and inefficient random P2P interaction is too limited. We introduce KNEXA-FL , a novel hybrid framework that enables orchestrated decentralization . It features a non-aggregating Central Profiler/Matchmaker (CPM) whose sole purpose is to learn an optimal matchmaking policy for a federation of heterogeneous, autonomous LLM agents. The CPM operates on abstract, privacy-preserving agent profiles to solve a contextual bandit problem, intelligently routing knowledge exchange without ever accessing or storing the models themselves. The actual knowledge transfer, via prediction distillation compatible with parameter-efficient fine-tuning (PEFT), occurs directly and securely between the matched peers. Our contributions are threefold: • We designed and propose KNEXA-FL , a hybrid, centrally orchestrated - decentralized learning architecture for collaborative LLM fine-tuning. It resolves the matchmaking inefficiency of DFL without re-introducing the security vulnerabilities of a central model aggregator, thus offering a more robust and effective collaboration paradigm. • We are the first to formulate and solve the P2P LLM collaboration problem as a contextual bandit. Our CPM employs a LinUCB algorithm to learn a pairing policy from interaction rewards, dynamically optimizing the P2P knowledge graph to maximize network utility. • We provide comprehensive empirical validation on a challenging, heterogeneous code generation task. Our experiments show that KNEXA-FL substantially outperforms isolated and random P2P baselines, and, critically, demonstrates stable convergence where a state-of-the-art centralized knowledge distillation approach suffers from catastrophic collapse. Related Work KNEXA-FL integrates ideas from four strands of literature: (i) decentralized / peer-to-peer federated learning, (ii) parameter-efficient LLM federation, (iii) security‐aware governance in collaborative AI, and (iv) orchestration, data spaces, and multi-agent systems. We briefly position our contributions in each area. Federated and Decentralized Learning Federated Learning (FL) enables collaborative model training by exchanging parameter updates rather than raw data ( McMahan et al. 2017 ) . Canonical server-centric FL, however, struggles with statistical heterogeneity (non-IID data) and system heterogeneity (diverse model architectures). While methods like FedProx ( Li et al. 2020 ) and SCAFFOLD ( Karimireddy et al. 2020 ) address statistical drift, they maintain a central aggregator. Similarly, server-mediated knowledge distillation (e.g., FedMD ( Li and Wang 2019 ) ) handles architectural diversity but preserves the central server as a single point of failure and a potential privacy bottleneck. Decentralized FL (DFL) obviates the server, typically relying on gossip-based protocols where agents average parameters with random neighbors ( Hegedűs, Danner, and Jelasity 2021 ; Roy et al. 2019 ) . Such methods generally assume model homogeneity and do not perform intelligent peer selection. More recent P2P frameworks have introduced greater flexibility through knowledge distillation ( Itahara et al. 2023 ) , sub-network exchange ( Belal, Aksu, and Uluagac 2023 ) , or topology-aware aggregation ( Ryabinin et al. 2021 ) . Despite these advances, the fundamental problem of matchmaking remains underdeveloped, often relying on random or handcrafted heuristics. This is the critical gap our work addresses. In sharp contrast to prior art, our CPM formulates peer selection as a contextual bandit problem, learning to construct a high-utility interaction graph dynamically. Existing learning-based schedulers like Oort ( Lai et al. 2021 ) and FedBalancer ( Shin et al. 2022 ) optimize server-client selection for system metrics like throughput, a fundamentally different problem. The most relevant prior work, IPLS ( Pappas et al. 2021 ) , performs a single, static peer grouping at the outset based on model similarity. KNEXA-FL is the first framework to employ online learning to continually orchestrate the P2P collaboration graph, adapting to evolving agent knowledge while remaining fully non-aggregating. Parameter-Efficient LLM Federation The immense scale of LLMs has catalyzed research into federated fine-tuning using PEFT techniques. Centralized frameworks like FATE-LLM ( Liu et al. 2023 ) and FedLoRA variants ( Yang et al. 2024 ) federate PEFT modules (e.g., LoRA adapters) but rely on a central server for aggregation, which can lead to destructive parameter interference. Decentralized approaches such as FedSKD ( Weng, Cai, and Zhou 2025 ) and KD-PDFL ( Jeong and Kountouris 2023 ) use P2P knowledge distillation, but as noted, they lack an intelligent matchmaking mechanism. KNEXA-FL advances this line of work by uniquely combining support for heterogeneous LLM backbones and PEFT methods with CPM-guided P2P transfers, eliminating the risks of centralized aggregation while maximizing the efficacy of knowledge exchange. Security

Read the complete text