Democratizing Federated Learning with Blockchain and Multi-Task Peer Prediction
Leon Witt, Wojciech Samek, Kentaroh Toyoda, Dan Li · 2026
Read Democratizing Federated Learning with Blockchain and Multi-Task Peer Prediction by Leon Witt, Wojciech Samek, Kentaroh Toyoda, Dan Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28434.txt.
Introduction
Witt and three co-authors sketch a way to decentralize federated learning with blockchain and peer prediction. Federated training keeps data local, but scoring each helper's contribution is heavy work that blockchains handle poorly. Their design uses smart contracts and crypto payments to reward useful training help. A multi-task peer prediction scheme judges contributions without a central referee. The authors weigh what this setup gains and where it strains.
Catalog record
| CREATOR | Leon Witt, Wojciech Samek, Kentaroh Toyoda, Dan Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19820 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.28434
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Democratizing Federated Learning with Blockchain and Multi-Task Peer Prediction Leon Witt, Wojciech Samek, Kentaroh Toyoda, Dan Li Abstract The synergy between Federated Learning and blockchain has been considered promising; however, the computationally intensive nature of contribution measurement conflicts with the strict computation and storage limits of blockchain systems. We propose a novel concept to decentralize the AI training process using blockchain technology and Multi-task Peer Prediction. By leveraging smart contracts and cryptocurrencies to incentivize contributions to the training process, we aim to harness the mutual benefits of AI and blockchain. We discuss the advantages and limitations of our design. I Introduction Federated Learning (FL), a technique where multiple clients train an AI model locally and in parallel without data leaving the device, was pioneered by Google in 2016 [ 5 ] . This approach (i) decentralizes the computational load across participants and (ii) allows for privacy-preserving AI training as the training data remains on the edge devices. In this context, Federated Averaging 1 1 1 Other optimization algorithms for FL exist and are ongoing research [ 23 ] , with variations like FedBoost [ 17 ] , FedProx [ 26 ] , FedNova [ 50 ] , FedSTC [ 40 ] , and FetchSGD [ 39 ] exploring improvements to the FedAvg algorithm. ( FedAvg ) is an algorithm [ 5 ] widely adopted in FL, aiming to minimize the global model’s empirical risk by aggregating local updates, represented as \arg\min_{\boldsymbol{\theta}}\sum_{i}\frac{|S_{i}|}{|S|}f_{i}(\boldsymbol{\theta}) (1) where for each agent i , f_{i} represents the loss function, S_{i} is the set of indexes of data points on each client, and S:=\bigcup_{i}S_{i} is the combined set of indexes of data points of all participants. The traditional Federated Learning process contains four steps and is depicted on the left of Fig. 1 . To scale FL Frameworks beyond entrusted entities towards mass adoption, where participants are treated equally and fairly towards genuine democratic AI training, two major challenges have to be overcome: 1. Incentivization: Use cases where clients have valuable training data yet no interest in the AI model require incentive mechanisms through compensation. The privacy-by-design nature of FL makes it challenging to measure contributions for a fair reward distribution. 2. Decentralization: FL, although intended to be decentralized and private, relies on a central server for aggregating gradients (FedAvg). This central server can (i) exclude clients, (ii) introduce a single point of failure, and (iii) withhold payment in environments where clients are compensated for their contributions (incentivized FL). These issues can be mitigated by replacing the central authority with blockchain technology. Although the synergy between FL and blockchain has been considered to be promising [ 56 ] , computationally intensive processes on the blockchain, such as contribution measurement, hinders its adoption in the real world. In this paper, we first propose Multi-Task Peer Prediction (MTPP), a lightweight incentivization method from the domain of crowdsourcing, based on the correlation of clients’ outputs, to incentivize honest model training from clients in Federated Learning (FL). We then propose a novel framework to decentralize the AI training process using blockchain technology with MTPP. This framework leverages smart contracts and cryptocurrencies to incentivize contributions to the training process, offering a practical solution to harness the mutual benefits of AI and blockchain. This work is structured as follows: Section II explores contemporary methods of measuring contributions in FL. Section III examines the integration of blockchain technology within FL. Finally, Section IV describes a conceptual framework that combines MTPP with existing General-Purpose Blockchain Systems (GPBS) to both incentivize and decentralize FL. Fig. 1: FL vs. Decentralized and Incentivized FLF from [ 57 ] II Contribution Measurement in FL In FL, measuring individual contributions is challenging due to the privacy-preserving nature of the system, where only model updates are shared without revealing underlying data quality or distribution [ 57 , 22 , 55 ] . Contribution measurement methods include honest reporting based on data volume, local accuracy, or cost, though these may encourage dishonesty due to lack of verification [ 38 , 21 , 59 , 61 , 15 , 64 , 12 , 6 , 24 , 9 , 36 , 44 , 8 ] . Reputation systems and majority voting offer alternative metrics, reducing the need for stringent controls, but accurately quantifying reputation remains a challenge [ 67 , 63 , 66 , 36 , 46 , 45 ] . Direct performance comparison methods include the Leave-one-out strategy , where the impact of removing one client’s data is analyzed, although it overlooks complex data interactions [ 25 ] . The Shapley value method accounts for all possible contributions through cooperative game theory, ensuring fairness and promoting efficiency, symmetry, and proportional rewards, though it is computationally demanding [ 41 , 47 , 16 , 51 , 20 , 31 , 43 , 52 , 53 , 30 , 34 ] . These methods however require a central authority, a test set to perform the measurement against and cause computational overhead [ 32 ] . II-A Peer Prediction MTPP is a part of crowdsourcing, where a scoring rule is defined such that the optimal strategy for each client is to behave in a way the mechanism designer intends. Specifically, clients receive the most rewards for (i) exerting effort into solving the tasks and then (ii) reporting the results of the task truthfully. The beauty of peer prediction is that it does not require knowing the ground truth to elicit said properties, as the scoring function is based on the correlations of what clients report. To understand how MTPP can be applied to FL, we need to define what constitutes a task , signal , and report in the context of FL. Examples of tasks in FL include the classification of images [ 29 ] or finding the right parameterization of a neural network [ 33 ] . For image classification, retrieving a signal means applying inference on a trained model to predict a label, where the label would be the signal. In contrast, when the task is correct parameterization, training the model to retrieve the correct parameterization would constitute retrieving a signal. Whether the client then reports the retrieved signal truthfully depends on the incentivization. An informed strategy involves varying reports based on the signal, whereas an uninformed strategy maintains random reports independent of the true signal. A mechanism is informed-truthful if truthful reporting ( \mathbb{I} ) always results in at least as high expected payment as any other strategy, achieving equality only when all strategies are fully informed [ 42 ] . In the context of FL, the optimal client behavior (both genuine AI training and honest reporting) should achieve a Bayesian Nash equilibrium, aligning individual incentives with the overall objectives of the FL system. Multi-Task Peer Prediction: The MTPP algorithm works as follows for two clients as part of a broader group: 1. Assign shared tasks to ensure diverse engagement. 2. Define subsets M_{b} as “bonus tasks” and M_{1} , M_{2} (non-overlapping) as “penalty tasks.” 3. Payment for a bonus task is calculated by the difference in scores for bonus versus penalty tasks, with the total payment being the aggregate of all bonus tasks. The objective of MTPP algorithms is to define