Incentivizing Permissionless Distributed Learning of LLMs

Joel Lidin, Amir Sarfi, Evangelos Pappas, Samuel Dare, Eugene Belilovsky, Jacob Steeves · 2025

Read Incentivizing Permissionless Distributed Learning of LLMs by Joel Lidin, Amir Sarfi, Evangelos Pappas, Samuel Dare, Eugene Belilovsky, Jacob Steeves (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21684.txt.

Introduction

Joel Lidin and five colleagues pay strangers to train a language model together, and show the payments buy real learning, in a 2025 paper. Their incentive system, Gauntlet, runs on a public blockchain with fully open entry: anyone can join with any hardware and submit gradient updates. Keeping quality high without gatekeepers is the puzzle.

A two-stage filter first checks uptime, reliability, and synchronization. The core then scores each contribution by measuring the model's loss before and after it, ranking contributors with a skill rating over time. A uniqueness mechanism stops peers from resubmitting the same computation. The system trained a 1.2 billion parameter model entirely from permissionless contributions, paying real tokens by measured value. The model proved competitive per iteration against conventionally trained peers. The authors offer the design for any synchronous distributed training scheme.

Catalog record

CREATORJoel Lidin, Amir Sarfi, Evangelos Pappas, Samuel Dare, Eugene Belilovsky, Jacob Steeves
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21684

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Incentivizing Permissionless Distributed Learning of LLMs Joel Lidin, Amir Sarfi, Evangelos Pappas, Samuel Dare, Eugene Belilovsky, Jacob Steeves Abstract We describe an incentive system for distributed deep learning of foundational models where peers are rewarded for contributions. The incentive system, Gauntlet , has been deployed on the bittensor blockchain and used to train a 1.2B LLM with completely permissionless contributions of pseudo-gradients: no control over the users that can register or their hardware. Gauntlet can be applied to any synchronous distributed training scheme that relies on aggregating updates or pseudo-gradients. We rely on a two-stage mechanism for fast filtering of peer uptime, reliability, and synchronization, combined with the core component that estimates the loss before and after individual pseudo-gradient contributions. We utilized an OpenSkill rating system to track competitiveness of pseudo-gradient scores across time. Finally, we introduce a novel mechanism to ensure peers on the network perform unique computations. Our live 1.2B run, which has paid out real-valued tokens to participants based on the value of their contributions, yielded a competitive (on a per-iteration basis) 1.2B model that demonstrates the utility of our incentive system. 1 Introduction Training large foundational models, such as large language models (LLMs), remains dominated by centralized actors with access to vast computational resources. However, as these models grow in importance and influence, so does the imperative to democratize their development. Foundational models such as LLMs are typically trained in large, well-interconnected centralized data centers, in part due to the heavy communication costs of typical data parallel distributed learning methods. However, recent advancements in communication-efficient distributed learning [ 19 , 4 , 12 , 1 ] open the possibility to decentralize computation. This opens the door to new paradigms such as permissionless distributed training, where anyone can contribute updates to a shared model. While recent works have demonstrated pre-training with decentralized or federated learning [ 3 , 6 , 16 ] , these approaches have not fully addressed the challenges of incentivization and quality control in open networks opting for vetted contributors. In particular, ensuring honest user participation in such systems remains a challenge. Recent work has considered verification of machine learning programs [ 2 ] , from untrusted users which can include distributed training. However, this work on verification focuses on assuring that exact pre-described computations have been performed. On the other hand, contributors in incentivized systems may vary their computations (e.g., data selection or hyperparameters). Proof of Learning (PoL) has also been proposed in [ 7 ] and can be seen as a type of verification mechanism that attempts to recompute the exact calculations that a learner should have performed. It avoids re-training of the entire model by only recomputing part of the computation. Similar to verification, existing PoL work does not consider the case where a learner can deviate and even improve on the prescribed learning scheme (such as using more data than specified for a gradient step). Incentivized distributed training can be seen as a generalization of verification systems in distributed learning. The goal is to both ensure that untrusted users provide useful computations to the system, and to incentivize competition and innovation between users. For example, the incentive system may encourage participants to optimize their local hardware, networking, as well as their implementation in order to maximize throughput and utility of their contributions. In this paper, we introduce the Gauntlet incentive mechanism, a system designed to enable and reward high-quality contributions in a permissionless distributed training setting. Gauntlet efficiently evaluates and compares pseudo-gradient contributions from peers participating in a distributed training run. Gauntlet has been deployed on the Bittensor blockchain and used in a live training run of a 1.2B parameter language model, where contributors provided compressed pseudo-gradients without any centralized registration or approval. This model achieved competitive performance per iteration, with the Gauntlet protocol paying real-valued tokens to participants in proportion to the utility of their updates. Our 1.2B model run is, to our knowledge, the first truly permissionless pre-training LLM run. Any user with a valid internet connection is able to make a contribution without needing approval, coordination, or identification. It demonstrates that foundational model training can be conducted in a completely open network with minimal assumptions about trust, identity, or compute capabilities. Our study opens the door to decentralized AI models sustained by market-driven incentives. 2 Distributed Training Framework We consider a general synchronous distributed training scheme where a model \theta is updated with learning rate \alpha as follows: \theta_{t}=\theta_{t-1}-\alpha\sum_{k=1}^{K}w_{k}{\Delta_{k}} (1) In this scheme, K distributed peers contribute "pseudo-gradients", \Delta_{k} , which are aggregated and used to perform an optimization step. We note that this is a generic framework encompassing a number of popular data parallel distributed learning schemes [ 5 , 15 , 14 , 4 , 19 , 17 , 12 ] Training proceeds in communication rounds t , each with a specified duration. At the end of each round, we define a ‘put window’: a short period during which peers must publish their pseudo-gradients. Submissions made outside this window (i.e., too early or too late) are ignored. To implement incentivization, we consider the concept of a validator that can access any contribution \Delta_{k} for evaluation. The validator maintains a score for all participants, which is periodically posted on the public blockchain. This score is used to determine the amount of monetary rewards given to participants on the network. The instantiation of this framework that we evaluate uses the communication-efficient Decoupled Momentum Optimizer (DeMo) [ 12 ] to produce pseudo-gradients (see Algo. 2). DeMo is a variant of compression with error feedback methods [ 9 , 17 , 19 ] . The compressor utilized by DeMo applies a Discrete Cosine Transform (DCT) operation on chunked tensors, decorrelating the values before applying a top-k operation. This method has been shown to achieve competitive compression ratios on LLM training [ 12 , 1 ] . 3 Gauntlet Incentive Our incentive system is built with two phases: (a) a compute-intensive primary evaluation applied to a small number of peers per communication round (b) a low-cost fast evaluation applied to a large number of peers in each round. Incentives are calculated in each communication window and the scores of each participant are updated locally by the validator. The overall behavior of peers and validators in the system is summarized in Algorithm 1. 3.1 Primary evaluation Loss Rating The heart of the incentive mechanism attempts to judge the value of each pseudo-gradient contribution. \text{LossScore}_{p}(\Delta_{t}^{p},D)=L(\theta_{t},D)-L(\theta_{t}-\beta\Delta_{t}^{p},D) (2) where \Delta_{t}^{p} is the pseudo-gradient from peer p at round t , D is a random subset of data from the training dataset, and \beta is a scaling factor. This essentially measures how much a peer’s contribution decreases the loss. Naturally, poor gradients will lead to highly negative scores allowing the system to quickly downweight malicious contributors. Note that since an individual contribution has a higher variance than the aggregated pseudo-gradients, the \beta will typically be set to a smaller value than the current learning rate. In practice, when using a learning rate scheduler, we found it was sufficient to set \beta_{t}=c*\alpha_{t} where c<1 . Using a smaller value also allows us to reduce the noise in the LossScore . Specifically, stepping with too large a

Read the complete text