Optimizing Decentralized Online Learning for Supervised Regression and Classification Problems

Kruijssen, Valieva & Longmore · 2025

Read Optimizing Decentralized Online Learning for Supervised Regression and Classification Problems by Kruijssen, Valieva & Longmore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16519.txt.

Introduction

Diederik Kruijssen, Renata Valieva, and Steven Longmore wrote in 2025 on how shared learning networks should weigh and pay their members. In such a network, many people send in guesses and the system blends them into one answer. Two rules shape the blend: how past skill turns into weight, and how skill turns into fair rewards.

No shared guide existed for setting those rules, so the team built a tuning frame and tested it on many mock networks. Their tests cover both number guessing and class guessing tasks, modeled on one live network. The best settings shift with who joins and what task is set, a lesson the authors say applies to any network of this kind.

Catalog record

CREATORKruijssen, Valieva & Longmore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16519

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing Decentralized Online Learning for Supervised Regression and Classification Problems Kruijssen, Valieva & Longmore Abstract Decentralized learning networks aim to synthesize a single network inference from a set of raw inferences provided by multiple participants. To determine the combined inference, these networks must adopt a mapping from historical participant performance to weights, and to appropriately incentivize contributions they must adopt a mapping from performance to fair rewards. Despite the increased prevalence of decentralized learning networks, there exists no systematic study that performs a calibration of the associated free parameters. Here we present an optimization framework for key parameters governing decentralized online learning in supervised regression and classification problems. These parameters include the slope of the mapping between historical performance and participant weight, the timeframe for performance evaluation, and the slope of the mapping between performance and rewards. These parameters are optimized using a suite of numerical experiments that mimic the design of the Allora Network, but have been extended to handle classification tasks in addition to regression tasks. This setup enables a comparative analysis of parameter tuning and network performance optimization (loss minimization) across both problem types. We demonstrate how the optimal performance-weight mapping, performance timeframe, and performance-reward mapping vary with network composition and problem type. Our findings provide valuable insights for the optimization of decentralized learning protocols, and we discuss how these results can be generalized to optimize any inference synthesis-based, decentralized AI network. Optimizing Decentralized Online Learning for Supervised Regression and Classification Problems J. M. Diederik Kruijssen {\lx@orcidlink{0000-0002-8804-0212}{\orcidlogo}\,^{1}} , Renata Valieva {\lx@orcidlink{0000-0002-7256-5321}{\orcidlogo}\,^{1}} & Steven N. Longmore {\lx@orcidlink{0000-0001-6353-0170}{\orcidlogo}\,^{1,2}} 1 Allora Foundation , 2 Liverpool John Moores University 1 Introduction Decentralized learning is a key ingredient of blockchain-based artificial intelligence (AI) networks, which enable the secure coordination of data owners, data processors, AI models, and the end users utilizing these insights ( Dinh & Thai 2018 ; Wang et al. 2021 ; Qammar et al. 2023 ; Bhumichai et al. 2024 , e.g.) . The trustless and permissionless nature of blockchains is ideally suited for coordinating independent actors in a collaboration game ( Nakamoto 2008 ; Buterin 2014 , e.g.) . Over the past years, several examples of on-chain decentralized AI have been introduced, either in the form of on-chain models ( Harris & Waggoner 2019 ; Zheng et al. 2024 , e.g.) or in the form of model coordination networks ( Craib et al. 2017 ; Rao et al. 2021 ; Kruijssen et al. 2024a , e.g.) . Any such network requires a mechanism to combine the raw inferences of individual participants into a single network inference (referred to as Inference Synthesis), and to correctly incentivize these participants by rewarding them for their contributions to this network inference. The Inference Synthesis mechanisms and incentive structures that are used by these networks have a number of free parameters that can be tuned to optimize the performance of the network. Despite the general applicability of such parameter calibrations and the numerous decentralized AI networks that have recently appeared, there exists no systematic study that performs such a calibration. This work aims to fill this gap by systematically optimizing a set of generalizable parameters governing Inference Synthesis and reward distribution in decentralized AI networks. The heterogeneity of the problem types and solution architectures is considerable, and therefore we reduce the problem to a small set of essential elements. Any decentralized learning protocol that combines multiple model outputs into a single, joint inference must decide on a mapping between the historical performance of a participant and their weight in determining the network inference. Some protocols perform this calculation on-chain ( Kruijssen et al. 2024a , e.g.) , whereas others outsource this in the form of a voting contest among network participants ( Craib et al. 2017 ; Rao et al. 2021 , e.g.) . Regardless of how the performance-weight mapping is consolidated, the simplest way in which such a mapping can be characterized is by its slope, i.e. how quickly the weight of a participant increases or decreases as their performance changes. The second free parameter is to quantify the word ‘historical’ in ‘historical performance’, i.e. over what timeframe the performance is considered and how strongly the most recent performance is weighted relative to the historical performance. Moving averages are a key tool to quantify this property, and the particular form of the moving average (e.g. simple, exponential, or something else) is a free parameter that can be tuned to optimize the performance and adaptability of the network. Finally, decentralized learning protocols must decide how to distribute rewards among the participating agents. This is often done based on the participant’s performance (e.g. score) or their commitment to the network (e.g. stake). Similarly to the mapping between performance and weight, the simplest form of characterizing this mapping between performance and rewards is by calibrating the slope of the mapping, i.e. how quickly the reward of a participant increases or decreases as their performance changes. These forms of parameter calibration are a requirement for any decentralized learning protocol that synthesizes a network inference from a large pool of raw inferences, independently of the specific decentralized learning protocol used. In this paper, we perform parameter optimization using an experimental setup that mimics the design of the Allora Network ( Kruijssen et al. 2024a ) , due to its transparent design and tractable parameter functionality. Specifically, we focus on parameters that describe the aforementioned mappings between (historical) performance and weight, and performance and rewards, as a function of the network composition (i.e. the number of participants) and the problem type. While Allora’s design was initially tailored to regression tasks, we extend this design to additionally cover classification tasks. This enables the comparison of parameter optimization for both problem types. The structure of this paper is as follows. In § 2 , we describe the decentralized learning framework of the Allora Network and introduce the key concepts that are relevant to the present work, summarizing the regression setup from Kruijssen et al. 2024a in § 2.1 , presenting the extension of the Allora Network to handle classification tasks in § 2.2 , and summarizing the incentive structure in § 2.4 . In § 3 , we describe the synthetic data generation process that is used in our numerical experiments for both regression and classification tasks. In § 4 , we describe the parameter optimization process and present the results, showing how the optimal performance-weight mapping and performance-reward mapping depend on the network composition and problem type. Finally, we summarize and discuss the results in § 5 . 2 Decentralized Learning as Facilitated by the Allora Network 2.1 Supervised Regression We carry out the experiments described in this work using a simulator that describes the decentralized learning infrastructure of the Allora Network ( Kruijssen et al. 2024a ) . Allora is a state-of-the-art protocol that uses decentralized AI and ML to build, extract, and deploy AI predictions or inferences among its participants. It offers a formalized way to obtain the output of ML models in blockchain networks of virtual machines (VMs) and to reward the operators of AI nodes who create these inferences. In this way, Allora bridges the information gap between data owners, data processors, AI models, and

Read the complete text