Distributed Learning over Noisy Communication Networks

Emrah Akyol, Marcos M. Vasconcelos · 2026

Read Distributed Learning over Noisy Communication Networks by Emrah Akyol, Marcos M. Vasconcelos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20723.txt.

Introduction

Emrah Akyol and Marcos Vasconcelos study how a network of agents can learn to coordinate when their messages get garbled. Their 2026 paper uses binary coordination games played over a graph. Each agent picks one of two actions. News of neighbors' actions arrives through noisy links. The noise can flip a bit or erase it.

The team models each link as one of two classic channels. One flips bits at random; the other drops them. Agents update their play with log-linear learning, a standard rule for such games. The authors analyze two working regimes and describe the shape of the learning dynamics that result. The work matters for systems that must agree while talking over poor connections.

Catalog record

CREATOREmrah Akyol, Marcos M. Vasconcelos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20723

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributed Learning over Noisy Communication Networks Emrah Akyol, Marcos M. Vasconcelos Abstract We study binary coordination games over graphs under log-linear learning when neighbor actions are conveyed through explicit noisy communication links. Each edge is modeled as either a binary symmetric channel (BSC) or a binary erasure channel (BEC). We analyze two operational regimes. For binary symmetric and binary erasure channels, we provide a structural characterization of the induced learning dynamics. In a fast-communication regime, agents update using channel-averaged payoffs; the resulting learning dynamics coincide with a Gibbs sampler for a scaled coordination potential, where channel reliability enters only through a scalar attenuation coefficient. In a snapshot regime, agents update from a single noisy realization and ignore channel statistics; the induced Markov chain is generally nonreversible, but admits a high-temperature expansion whose drift matches that of the fast Gibbs sampler with the same attenuation. We further formalize a finite- K K communication budget, which interpolates between snapshot and fast behavior as the number of channel uses per update grows. This viewpoint yields a communication-theoretic interpretation in terms of retransmissions and repetition coding, and extends naturally to heterogeneous link reliabilities via effective edge weights. Numerical experiments illustrate the theory and quantify the tradeoff between communication resources and steady-state coordination quality. I Introduction Large-scale networked systems are now a cornerstone of modern communication, computation, and control infrastructures. Applications ranging from machine learning and distributed sensing to cooperative robotics, smart grids, and Internet-of-Things (IoT) platforms increasingly rely on collections of agents that coordinate through local message exchanges over communication networks. In these systems, global objectives, such as consensus, distributed optimization, collaborative inference, or learning a shared model, must be achieved through iterative local interactions constrained by the physical properties of the underlying communication medium. From a communications perspective, a defining feature of such distributed cooperative systems is that information exchange is inherently imperfect. Bandwidth limitations, noise, quantization, packet losses, interference, and intermittent connectivity are fundamental constraints in wireless and large-scale wired networks. These impairments are typically addressed at the PHY, MAC, and network layers through coding, scheduling, and retransmission mechanisms. However, even when such mechanisms are present, higher-layer distributed algorithms operate on information that is delayed, noisy, or partially observed. As a result, communication constraints ultimately shape the collective performance of distributed learning and coordination protocols. This paper studies distributed coordination through the lens of log-linear learning (LLL) over communication-constrained networks. LLL and related stochastic best-response dynamics are widely used abstractions for decentralized adaptation in networked systems, with connections to distributed optimization, consensus algorithms, and learning in games. Their appeal lies in their simplicity and robustness: agents update using local information and randomized rules that naturally tolerate uncertainty. The existing literature, however, typically assumes that agents observe their neighbors’ actions or states reliably, or models communication imperfections indirectly as abstract noise in their utility functions [ 1 ] or random link failures [ 2 ] . In contrast, we explicitly model the physical communication layer. We focus on binary coordination games over graphs, which serve as a minimal yet expressive abstraction for cooperative decision-making in distributed systems. Agents exchange information with neighbors through noisy communication channels, such as binary symmetric or erasure channels, and base their updates on the received messages. This explicit channel-level modeling allows us to directly connect communication reliability to effective inter-agent coupling strengths, providing a principled bridge between communication theory and distributed learning dynamics. I-A Contributions Exact Gibbs structure in the fast regime: For BSC and BEC links, fast communication turns LLL into a single-site Gibbs sampler for a scaled coordination potential. Communication enters only through a scalar attenuation coefficient \kappa defined in ( 11 ). Snapshot regime as a nonequilibrium process with a controlled high-temperature limit: Snapshot updates generate a generally nonreversible Markov chain. For small inverse temperature \beta , we derive a first-order expansion that recovers the same drift as the fast Gibbs sampler, with the same attenuation ( 11 ). Finite- K communication budget and interpolation: We formalize an intermediate model in which each update uses K channel uses per neighbor. We prove entrywise kernel convergence to the fast regime as K\to\infty and convergence of stationary distributions on the finite state space. Communication-theoretic interpretation and heterogeneity: The finite- K model yields a concrete interpretation in terms of retransmissions and repetition coding. We also extend the fast regime to heterogeneous link qualities, showing that reliability simply rescales edge weights in the Gibbs potential. Overall, this work contributes to the understanding of distributed coordination over communication-constrained networks by providing a unified analytical framework that connects channel models, network topology, and learning dynamics. By making the role of communication explicit, our results complement existing research on communication-efficient distributed optimization and learning, offers new insights into designing novel communication-aware, scalable, and resilient distributed cooperative systems. I-B Related Work The modern use of LLL in games traces to Blume [ 3 ] , who made explicit the Gibbs connection for potential games. Subsequent work developed robustness, implementability, and structural relaxations; see, e.g., Marden and Shamma’s revisiting of LLL under asynchrony and payoff-based feedback [ 1 ] . In parallel, the algorithmic game theory community analyzed logit dynamics beyond potential maximizers, including bounds on mixing time and metastability; see Auletta et al. for general mixing bounds and social welfare under logit dynamics [ 4 , 5 ] and metastability phenomena in coordination games [ 6 ] . Classical selection under perturbations via evolutionary logit response and mutations goes back to Young and to Kandori–Mailath–Rob [ 7 , 8 ] . There is a substantial literature showing that LLL is robust to utility noise and limited feedback, including finite-time convergence to \varepsilon -efficient Nash equilibria in general potential games (under Lipschitz regularity and noisy/partial feedback) [ 9 ] . There is also work on stochastic connectivity, e.g., BLLL over randomly available links, that derives conditions on link-up probabilities for concentrating the stationary measure on potential maximizers [ 2 ] . However, to our knowledge, these strands do not model a per-edge observation channel of neighbor actions and drive the logit via the associated channel likelihood/posterior. Our formulation fills this gap by (i) placing a BSC (p) or BEC( \varepsilon ) on each link, (and (ii) showing a two-regime attenuation law, \kappa=(1-2p) for BSC and \kappa=(1-\varepsilon) for BEC in the averaged (fast-channel) regime and in the snapshot regime to first order in \beta . II Model and Preliminaries II-A Coordination game and potential Let G=(V,E) be an undirected graph with |V|=n and symmetric nonnegative weights v_{ij}=v_{ji} for \{i,j\}\in E . Each agent i selects an action x_{i}\in\{0,1\} , and the joint action profile is x=(x_{1},\dots,x_{n}) . We consider a binary coordination game in which agents are rewarded for matching the actions of their neighbors. The utility of agent i is u_{i}(x)=\sum_{j\in N(i)}v_{ij}\,\mathbf{1}\{x_{i}=x_{j}\}. This game is a potential game with potential function \Phi(x)\triangleq\sum_{\{i,j\}\in E}v_{ij}\,\mathbbm{1}\{x_{i}=x_{j}\}. (1) The two consensus profiles x=\mathbf{0} and x=\mathbf{1} are Nash equilibria and represent global coordination. For each i , we define m_{i}(b;x)\triangleq\sum_{j\in N(i)}v_{ij}\,\mathbbm{1}\{x_{j}=b\},\qquad b\in\{0,1\}, (2) where N(i)\triangleq\{j:\{i,j\}\in E\} . Only edges incident to i change when x_{i} changes. In particular, for any b,b^{\prime}\in\{0,1\} , \Phi(b,x_{-i})-\Phi(b^{\prime},x_{-i})=m_{i}(b;x)-m_{i}(b^{\prime};x). (3) We also define the single-site potential difference \Delta\Phi_{i}(x)\triangleq\Phi(1,x_{-i})-\Phi(0,x_{-i}), (4) which is equivalen tto, via (

Read the complete text