Non-exchangeable mean-field theory for adaptive weights: propagation of chaos and graphon sampling lemma

Datong Zhou · 2025

Read Non-exchangeable mean-field theory for adaptive weights: propagation of chaos and graphon sampling lemma by Datong Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13587.txt.

Introduction

Datong Zhou, in a solo 2025 paper, builds math for very large groups of moving parts whose links change as they move. In the classic case, the parts can be swapped for each other, and each part soon acts on its own. Here that swap does not hold, since each part keeps a tie to its own links. States and link weights thus shift as one joined system, driven by random noise.

Zhou proves a new form of that drift to freedom, for parts that start out linked in this tied way. The limit law needs a rich frame that holds both the parts and their weights. A graph sampling rule gives firm bounds on how close the real group stays to the limit. The work extends mean-field tools to nets whose links learn or adapt.

Catalog record

CREATORDatong Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE111 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13587

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Non-exchangeable mean-field theory for adaptive weights: propagation of chaos and graphon sampling lemma Thanks: This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 101034255. Datong Zhou Abstract . We develop a mean-field theory for large, non-exchangeable particle (agent) systems where the states and interaction weights co-evolve in a coupled system of SDEs. A first main result is a generalization of the propagation of chaos. The weight adaptation in the SDEs makes the classical approach of using a static probability space as the continuum limit for the agent labels inadequate. We address this by introducing a label space endowed with a filtration that captures the stochasticity. While this yields a well-posed McKean-Vlasov SDE, its limit is not easily described by a Vlasov-type PDE. This difficulty, in turn, motivates the introduction of a unified metric that naturally combines the Wasserstein distance for states and the cut norm for weights. In this metric space, we establish the convergence of finite systems to their continuum limit. This result, analogous to the classical convergence of empirical measures, is a subtle consequence of a deep result from dense graph theory, namely the Sampling Lemma. 1. Overview 1.1. A class of non-exchangeable multi-agent systems The aim of the article is to establish a natural formalism of limits for the so-called non-exchangeable multi-agent systems where the interaction between agents is parameterized by an additional weighted graph connecting all agents. We consider systems with the following specifications: Let \bm{X}_{i}(t)\in\mathbb{D}=\mathbb{R}^{d} or \mathbb{T}^{d} denote the state of the i -th agent, and \bm{w}_{i,j}(t)\in\mathbb{R} denote the time-varying interaction weights between the i -th and the j -th agent. The individual agent dynamics combine a drift term \mu:\mathbb{D}\to\mathbb{R}^{d} with addtive noise term \nu\mathrm{d}\bm{B}_{i}(t) , where \{\bm{B}_{i}(t)\} are i.i.d. Brownian motions. Agent interactions are given through an interaction kernel \sigma:\mathbb{D}\times\mathbb{D}\to\mathbb{R}^{d} and weight adaptation functions \alpha,\beta:\mathbb{D}\times\mathbb{D}\to\mathbb{R} . This leads to the following general system of SDEs: (1.1a) \displaystyle\mathrm{d}\bm{X}_{i} \displaystyle=\mu(\bm{X}_{i})\mathrm{d}t+\nu\mathrm{d}\bm{B}_{i}+\frac{1}{N}\!\sum_{j\in[N]\setminus\{i\}}\bm{w}_{i,j}\sigma(\bm{X}_{i},\bm{X}_{j})\mathrm{d}t, \displaystyle\forall i\in[N], (1.1b) \displaystyle\mathrm{d}\bm{w}_{i,j} \displaystyle=\alpha(\bm{X}_{i},\bm{X}_{j})\bm{w}_{i,j}\mathrm{d}t+\beta(\bm{X}_{i},\bm{X}_{j})\mathrm{d}t, \displaystyle\forall i,j\in[N],\ i\neq j. Here [N]=\{1,\dots,N\} , and this notation is used consistently throughout the article. A mean-field scaling factor \frac{1}{N} is incorporated in the interaction summation in ( 1.1 ). One of our key regularity assumptions requires the initial weight configuration to satisfy \displaystyle\max_{i,j\in[N]}|\bm{w}_{i,j}(0)|\sim O(1),\quad\text{as }N\to\infty, which is preserved for all t>0 if one further assumes that \alpha,\beta are L^{\infty} bounded. This scaling regime preserves two fundamental characteristics in mean-field analysis: the total interaction exerted on or by any individual agent remains O(1) as N\to\infty ; no single agent dominates the dynamics as pairwise interactions contribute only O(\frac{1}{N}) . 1.2. A brief review of classical mean-field theory The classical study of mean-field limits typically concerns systems of identical agents where interaction weights remain constant (up to the mean-field scaling factor \frac{1}{N} ). This line of research dates back to the seminal works of [ 13 , 19 , 37 , 38 , 41 ] , where sufficient regularity conditions (e.g., bounded Lipschitz coefficients) ensured rigorous derivation of the mean-field limit. Contemporary research has made significant progress in more singular interaction dynamics, see for example the reviews [ 14 , 15 , 26 , 31 ] . In the context of exchangeable systems of the form ( 1.1a ) with fixed interaction weights \bm{w}_{i,j}(t)\equiv 1 and bounded Lipschitz coefficients, we briefly outline a few classical conclusions of mean-field theory: • Propagation of chaos : The N -particle system becomes asymptotically decoupled as N\to\infty , such that under i.i.d. initial conditions, individual agent trajectories converge to i.i.d. copies of the McKean-Vlasov SDE \displaystyle\mathrm{d}\overline{\bm{X}}_{i} \displaystyle=\mu(\overline{\bm{X}}_{i})\mathrm{d}t+\nu\mathrm{d}\bm{B}_{i}+\int_{\mathbb{D}}\sigma(\overline{\bm{X}}_{i},y)\overline{f}(t,\mathrm{d}y)\ \mathrm{d}t characterized by a common law \overline{f}(t,\cdot)=\mathrm{Law}(\overline{\bm{X}}_{i}(t)) (in Kac’s sense [ 41 ] ). More precisely, for any t\geq 0 , (1.2) \displaystyle\sup_{i\in[N]}\mathbb{E}|\bm{X}_{i}(t)-\overline{\bm{X}}_{i}(t)|\leq C(t)N^{-\frac{1}{2}}. • Vlasov equation : The limiting law \overline{f}(t,\cdot) in the McKean-Vlasov SDE satisfies the following Vlasov PDE: (1.3) \displaystyle\partial_{t}f(t,x)+\nabla\cdot\bigg[\bigg(\mu(x)+\int_{\mathbb{D}}\sigma(x,y)f(t,\mathrm{d}y)\bigg)f(t,x)\bigg]=\frac{\nu^{2}}{2}\Delta f(t,x). One can directly characterize the convergence of the original system of SDEs (i.e. ( 1.1a ) with \bm{w}_{i,j}(t)\equiv 1 ) to the Vlasov PDE by introducing the empirical measure \frac{1}{N}\sum_{i=1}^{N}\delta_{\bm{X}_{i}(t)} . As an example, under mild moment assumptions, the following convergence holds: (1.4) \mathbb{E}\bigg[W_{1}\bigg(\frac{1}{N}\sum_{i=1}^{N}\delta_{\bm{X}_{i}(t)}\ ,\ \overline{f}(t,\cdot)\bigg)\bigg]\leq C(t)N^{-\theta}, where W_{1} is the Wasserstein- 1 distance. The exponent \theta depends on the spatial dimension d and generally satisfies \theta<\frac{1}{2} (see, e.g., [ 18 ] ). This phenomenon arises from the use of Wasserstein distance: The distributional convergence with respect to the sample size N exhibits slower a priori rates in higher dimensions, as discussed in [ 7 , 20 ] . For specific dual test functions \varphi\in\mathrm{Lip}_{b}(\mathbb{D}) , the classical N^{-\frac{1}{2}} convergence rate emerges. For example, (1.5) \mathbb{E}\left[\ \left|\int_{\mathbb{D}}\varphi(x)\left(\frac{1}{N}\sum_{i=1}^{N}\delta_{\bm{X}_{i}(t)}(\mathrm{d}x)-\overline{f}(t,\mathrm{d}x)\right)\right|\ \right]\leq C(t)N^{-\frac{1}{2}}. One can also establish the stability of empirical measures without assuming initial i.i.d. sampling from a prescribed distribution. For any solution f to the Vlasov equation and any particle system (\bm{X}_{i}(t))_{i\in[N]} with deterministic initial data (X_{i}(0))_{i\in[N]} , the stability estimate (1.6) \displaystyle\mathbb{E}\bigg[W_{1}\bigg(\frac{1}{N}\sum_{i=1}^{N}\delta_{\bm{X}_{i}(t)},f(t,\cdot)\bigg)\bigg]\leq C(t)W_{1}\bigg(\frac{1}{N}\sum_{i=1}^{N}\delta_{X_{i}(0)},f(0,\cdot)\bigg)+C(t)N^{-\theta} can be established through a W_{1} -stability estimate of the Vlasov PDE combined with an asymptotic independence analysis. (In the purely deterministic case \nu=0 where the system reduces to ODEs, the empirical measure’s time evolution exactly satisfies the Vlasov PDE as a distributional solution and the N^{-\theta} error term vanishes. See classical results in [ 19 , 37 , 38 ] .) 1.3. A first intuition: Propagation of independence In recent years, there has been a growing interest in non-exchangeable systems, where swapping the states of agents \bm{X}_{i} and \bm{X}_{j} can alter the overall dynamics unless all associated weights are correspondingly adjusted. This difference necessitates a re-examination of classical concepts in mean-field theory. An intuition that remains valid is that, when the contribution of any single agent is still small (say, O(1/N) ), the finite- N system could exhibit asymptotic independence. However, a classical propagation of chaos result, where agents (\bm{X}_{i})_{i\in[N]} become asymptotically i.i.d., is not expected. For non-exchangeable systems with non-adaptive weights (e.g., considering ( 1.1a ) alone), such independence has been validated to varying degrees in recent works such as [ 4 , 6 , 29 , 35 ] . In our context of fully adaptive weights, this intuition must be formulated via a more complex McKean-Vlasov SDE corresponding to the full system ( 1.1 ). The auxiliary processes ((\overline{\bm{X}}_{i})_{i\in[N]},(\overline{\bm{w}}_{i,j})_{i,j\in[N]}) computed from this McKean-Vlasov system propagate a form of structured independence, such that, any subcollection of these N+N^{2} processes is mutually independent, provided their underlying agent indices are disjoint. For example, the processes \overline{\bm{X}}_{1},\overline{\bm{X}}_{2},\overline{\bm{w}}_{3,4},\overline{\bm{w}}_{5,6} are independent, whereas \overline{\bm{X}}_{1} and \overline{\bm{w}}_{1,2} are necessarily correlated because, in the equation for the weights ( 1.1b ), the influence of \overline{\bm{X}}_{1} on the dynamics of \overline{\bm{w}}_{1,2} is not diluted by a factor of 1/N . If both the original SDE system ( 1.1 ) and this McKean-Vlasov system start from the same initial data, then under suitable assumptions, one can establish the following estimate, which is the direct analogue of the classical propagation of chaos result ( 1.2 ): (1.7) \displaystyle\sup_{i\in[N]} \displaystyle\mathbb{E}\Big[|\bm{X}_{i}(t)-\overline{\bm{X}}_{i}(t)|\Big]\leq C(t)N^{-\frac{1}{2}}, \displaystyle\sup_{i,j\in[N],i\neq j} \displaystyle\mathbb{E}\Big[|\bm{w}_{i,j}(t)-\overline{\bm{w}}_{i,j}(t)|\Big]\leq C(t)N^{-\frac{1}{2}}. In the following two subsections, we rigorously formulate this structured independence and illustrate the corresponding McKean-Vlasov SDE system. 1.4. State-weight triplets and independent mixture sampling We first present the idea of how to construct the structured independence described above. The probability spaces introduced here

Read the complete text