Weak Adversarial Neural Pushforward Method for the McKean–Vlasov / Mean-Field Fokker–Planck Equation
Andrew Qing He, Wei Cai · 2026
Read Weak Adversarial Neural Pushforward Method for the McKean–Vlasov / Mean-Field Fokker–Planck Equation by Andrew Qing He, Wei Cai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16186.txt.
Introduction
He and Cai extend a neural solver to the McKean-Vlasov mean-field Fokker-Planck equation. The hard part is a mean-field term, an average over the solution itself. Their pushforward network estimates that average by Monte Carlo sampling. No change to the network design is needed. For a quadratic interaction kernel, the term shrinks to a plain batch mean. Tests in up to 100 dimensions recovered the exact Gaussian solutions. Training took from 27 seconds to 10 minutes on one GPU.
Catalog record
| CREATOR | Andrew Qing He, Wei Cai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37493 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16186
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Weak Adversarial Neural Pushforward Method for the McKean–Vlasov / Mean-Field Fokker–Planck Equation Andrew Qing He, Wei Cai Abstract We extend the Weak Adversarial Neural Pushforward Method (WANPM) [ 1 ] to the McKean–Vlasov mean-field Fokker–Planck equation, covering both the stationary and time-dependent cases. The key observation is that the mean-field nonlinearity — an expectation under the solution distribution — is naturally estimated by Monte Carlo sampling from the pushforward network, requiring no change to the architecture and only minor modifications to the training loop. For the quadratic (granular media) interaction kernel, the interaction term reduces to the batch sample mean, eliminating secondary sampling entirely. We also identify a dimension-dependent frequency initialization rule for the adversarial test functions, necessary to avoid spurious minimizers. Numerical experiments on linear McKean–Vlasov benchmarks in 2, 5, 20, and 100 dimensions confirm accurate recovery of the exact Gaussian stationary and transient distributions, with training times ranging from 27 seconds (2D) to 10 minutes (100D) on a single GPU. Keywords: McKean–Vlasov equation, mean-field Fokker–Planck, neural pushforward map, weak adversarial network, plane-wave test functions, granular media, interacting particle systems. 1 Introduction The standard Fokker–Planck equation (FPE) governs the time evolution of the probability density \rho(t,\mathbf{x}) of a stochastic process whose drift and diffusion coefficients are prescribed functions of (t,\mathbf{x}) . A natural and physically important generalization arises when these coefficients depend on the evolving distribution \rho_{t} itself, yielding the McKean–Vlasov or mean-field Fokker–Planck equation: \partial_{t}\rho(t,\mathbf{x})=-\nabla_{\mathbf{x}}\cdot\bigl[b(\mathbf{x},\rho_{t})\,\rho(t,\mathbf{x})\bigr]+\frac{\sigma^{2}}{2}\,\Delta\rho(t,\mathbf{x}), (1) with initial condition \rho(0,\mathbf{x})=\rho_{0}(\mathbf{x}) . This class of equations appears in interacting particle systems and granular media [ 3 ] , Curie–Weiss spin systems, stochastic flocking [ 4 ] , mathematical finance and mean-field games [ 5 ] , and the mean-field analysis of overparameterized neural networks [ 6 ] . The nonlinearity of ( 1 ) — the unknown \rho appears both as the evolved density and inside the convolution integral defining the drift — makes it significantly harder to solve than the standard FPE. Particle methods exploit the propagation of chaos phenomenon [ 2 ] : as N\to\infty , the empirical measure of N interacting particles converges to the solution of ( 1 ). However, particle methods suffer from statistical noise, require a large number of particles for accuracy, and do not naturally produce a functional representation of \rho queryable at arbitrary points. Neural network methods for solving Fokker–Planck equations have been developed in recent works [ 7 , 8 , 9 , 10 ] . In [ 1 ] , the Weak Adversarial Neural Pushforward Method (WANPM) was introduced, which learns a neural pushforward map F_{\boldsymbol{\vartheta}}:\mathbb{R}^{d}\to\mathbb{R}^{n} that transforms samples from a simple base distribution into samples from the solution distribution, trained via an adversarial weak formulation with plane-wave test functions. WANPM avoids the need for explicit density representations, invertible architectures, or score estimation, and scales to high-dimensional problems. The present paper extends WANPM to the McKean–Vlasov setting. For the quadratic (granular media) kernel W(\mathbf{x}-\mathbf{y})=\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|^{2} , the mean-field nonlinearity reduces to a sample mean, requiring no secondary sampling. We develop both the stationary and time-dependent formulations, analyze training subtleties that arise from the self-referential structure of the equation, and demonstrate accuracy across dimensions from 2 to 100. The paper is organized as follows. Section 2 introduces the McKean–Vlasov equation and the quadratic kernel simplification. Section 3 develops WANPM for the stationary problem. Section 4 extends the method to the time-dependent case, including a discussion of adversarial frequency initialization. Section 5 presents numerical experiments, and Section 6 concludes. 2 The McKean–Vlasov Equation 2.1 Derivation from an Interacting Particle System Consider N particles with positions X_{i}(t)\in\mathbb{R}^{n} obeying dX_{i}=b\!\left(X_{i},\,\frac{1}{N}\sum_{j=1}^{N}\delta_{X_{j}(t)}\right)dt+\sigma\,dW_{i},\quad i=1,\ldots,N, (2) where W_{i} are independent standard Brownian motions and \delta_{\mathbf{y}} denotes the Dirac measure at \mathbf{y} . By the propagation of chaos phenomenon [ 2 ] , as N\to\infty the single-particle density satisfies the McKean–Vlasov equation ( 1 ). 2.2 The Aggregation–Diffusion Form The most widely studied instance takes the drift as the superposition of a confinement force and a pairwise interaction: b(\mathbf{x},\rho_{t})=-\nabla V(\mathbf{x})-\nabla(W*\rho_{t})(\mathbf{x})=-\nabla V(\mathbf{x})-\int_{\mathbb{R}^{n}}\nabla W(\mathbf{x}-\mathbf{y})\,\rho(t,\mathbf{y})\,d\mathbf{y}. (3) Substituting ( 3 ) into ( 1 ) yields the aggregation–diffusion equation \partial_{t}\rho=\nabla\cdot\bigl[(\nabla V)\rho\bigr]+\nabla\cdot\bigl[(\nabla W*\rho)\rho\bigr]+\frac{\sigma^{2}}{2}\Delta\rho. (4) The unknown \rho appears both as the evolved density and inside the convolution; this self-referential structure is the central mathematical difficulty. 2.3 Quadratic Interaction Kernel and Complexity Reduction We focus on the quadratic (granular media) kernel W(\mathbf{x}-\mathbf{y})=\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|^{2} , for which a key simplification holds. Proposition 1 ( [ 3 ] ) . Let W(\mathbf{x}-\mathbf{y})=\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|^{2} . Then \int_{\mathbb{R}^{n}}\nabla W(\mathbf{x}-\mathbf{y})\,\rho_{t}(\mathbf{y})\,d\mathbf{y}=\mathbf{x}-m(t),\qquad m(t)=\mathbb{E}_{\mathbf{y}\sim\rho_{t}}[\mathbf{y}]. (5) Proof. Direct computation: \nabla_{\mathbf{x}}W(\mathbf{x}-\mathbf{y})=\mathbf{x}-\mathbf{y} , so \int(\mathbf{x}-\mathbf{y})\rho_{t}(\mathbf{y})\,d\mathbf{y}=\mathbf{x}-m(t) . ∎ With confinement V(\mathbf{x})=\frac{\theta}{2}\|\mathbf{x}\|^{2} and the quadratic kernel, the full drift simplifies to b(\mathbf{x},\rho_{t})=-\theta\mathbf{x}-(\mathbf{x}-m(t))=-(\theta+1)\mathbf{x}+m(t)=:-\lambda\mathbf{x}+m(t), (6) where \lambda:=\theta+1 is the effective mean-reversion rate. The interaction integral reduces to a single scalar m(t)=\mathbb{E}[\mathbf{x}] , which is the sample mean of the primary training batch during training — no secondary sampling is needed. 3 WANPM for the Stationary McKean–Vlasov Equation 3.1 The Stationary Problem Setting \partial_{t}\rho=0 in ( 1 ) yields -\nabla\cdot\bigl[b(\mathbf{x},\rho)\,\rho(\mathbf{x})\bigr]+\frac{\sigma^{2}}{2}\Delta\rho(\mathbf{x})=0,\quad\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\,d\mathbf{x}=1. (7) This is a nonlinear eigenvalue problem: the operator acting on \rho depends on \rho itself through the convolution. For the quadratic kernel with V(\mathbf{x})=\frac{\theta}{2}\|\mathbf{x}\|^{2} , the drift ( 6 ) gives b(\mathbf{x},\rho)=-\lambda\mathbf{x}+m^{*} where m^{*}=\mathbb{E}_{\rho}[\mathbf{x}] . By the symmetry of V and W , the unique stationary solution is \rho^{*}=\mathcal{N}(0,\frac{\sigma^{2}}{2\lambda}I) with m^{*}=0 , giving b(\mathbf{x},\rho^{*})=-\lambda\mathbf{x} . 3.2 Weak Formulation To derive the weak form, multiply ( 7 ) by a smooth test function f(\mathbf{x}) and integrate over \mathbb{R}^{n} . The right-hand side becomes \int_{\mathbb{R}^{n}}f(\mathbf{x})\,\nabla\cdot\!\left[\rho(\mathbf{x})\,\nabla\!\left(V(\mathbf{x})+(W*\rho)(\mathbf{x})+\tfrac{\sigma^{2}}{2}\rho(\mathbf{x})\right)\right]d\mathbf{x}. One integration by parts moves the divergence onto \nabla f : =-\int_{\mathbb{R}^{n}}\sum_{i=1}^{n}\frac{\partial f}{\partial x_{i}}\left[\rho(\mathbf{x})\,\frac{\partial}{\partial x_{i}}\!\left(V(\mathbf{x})+(W*\rho)(\mathbf{x})+\tfrac{\sigma^{2}}{2}\rho(\mathbf{x})\right)\right]d\mathbf{x}. Separating the nonlinear diffusion term \frac{\sigma^{2}}{2}\rho from the remaining drift and applying integration by parts once more to that term gives \displaystyle=-\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\sum_{i=1}^{n}\frac{\partial f}{\partial x_{i}}\frac{\partial}{\partial x_{i}}\!\Bigl(V(\mathbf{x})+(W*\rho)(\mathbf{x})\Bigr)\,d\mathbf{x}+\frac{\sigma^{2}}{2}\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\sum_{i=1}^{n}\frac{\partial^{2}f}{\partial x_{i}^{2}}\,d\mathbf{x}. Expanding the interaction term (W*\rho)(\mathbf{x})=\int_{\mathbb{R}^{n}}W(\mathbf{x}-\mathbf{y})\rho(\mathbf{y})\,d\mathbf{y} and collecting by role, the right-hand side decomposes as -E_{V}-E_{W}+E_{D}=0, (8) where \displaystyle E_{V} \displaystyle=\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\sum_{i=1}^{n}\frac{\partial f(\mathbf{x})}{\partial x_{i}}\frac{\partial V(\mathbf{x})}{\partial x_{i}}\,d\mathbf{x}, (9) \displaystyle E_{W} \displaystyle=\int_{\mathbb{R}^{n}}\!\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\rho(\mathbf{y})\sum_{i=1}^{n}\frac{\partial f(\mathbf{x})}{\partial x_{i}}\frac{\partial W}{\partial x_{i}}(\mathbf{x}-\mathbf{y})\,d\mathbf{y}\,d\mathbf{x}, (10) \displaystyle E_{D} \displaystyle=\frac{\sigma^{2}}{2}\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\sum_{i=1}^{n}\frac{\partial^{2}f(\mathbf{x})}{\partial x_{i}^{2}}\,d\mathbf{x}. (11) Equation ( 8 ) is the weak stationarity condition that the pushforward network is trained to satisfy. Following [ 1 ] , we choose plane-wave test functions f^{(k)}(\mathbf{x})=\sin(\mathbf{w}^{(k)}\cdot\mathbf{x}+b^{(k)}) , whose derivatives are all analytic: \nabla f^{(k)}(\mathbf{x})=\mathbf{w}^{(k)}\cos(\mathbf{w}^{(k)}\cdot\mathbf{x}+b^{(k)}),\qquad\Delta f^{(k)}(\mathbf{x})=-\|\mathbf{w}^{(k)}\|^{2}\sin(\mathbf{w}^{(k)}\cdot\mathbf{x}+b^{(k)}). (12) For the quadratic kernel, substituting ( 6 ) into E_{V}+E_{W} and using \nabla W(\mathbf{x}-\mathbf{y})=\mathbf{x}-\mathbf{y} gives the combined drift contribution (E_{V}+E_{W})\big|_{\text{quad}}=\int_{\mathbb{R}^{n}}\rho(\mathbf{x})\,(-\lambda\mathbf{x}+m^{*})\cdot\mathbf{w}^{(k)}\cos(\mathbf{w}^{(k)}\cdot\mathbf{x}+b^{(k)})\,d\mathbf{x}, (13) where m^{*}=\mathbb{E}_{\rho}[\mathbf{x}] is the only quantity depending nonlinearly on \rho . 3.3 Neural Parametrization We parametrize the stationary distribution \rho^{*} via a neural pushforward map F_{\boldsymbol{\vartheta}}:\mathbb{R}^{d}\to\mathbb{R}^{n} , where d is the dimension of the base distribution (not necessarily equal to n ). If \mathbf{r}\sim\pi_{\mathrm{base}} , then \mathbf{x}=F_{\boldsymbol{\vartheta}}(\mathbf{r}) is a sample from the learned distribution \rho_{\boldsymbol{\vartheta}} . The pushforward parametrization naturally enforces the normalization constraint. In the stationary setting, F_{\boldsymbol{\vartheta}} takes only \mathbf{r} as input. The K test functions have learnable parameters \eta=\{\mathbf{w}^{(k)},b^{(k)}\}_{k=1}^{K} . 3.4 Loss Function The training objective is the adversarial squared weak residual: \mathcal{L}[\boldsymbol{\vartheta},\eta]=\frac{1}{K}\sum_{k=1}^{K}\left[\frac{1}{M}\sum_{m=1}^{M}\Bigl(-E_{V}^{(k,m)}-E_{W}^{(k,m)}+E_{D}^{(k,m)}\Bigr)\right]^{2}, (14) where \{\mathbf{x}^{(m)}=F_{\boldsymbol{\vartheta}}(\mathbf{r}^{(m)})\}_{m=1}^{M} is a batch of pushed samples, the terms E_{V}^{(k,m)},E_{D}^{(k,m)} are the per-sample contributions to ( 9 )–( 11 ) evaluated via ( 12 ), and the mean m^{*} is approximated by the batch mean \hat{m}=\frac{1}{M}\sum_{m=1}^{M}F_{\boldsymbol{\vartheta}}(\mathbf{r}^{(m)}),\quad\mathbf{r}^{(m)}\sim\pi_{\mathrm{base}}, (15) computed from the same batch as the residual so that \partial\hat{m}/\partial\boldsymbol{\vartheta} contributes to the total gradient, enforcing the self-consistency constraint m^{*}=\mathbb{E}_{\rho_{\boldsymbol{\vartheta}}}[\mathbf{x}] through the optimization dynamics. 3.5