Weak Adversarial Neural Pushforward Mappings for Fokker-Planck Equations

Andrew Qing He, Wei Cai · 2025

Read Weak Adversarial Neural Pushforward Mappings for Fokker-Planck Equations by Andrew Qing He, Wei Cai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14575.txt.

Introduction

Andrew Qing He and Wei Cai present a method in 2025 for solving Fokker-Planck equations, which describe how a probability distribution drifts and spreads over time. Direct solvers struggle in high dimensions. A sampler that can draw from the solution distribution is often enough.

Their weak adversarial training learns a neural pushforward map that generates the solution distribution. A weak formulation moves derivatives onto simple plane wave test functions, where they are known exactly. The problem becomes a Monte Carlo importance sampling task with a natural sampling strategy and probability conservation built in. Adversarial training pits the sampler against test functions that expose its errors. Sampling based solutions scale differently from grid based solvers for stochastic systems.

Catalog record

CREATORAndrew Qing He, Wei Cai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14575

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Weak Adversarial Neural Pushforward Mappings for Fokker-Planck Equations Andrew Qing He, Wei Cai Abstract This paper presents a novel method for solving Fokker-Planck equations by learning neural samplers via a weak adversarial framework. We represent the solution distribution through a neural pushforward map, bypassing the limitations of density-based methods. A key innovation is our use of computationally efficient plane-wave test functions, whose derivatives are explicitly computed—a treatment distinct from prior work. This approach handles distributions without densities and naturally enforces probability conservation. AMS Subject Classifications: 65N75, 68T07, 35Q84 1 Introduction In recent years, significant attention has been directed towards solving differential and integral equations using deep learning techniques, such as Physics-Informed Neural Networks (PINNs) [ 1 ] , the Deep Ritz method [ 8 ] , Weak Adversarial Networks (WAN) [ 6 ] , and others. A common element across these frameworks is the representation of the solution by a pointwise evaluation neural network —a deep neural network that takes a spatial or spatio-temporal coordinate as input and outputs an estimate of the solution’s value at that point. This offers a natural and intuitive way to represent a function. However, this approach is not always optimal. The intrinsic nature of the solution can sometimes suggest more suitable representations. This paper examines one such case: when the solution is a probability density function (PDF). Here, a pointwise evaluation network is often suboptimal for two primary reasons: 1. The solution may not be absolutely continuous with respect to the Lebesgue measure on \mathbb{R}^{n} (e.g., a Dirac \delta distribution), in which case a classical PDF does not exist. 2. It is exceedingly difficult to guarantee conservation of probability (a volume-preserving property), as exactly evaluating the integral of a neural network over an arbitrary domain is generally intractable. In such scenarios, a more natural strategy is to represent the solution distribution directly. We propose representing the solution via a neural pushforward mapping F_{\boldsymbol{\vartheta}} (parameterized by {\boldsymbol{\vartheta}} ), which transforms samples from a simple reference distribution (e.g., uniform or standard Gaussian) of potentially different dimensionality into the target solution distribution through a pushforward operation. A similar methodology is employed in [ 9 , 10 , 11 , 12 ] . However, these works typically employ a PINN-style loss that requires the existence and regularity of the PDF. This, in turn, constrains the network F_{\boldsymbol{\vartheta}} to be invertible and Jacobian-friendly (e.g., Real NVP [ 13 ] , as used in normalizing flows), and incurs a high computational cost from calculating second-order derivatives of the density (which involves Jacobian determinant computations). In contrast, our method is based on the weak formulation of transport and Fokker-Planck equations. This allows us to employ more general deep neural networks for the mapping F_{\boldsymbol{\vartheta}} . We adopt the weak adversarial framework [ 6 , 5 ] , which reformulates the equation in its weak form. A test function in this formulation is parameterized as an adversarial network (acting as a “discriminator”, similar to GANs [ 14 ] ), and the pushforward mapping F_{\boldsymbol{\vartheta}} is trained adversarially to satisfy the equation. In our framework, F_{\boldsymbol{\vartheta}} can be any neural network that maps from a convenient base distribution (of arbitrary dimension) to the target space, with output dimension matching that of the target distribution. The trained network acts as an efficient sampler from the solution distribution. While the framework does not inherently provide an explicit expression for the probability density function, users who require one—and can ensure its existence—may still instantiate F_{\boldsymbol{\vartheta}} as an invertible, Jacobian-friendly network like Real NVP. Nevertheless, this only serves as an optional choice within our framework, not a requirement. The adversarial test function is treated in a distinct manner. Aligning with the mathematical philosophy of weak formulations, the test function should exhibit greater regularity and be more amenable to differential operators than the solution itself. In PDE theory, this implies the test functions should be smooth and exhibit suitable decay. But for numerically, this translates to a requirement for computational efficiency; the cost of differentiating the network should not substantially exceed the cost of evaluating it. To satisfy this condition, we select a specific, computationally efficient form for the test function: the plane wave function. This choice allows its partial derivatives to be computed explicitly and with the same complexity as evaluating the function itself, significantly enhancing the efficiency of the training process. It is worth noting that while plane waves have been employed as test functions in other works [ 2 , 3 ] , their treatment was fundamentally different as the requisite differential operators were not applied to them. Our method’s explicit computation of these operators on the test function is a novel and innovative aspect of this framework. 2 Methods 2.1 The Steady-State Fokker-Planck Equation We consider the steady-state Fokker-Planck equation (FPE) on \mathbb{R}^{n} , which describes the probability density function f(\mathbf{x}) of a stochastic process at equilibrium. The equation is given by: \mathcal{L}^{\dagger}f(\mathbf{x})=-\frac{1}{2}\sum_{i,j=1}^{n}\frac{\partial^{2}}{\partial x_{i}\partial x_{j}}\left[a_{ij}(\mathbf{x})f(\mathbf{x})\right]+\sum_{i=1}^{n}\frac{\partial}{\partial x_{i}}\left[b_{i}(\mathbf{x})f(\mathbf{x})\right]=0, (1) where \mathbf{x}=(x_{1},\dots,x_{n})^{T}\in\mathbb{R}^{n} , a_{ij}(\mathbf{x}) are the components of the state-dependent diffusion tensor \mathbf{A}(\mathbf{x}) , and b_{i}(\mathbf{x}) are the components of the drift vector \mathbf{b}(\mathbf{x}) . We assume the diffusion tensor \mathbf{A}(\mathbf{x}) is such that the differential operator \mathcal{L}^{\dagger} is elliptic (or possibly hypo-elliptic), ensuring the well-posedness of the problem. Furthermore, we seek a probability density function, which imposes the natural normalization constraint: \int_{\mathbb{R}^{n}}f(\mathbf{x})\,\mathrm{d}\mathbf{x}=1,\quad\text{and}\quad f(\mathbf{x})\geq 0. (2) 2.1.1 Weak Formulation and Adversarial Formulation A key challenge in solving ( 1 ) directly is that the solution f may be a generalized function (e.g., a Dirac delta distribution) lacking a classical density. To circumvent this, we employ the weak formulation of the PDE. Multiplying ( 1 ) by a smooth test function \rho(\mathbf{x}) and applying integration by parts twice (assuming appropriate decay conditions at infinity of f ), we obtain the weak form: \int_{\mathbb{R}^{n}}f(\mathbf{x})\left(-\frac{1}{2}\sum_{i,j=1}^{n}a_{ij}(\mathbf{x})\frac{\partial^{2}\rho(\mathbf{x})}{\partial x_{i}\partial x_{j}}-\sum_{i=1}^{n}b_{i}(\mathbf{x})\frac{\partial\rho(\mathbf{x})}{\partial x_{i}}\right)\mathrm{d}\mathbf{x}=0. (3) This must hold for all test functions \rho in a suitable class of smooth, bounded functions. Critically, this formulation does not require f to be differentiable. The weak form can be interpreted as an expectation under the probability measure associated with f : \mathbb{E}_{\mathbf{x}\sim f}\left[\mathcal{L}\rho(\mathbf{x})\right]=0,\quad\text{where}\quad\mathcal{L}\rho(\mathbf{x})=-\frac{1}{2}\sum_{i,j=1}^{n}a_{ij}(\mathbf{x})\frac{\partial^{2}\rho}{\partial x_{i}\partial x_{j}}-\sum_{i=1}^{n}b_{i}(\mathbf{x})\frac{\partial\rho}{\partial x_{i}}. (4) This expectation can be approximated efficiently via Monte Carlo sampling if one has access to samples from the distribution f . 2.1.2 Neural Parametrization of the Solution and Test Functions Our method parametrizes two core components: the solution f and the test functions \rho . Parametrizing the Solution ( f ) Instead of representing the density f directly, we represent the solution distribution implicitly via a pushforward map.We define a neural network F_{{\boldsymbol{\vartheta}}}:\mathbb{R}^{d}\rightarrow\mathbb{R}^{n} , parameterized by weights {\boldsymbol{\vartheta}} , that transforms samples from a simple base distribution (e.g., uniform or Gaussian) of dimension d into samples from the target distribution f in \mathbb{R}^{n} . The dimensions d and n need not be equal, providing flexibility in choosing the most convenient base distribution for sampling and optimization. If \mathbf{r}\sim\mathcal{P}_{\text{base}} , then \mathbf{x}=F_{{\boldsymbol{\vartheta}}}(\mathbf{r}) is a sample such that \mathbf{x}\sim f . This approach naturally enforces the normalization constraint and can represent distributions without a density. Parametrizing the Test Functions ( \rho ) Following the rationale in the introduction, we choose test functions that are computationally efficient and facilitate easy computation of their derivatives. A

Read the complete text