A deep shotgun method for solving high-dimensional parabolic partial differential equations Journal: Journal of Scientific Computing
Wenjun Xu 1, 2], Wenzhong Zhang 2, 3] · 2025
Read A deep shotgun method for solving high-dimensional parabolic partial differential equations Journal: Journal of Scientific Computing by Wenjun Xu 1, 2], Wenzhong Zhang 2, 3] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15481.txt.
Introduction
Wenjun Xu and Wenzhong Zhang propose in 2025 a deep shotgun method for solving high-dimensional parabolic equations, a class that includes heat and pricing models. Deep learning approaches usually simulate many full random paths with tiny time steps, which is slow over long horizons. Their method instead uses only the distribution of path data, not whole trajectories, to train the solver.
Tests reached dimensions as high as ten thousand. The method stayed competitive in both speed and accuracy against established solvers. Avoiding full trajectories cuts the simulation burden sharply. The work extends neural solvers toward problems once far out of reach.
Catalog record
| CREATOR | Wenjun Xu 1, 2], Wenzhong Zhang 2, 3] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-15481
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A deep shotgun method for solving high-dimensional parabolic partial differential equations Journal: Journal of Scientific Computing Wenjun Xu 1, 2], Wenzhong Zhang 2, 3] Abstract Recent advances in deep learning makes solving parabolic partial differential equations (PDEs) in high dimensional spaces possible via forward-backward stochastic differential equation (FBSDE) formulations. The implementation of most existing methods requires simulating multiple trajectories of stochastic processes with a small step size of time discretization to ensure accuracy, hence having limited performance, especially when solving on a large time interval. To address such issue, we propose a deep “shotgun method” that does not exploit full trajectories, but only utilizes the data distribution of them. Numerical results including examples with dimensionality up to 10000 10000 demonstrate the competitiveness of the proposed shotgun method in both performance and accuracy. ∎ MSC 65C30 65M99 1 Introduction Solving partial differential equations (PDEs) numerically in high-dimensional spaces has been known as a challenging task because of the curse of dimensionality (CoD), namely, the number of unknowns in the numerical solver grows exponentially as the dimensionality increases. For high-dimensional parabolic PDEs such as the Black–Scholes equation for option pricing and the Hamilton–Jacobi–Bellman equation originated in stochastic optimal control problems, recent approaches such as DeepBSDE r1 , FBSNNs r2 and derived work r9 , the diffusion loss schemes r10 ; DiffusionLoss24 , DeepMartNet r11 ; cai2024soc , etc. take advantage of deep learning, where the deep neural networks (DNNs) are capable of approximating high-dimensional functions using a feasible number of trainable variables. Note that there’s no intention for a thorough enumeration. Unlike in the physics-informed neural network (PINN) r3 method that minimizes the mean squared residual of a PDE at spatially sampled positions, which is arguably the most prevailing general-purpose deep learning method for solving PDEs numerically, the loss function and the data collection of the above-mentioned methods are derived from the Pardoux–Peng theory r8 of nonlinear Feynman–Kac formula. The Pardoux–Peng theory bridges a parabolic PDE with a forward-backward stochastic differential equation (FBSDE) system. By matching the PDE formulation and the FBSDE formulation in different manners, different loss function schemes have been developed in these “deep FBSDE” numerical methods. Meanwhile, the data collection is similar across all these deep FBSDE methods: along discretized trajectories of the stochastic processes in the FBSDE formulation, towards a prescribed stopping time. There are two common benefits of the deep FBSDE methods compared to PINN for numerically solving high-dimensional parabolic PDEs. First, they effectively prevent explicit evaluation of the second-order partial derivatives in the PDE formulation, which, within typical deep learning frameworks, requires the full d\times d Hessian matrix and takes \mathcal{O}(d^{2}) computational cost when the spatial dimensionality is d\gg 1 . Second, the stochastic process trajectories in the FBSDE formulation are usually meaningful in practical problems, hence providing a helpful suggestion to the data distribution used for training. However, when simulating the trajectories in the deep FBSDE methods in high-dimensional space, the Euler–Maruyama method is the only discretization approach of decent efficiency, but its accuracy is limited to half order with respect to time discretization step size. Thus, existing deep FBSDE methods have to apply large discretization step numbers for better resulting accuracy. In some of the implementations, the outputs of DNNs along the trajectories are accumulated before backward propagation, which further slows down the training process. As a result, the capability of solving in a long time range is limited. To address such issue, we propose a deep “shotgun method” that utilizes the data distribution of trajectories instead of the full-length version considering all the time steps. This is made possible by the observation that each single-step discretization of the FBSDE system on a time interval with length 0<\Delta t\ll 1 is indeed an estimator of the PDE residual. The estimate gets improved as \Delta t\to 0^{+} , and with multiple independently sampled antithetic variates. The sample points are still picked from stochastic process trajectories, but using a much larger step size for simulation is sufficient in our numerical tests. The resulting method behaves like shot grouping on the selected sample points from trajectories, hence given the same name as in the shotgun sequencing of DNA strands r5 ; r6 . The rest of this paper is organized as follows. In Section 2 , we take a brief review of a few deep FBSDE methods with our concerns. Then, we introduce the deep shotgun method in Section 3 . The numerical tests are presented in Section 4 , with succeeding discussion in Section 5 . Some final concluding remarks are given in Section 6 . 2 A review of deep FBSDE methods Before introducing the shotgun method, we will first briefly review selected existing deep FBSDE methods that utilizes a FBSDE formulation to solve parabolic PDEs with deep learning. 2.1 The parabolic PDE and the FBSDE formulation We study d -dimensional parabolic PDEs of u(t,x) in the form \displaystyle\begin{split}\mathcal{L}[u]:=\partial_{t}u+\frac{1}{2}\mathrm{Tr}[\sigma\sigma^{T}\nabla\nabla u]+\mu\cdot\nabla u&=\phi,\quad t\in[0,T],\quad x\in\mathbb{R}^{d},\\ u(T,x)&=g(x),\quad x\in\mathbb{R}^{d}\end{split} (1) where \mu , \sigma , \phi are functions of t,x,u(t,x),\nabla u(t,x) , \cdots that map to \mathbb{R}^{d} , \mathbb{R}^{d\times d} and \mathbb{R} , respectively, and g:\mathbb{R}^{d}\to\mathbb{R} presents the terminal condition values at time T . For the rest of this paper, we use \nabla for the gradient with respect to spatial coordinates x . The goal of solving the PDE is usually finding an initial value at given x_{0}\in\mathbb{R}^{d} , i.e. finding u(0,x_{0}) . Under the Pardoux–Peng theory r4 ; r7 , the PDE ( 1 ) is associated with the following FBSDE system \displaystyle\begin{split}dX_{t}&=\mu dt+\sigma dW_{t},\quad t\in[0,T],\\ X_{0}&=x_{0},\\ dY_{t}&=\phi dt+{Z_{t}}^{T}\sigma dW_{t},\quad t\in[0,T],\\ Y_{T}&=g(X_{T}),\end{split} (2) where \{W_{t}:0\leq t\leq T\} is a d -dimensional standard Brownian motion, and the variables of functions \mu , \sigma and \phi consist of t,X_{t},Y_{t},Z_{t},\cdots instead of t,x,u(t,x),\nabla u(t,x) , \cdots , respectively. Indeed, the relationship between the stochastic process X_{t} , Y_{t} and Z_{t} in the FBSDE is given by the solution to the PDE as Y_{t}=u(t,X_{t}),\quad Z_{t}=\nabla u(t,X_{t}). (3) This can be verified using the Itô’s formula du(t,X_{t})=\left(\partial_{t}u+\frac{1}{2}\sigma^{T}\nabla\nabla u\sigma\right)dt+\nabla u^{T}(\mu dt+\sigma dW_{t})=\mathcal{L}[u]dt+\nabla u^{T}\sigma dW_{t}. With certain regularity conditions imposed on the functions \mu,\sigma and \phi , the FBSDE system has unique adapted solution. Numerically, the FBSDE system is usually discretized using the Euler–Maruyama method. Here, we consider the uniform time discretization 0=t_{0}<t_{1}<\cdots<t_{N}=T. The SDE of X_{t} and Y_{t} are discretized as \displaystyle\begin{split}X_{n+1}&=X_{n}+\mu(t_{n},X_{n},Y_{n},Z_{n},\cdots)\Delta t_{n}^{1}+\sigma(t_{n},X_{n},Y_{n},Z_{n},\cdots)\Delta W_{n},\\ Y_{n+1}&=Y_{n}+\phi(t_{n},X_{n},Y_{n},Z_{n},\cdots)\Delta t_{n}^{1}+Z_{n}^{T}\sigma(t_{n},X_{n},Y_{n},Z_{n},\cdots)\Delta W_{n},\end{split} (4) respectively, where \Delta t_{n}^{1}=t_{n+1}-t_{n} is the increment of time, and \Delta W_{n}=W_{n+1}-W_{n} is the increment of the Brownian motion on [t_{n},t_{n+1}] . The derived X_{n} , Y_{n} and Z_{n} are approximations of X_{t_{n}} , Y_{t_{n}} and Z_{t_{n}} from the continuous-time stochastic processes, respectively. 2.2 Deep FBSDE methods Here we enumerate a few deep FBSDE methods and discuss how the FBSDE formulation facilitates deep learning approaches. 2.2.1 Deep BSDE The Deep BSDE method r1 trains a DNN that accepts an instance of the Brownian motion W_{t} as the input, and takes Y_{N} as the output. The initial values at X_{0}=x_{0} are demanded, which are trainable variables Y_{0}=u(0,x_{0}) and Z_{0}=\nabla u(0,x_{0}) in the network. The value of Y_{N} , which is an approximation to u(t_{N},X_{N}) , is derived by simulating the X_{t} and Y_{t} trajectories, where in the discretization, sub-networks f^{(n+1)}_{\theta}\approx\nabla u(t_{n+1},\cdot) are applied to take the