Neural Network Convergence for Variational Inequalities
Yun Zhao, Harry Zheng · 2025
Read Neural Network Convergence for Variational Inequalities by Yun Zhao, Harry Zheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26535.txt.
Introduction
Yun Zhao and Harry Zheng show in 2025 that neural networks can solve variational inequalities, a class of problems with a free boundary that is hard to pin down. Such problems appear in optimal stopping, like deciding when to exercise an option. Their loss function builds the inequality in directly, so no stopping region must be guessed in advance. They prove networks exist whose loss shrinks to zero.
The pair then apply the method to an investment and stopping problem in finance. A duality trick turns the hard version into a linear one that their method handles. Tests cover American put options in high dimensions. Results support networks as a flexible solver for control problems.
Catalog record
| CREATOR | Yun Zhao, Harry Zheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-26535
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Network Convergence for Variational Inequalities Yun Zhao, Harry Zheng Abstract We propose an approach to applying neural networks on linear parabolic variational inequalities. We use loss functions that directly incorporate the variational inequality on the whole domain to bypass the need to determine the stopping region in advance and prove the existence of neural networks whose losses converge to zero. We also prove the functional convergence in the Sobolev space. We then apply our approach to solving an optimal investment and stopping problem in finance. By leveraging duality, we convert the nonlinear HJB-type variational inequality of the primal problem into a linear variational inequality of the dual problem and prove the convergence of the primal value function from the dual neural network solution, an outcome made possible by our Sobolev norm analysis. We illustrate the versatility and accuracy of our method with numerical examples for both power and non-HARA utilities as well as high-dimensional American put option pricing. Our results underscore the potential of neural networks for solving variational inequalities in optimal stopping and control problems. Keywords: Variational inequality, neural network approximation, convergence analysis, optimal investment and stopping. MSC2020 Subject Classification: 65K15, 68T07, 93E20, 60G40, 47J20. 1 Introduction Deep learning has revolutionized many fields, including computer vision, natural language processing, and reinforcement learning. In partial differential equations (PDEs), deep learning has shown strong promise in solving high-dimensional problems where traditional numerical methods are computationally expensive or infeasible. Recently, deep learning to PDEs has been extended to variational inequalities, essential for optimal stopping and free-boundary problems. Variational inequalities may be used to solve optimal stopping problems. There are also other approaches, such as martingales or Markovian chains, see Peskir and Shiryaev 2006 for a comprehensive review. For variational inequalities, one may try to derive the free boundary, then the optimal stopping time is the first time touching, see Ma et al. 2019 , or one may use the idea of Snell envelope to compare the continuation value and the immediate value, see Longstaff and Schwartz 2001 for a representative algorithm. Following the approaches mentioned above, the deep learning algorithms for optimal stopping problems can be separated into three categories: 1. Approximate the solution to variational inequalities. 2. Approximate the optimal stopping time. 3. Approximate the free boundary. We next review representative works in each approach and discuss their advantages and disadvantages. Most convergence results of deep neural networks are for PDEs. For instance, Sirignano and Spiliopoulos 2018 give sufficient conditions for the functional convergence of neural networks to quasi-linear parabolic PDEs. They also discuss optimal stopping problems, but the loss function depends on the unknown free boundary, so they have to determine the boundary by comparing the continuation value and the immediate value, which does not follow their convergence proof for a standard PDE. In Ito et al. 2021 , the authors use policy iterations and neural networks to solve Hamilton-Jacobi-Bellman-Isaacs (HJB-I) equations with convergence analysis. Some variational inequalities can be transformed to HJB-I equations, and their method can be applied to these problems. However, they only consider elliptic operators, and their algorithms are based on policy iterations, which is different from our direct approach to the minimum representation of variational inequalities. Alphonse et al. 2024 propose a weak adversarial neural network approach to solving variational inequalities with elliptic operators. They reformulate variational inequalities as a minimax problem and use neural networks to parametrize the solution and test functions, and then introduce a modified gradient descent ascent (GDA) algorithm to solve the optimization problem. The minimax approach ensures theoretical robustness but may require more computational resources. Huré et al. 2020 use neural networks to solve reflected backward stochastic differential equations (RBSDEs) related to variational inequalities, and design the algorithms by using different neural networks at every time step. Their convergence proof gives error bound in terms of the neural network approximation error and time discretization error. Our approach does not need to discretize the time variable, and only uses a single neural network for the whole domain. Another approach is to parameterize the optimal stopping time. Becker et al. 2019 and Becker et al. 2021 propose two deep learning algorithms to solve the optimal stopping problem in discrete time. They are based on the representation of the optimal stopping time in terms of a series of binary functions which take the values of state process at future time (backward) or past time (forward), and the value function is attained from the idea of Snell envelope. These algorithms are in discrete time and it is needed to consider the convergence from it to continuous time. One disadvantage is that they do not give the value function in the whole domain, but only at the initial time and state value, so it is inconvenient to evaluate further problems with this type of neural networks of stopping times. For instance, the derivatives of the value function would need to be approximated by finite difference method, which is often unstable with different grid sizes in practice, especially for second-order derivatives. Moreover, if there is an equation involving the first-order derivative, such as the mixed optimal stopping and control problem, it is time-consuming to evaluate the derivatives many times, making it unsuitable for these control problems. It is also possible to approximate the free boundary directly. Wang and Perdikaris 2021 propose to parameterize both the value function and free boundary and incorporate the conditions on free boundary into the loss function. The algorithm is tested up to two dimensional Stefan problem and is proved to be effective in practice. However, there is no convergence analysis, and it is not clear if it can be generalized for higher dimensions as the dimension of the free boundary would also increase and the framework of the network needs to change accordingly. More importantly, in general, we do not know the number of free boundaries for an optimal stopping problem, nor their monotonicity or relationships with each other. For instance, in Figure 1 of Ma et al. 2019 , the number of free boundaries and the continuation regions vary according to different parameters. Hence, it is difficult to estimate the free boundary for general optimal stopping problems. In this paper, we consider a mixed optimal control and stopping problem in continuous time, see Ma et al. 2019 . If we use the deep neural network for stopping times, we have to find a way to approximate the control process, and discuss the gap between discrete time and continuous time. If we use the deep neural network for free boundary, we have to know the basic properties of the unknown free boundary and it is difficult to be generalized to high dimensions. The value function is a solution to a nonlinear variational inequality that is typically difficult to solve. We turn to the dual method and formulate a dual optimal stopping problem. The dual value function satisfies a linear variational inequality that can be solved with deep neural networks, and the primal value function can then be recovered with the primal-dual relation. This approach depends crucially on the accuracy of the neural network approximation to the solution of the linear variational inequality. There are few results for convergence proof of