The latent variable proximal point algorithm for variational problems with inequality constraints
JØrgen S. Dokken (, ), Patrick E. Farrell (), Brendan Keith (), Ioannis P. A. Papadopoulos (), Thomas M. Surowiec · 2025
Read The latent variable proximal point algorithm for variational problems with inequality constraints by JØrgen S. Dokken (, ), Patrick E. Farrell (), Brendan Keith (), Ioannis P. A. Papadopoulos (), Thomas M. Surowiec (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05672.txt.
Introduction
A latent-space solver for math problems with inequality bounds is set out by Jørgen Dokken and co-authors in a 2025 arXiv paper. Such bounds hem in answers at each point, as with blocks that cannot overlap. Their method recasts a known proximal method as a saddle search. Work then runs in a latent space where bounds are easy to keep by plain mixes.
Grid builds keep the map's shape, and solvers can step freely there. Tests span ten problems, from blocks and cracks to flow bends. Mesh-free speed shows in many cases for the first time. A curved-road case is handled too.
Catalog record
| CREATOR | JØrgen S. Dokken (, ), Patrick E. Farrell (), Brendan Keith (), Ioannis P. A. Papadopoulos (), Thomas M. Surowiec |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05672
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The latent variable proximal point algorithm for variational problems with inequality constraints JØrgen S. Dokken (, ), Patrick E. Farrell (), Brendan Keith (), Ioannis P. A. Papadopoulos (), Thomas M. Surowiec Abstract The latent variable proximal point (LVPP) algorithm is a framework for solving infinite-dimensional variational problems with pointwise inequality constraints. The algorithm is a saddle point reformulation of the Bregman proximal point algorithm. At the continuous level, the two formulations are equivalent, but the saddle point formulation is more amenable to discretization because it introduces a structure-preserving transformation between a latent function space and the feasible set. Working in this latent space is much more convenient for enforcing inequality constraints than the feasible set, as discretizations can employ general linear combinations of suitable basis functions, and nonlinear solvers can involve general additive updates. LVPP yields numerical methods with observed mesh-independence for obstacle problems, contact, fracture, plasticity, and others besides; in many cases, for the first time. The framework also extends to more complex constraints, providing means to enforce convexity in the Monge–Ampère equation and handling quasi-variational inequalities, where the underlying constraint depends implicitly on the unknown solution. In this paper, we describe the LVPP algorithm in a general form and apply it to ten problems from across mathematics. 1 Introduction Many problems in science, engineering, finance, and mathematics involve solving for a function subject to inequality constraints. Prominent examples include contact and damage in solid mechanics [ 90 , 34 ] , non-negativity of probability densities [ 116 ] , invariant domain properties of hydrodynamic flow models [ 139 ] , the pricing of American options [ 85 ] , and the convexity condition on solutions to the Monge–Ampère equation [ 121 ] . While there are many popular methods for such problems, in general, it is quite difficult to achieve mesh-independence —that the number of iterations required for convergence of an optimization solver or Newton-type method does not grow unboundedly as the discretization is refined [ 4 , 123 , 136 ] —or high-order accuracy . Where mesh-independent algorithms exist, they often return infeasible iterates [ 71 , 90 ] or are tightly tied to lowest-order discretizations (e.g., piecewise linear finite elements), as they rely on monotonicity properties of the basis functions employed [ 39 ] . Typically, they also require parameters to pass to infinity for convergence [ 79 , 82 , 2 ] . While some methods have been proposed using high-degree basis approximations to construct solutions (e.g., Bernstein polynomial-based discretizations [ 93 ] or biorthogonal bases [ 23 ] ), these approaches are limited to pointwise bound constraints, and are generally mesh-dependent. The first main challenge is the general lack of smoothness of many variational problems with inequality constraints. For example, the optimality conditions for the classical obstacle problem [ 92 ] are, in general, insufficiently regular to define a semismooth Newton method [ 78 , 129 , 130 , 79 ] at the continuous level. This can seemingly be avoided on the finite-dimensional level by first discretizing the problem, where semismooth Newton methods are directly related to certain active set solvers for complementarity problems [ 104 , 78 ] . However, the algorithm’s lack of validity at the continuous level manifests as mesh dependence [ 61 , §4] as demonstrated in Section 3.1 of this paper. The second main challenge is that the feasible set K , implied by the underlying inequality constraint(s), is not a vector space; therefore, one cannot take arbitrary linear combinations of functions in K and remain in the set. Most successful discretization approaches approximate solutions using linear combinations of basis functions, but this strategy conflicts with the geometry imposed by the constraints. Moreover, most practical algorithms for solving optimization problems or nonlinear equations involve additive updates, which again conflicts. In this paper, we introduce a general framework that adaptively regularizes variational problems with inequality constraints to overcome these challenges. The employed regularization permits K to be identified with a latent function space via a flexible class of smooth coordinate transformations arising from the set’s convex geometry. In turn, the framework enables the natural use of linear combinations of basis functions for approximation and additive update formulae. Furthermore, it results in regularized subproblems that are smooth enough to be solved with well-established mesh-independent techniques. We call this framework the latent variable proximal point algorithm (LVPP) and demonstrate some of its many potential applications by solving ten challenging problems from across mathematics: • The obstacle problem • The Signorini problem • Variational fracture • Multi-phase gradient flow • Quasi-variational inequalities • Gradient constraints • Eigenvalue constraints • Intersections of constraints • The eikonal equation • The Monge–Ampère equation The LVPP algorithm, which was first proposed by Keith and Surowiec in [ 89 ] , is highly adaptable to various problem types, and possesses the following key properties, among others: (i) an infinite-dimensional formulation; (ii) observed mesh and order independence in both the mesh size and discretization degree; (iii) a simple mechanism for enforcing pointwise constraints on the discrete level without the need for a projection; (iv) ease of implementation — the algorithm reduces to repeatedly solving a system of smooth, nonlinear PDEs without requiring specialized discretizations, making it compatible with high-order methods and standard finite element libraries; (v) robust numerical performance, as convergence does not rely on any parameter passing to infinity. No other framework satisfies all these properties simultaneously. For instance, penalty methods [ 79 , 82 , 2 ] satisfy (i), (ii), and (iv) but, without special care, often violate (iii) and (v), deliver infeasible solutions, and are known to be sub-optimal for high-order discretizations [ 73 , §3.1] . Similarly, although multigrid methods [ 76 , 83 , 94 ] satisfy (iii) and (v), they are mildly mesh dependent, tied to low-order discretizations, and the implementation may be delicate for general problems. In Section 2 , we describe the theoretical foundations of the LVPP algorithm. Section 3 is dedicated to applying LVPP to pointwise bound constraints and includes example applications for the obstacle problem, contact mechanics, variational fracture, multiphase free boundary problems, and obstacle-type quasi-variational inequalities. Section 4 focuses on more complicated convex constraints, such as norm and eigenvalue constraints, as well as how to handle multiple simultaneous inequality constraints. Finally, in Section 5 , we describe applications to solving fully-nonlinear first- and second-order PDEs, using the eikonal and Monge–Ampère equations as examples. Our findings are summarized in Section 6 . In all the examples, we derive our numerical methods via the solver diagram blueprint found in fig. 1 . Figure 1 : LVPP approximates a solution of a variational problem with inequality constraints by solving a sequence of nonlinear systems of PDEs. In practice these systems are discretized and the resulting nonlinear systems of equations are solved via Newton’s method. Supplementing the ten inequality constraint applications in this work, Appendix A considers problems with general linear equality constraints. Here, we show that LVPP reduces, in the appropriate limit, to the classical, Lagrange multiplier saddle-point formulation, as established and studied thoroughly in, e.g., [ 33 ] . 2 Theoretical foundations We formally derive the general LVPP algorithm, drawing together classical notions from convex analysis and optimization, such