Convexity and strict convexity for compositional neural networks in high-dimensional optimal control
Lars Grüne 1 , Konrad Kleinberg 2 , Thomas Kruse 3 , Mario Sperl 4 1 Mathematical Institute, University of Bayreuth, Germany; e-mail: lars.gruene \texttt{a}⃝ uni-bayreuth.de 2 Department of Mathematics & Informatics, University of Wuppertal, Germany; e-mail: kleinberg \texttt{a}⃝ uni-wuppertal.de 3 · 2025
Read Convexity and strict convexity for compositional neural networks in high-dimensional optimal control by Lars Grüne 1 , Konrad Kleinberg 2 , Thomas Kruse 3 , Mario Sperl 4 1 Mathematical Institute, University of Bayreuth, Germany; e-mail: lars.gruene \texttt{a}⃝ uni-bayreuth.de 2 Department of Mathematics & Informatics, University of Wuppertal, Germany; e-mail: kleinberg \texttt{a}⃝ uni-wuppertal.de 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05339.txt.
Introduction
Lars Grüne and co-authors study when compositional neural networks keep convexity in high-dimensional optimal control tasks. Neural nets help beat the curse of dimensionality in such tasks, and their layered form fits functions built from nested parts.
They build on a 2022 frame by Kang and Gong for net approximations of compositional maps in control. The authors check which convexity and strict convexity traits pass through those nets. Keeping convexity matters, since it can make the control task solvable to a true best rather than a local one, a key point for safe use.
Catalog record
| CREATOR | Lars Grüne 1 , Konrad Kleinberg 2 , Thomas Kruse 3 , Mario Sperl 4 1 Mathematical Institute, University of Bayreuth, Germany; e-mail: lars.gruene \texttt{a}⃝ uni-bayreuth.de 2 Department of Mathematics & Informatics, University of Wuppertal, Germany; e-mail: kleinberg \texttt{a}⃝ uni-wuppertal.de 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05339
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Convexity and strict convexity for compositional neural networks in high-dimensional optimal control Lars Grüne 1 , Konrad Kleinberg 2 , Thomas Kruse 3 , Mario Sperl 4 1 Mathematical Institute, University of Bayreuth, Germany; e-mail: lars.gruene \texttt{a}⃝ uni-bayreuth.de 2 Department of Mathematics & Informatics, University of Wuppertal, Germany; e-mail: kleinberg \texttt{a}⃝ uni-wuppertal.de 3 Department of Mathematics & Informatics, University of Wuppertal, Germany; e-mail: tkruse \texttt{a}⃝ uni-wuppertal.de 4 Mathematical Institute, University of Bayreuth, Germany; e-mail: mario.sperl \texttt{a}⃝ uni-bayreuth.de Abstract Neural networks (NNs) have emerged as powerful tools for solving high-dimensional optimal control problems. In particular, their compositional structure has been shown to enable efficient approximation of high-dimensional functions, helping to mitigate the curse of dimensionality in optimal control problems. In this work, we build upon the theoretical framework developed by Kang & Gong (SIAM J. Control Optim. 60(2):786-813, 2022), particularly their results on NN approximations for compositional functions in optimal control. Theorem 6.2 in Kang & Gong (SIAM J. Control Optim. 60(2):786-813, 2022) establishes that, under suitable assumptions on the compositional structure and its associated features, optimal control problems with strictly convex cost functionals admit a curse-of-dimensionality-free approximation of the optimal control by NNs. We extend this result in two directions. First, we analyze the strict convexity requirement on the cost functional and demonstrate that reformulating a discrete-time optimal control problem with linear transitions and stage costs as a terminal cost problem ensures the necessary strict convexity. Second, we establish a generalization of Theorem 6.2 in Kang & Gong (SIAM J. Control Optim. 60(2):786-813, 2022) which provides weak error bounds for optimal control approximations by NNs when the cost functional is only convex rather than strictly convex. 1 Introduction High-dimensional problems arise naturally in a multitude of applications, e.g., partial differential equations, (stochastic) optimal control, and stability of dynamical systems. For such tasks, many conventional numerical algorithms are subject to the curse of dimensionality (COD) (see, e.g., [ 3 , 29 , 30 ] ). This means that their computational complexity to obtain a solution grows exponentially with the problem dimension and thus renders such algorithms impractical in high dimensions. The utilization of machine learning, in particular through (deep) neural networks (NNs), has demonstrated empirical success in various high-dimensional tasks which were previously intractable due to the COD (see, e.g., [ 14 , 4 , 8 , 2 , 1 , 24 , 35 , 22 ] ). The COD is particularly pronounced in optimal control when grid or mesh-based methods are employed to solve the associated Hamilton–Jacobi–Bellman (HJB) equations. Early contributions already investigated the use of neural networks to approximate optimal value functions or feedback laws in nonlinear control problems (see, e.g., [ 36 , 27 , 5 ] ). More recently, this line of research has been extended to high-dimensional settings, where neural networks have been employed to approximate optimal value functions and compute feedback laws in problems with state dimensions beyond the reach of traditional grid-based approaches (see, e.g., [ 20 , 21 , 26 , 25 , 38 ] ). It is important to emphasize that, although neural networks (NNs) are universal approximators for continuous functions (see, e.g., [ 6 , 15 ] ), in general, NN approximations of functions with high-dimensional input are subject to the COD (see, e.g., [ 23 , 31 , 13 ] ). Thus, the objective of attaining theoretical guarantees for when and why NNs overcome the COD has inspired a broad and active field of research. A variety of such results have been obtained in different contexts: for instance, for (control) Lyapunov functions [ 12 , 37 ] , for partial (integro-)differential equations [ 16 , 10 ] , and for problems in (stochastic) optimal stopping and control [ 33 , 18 , 11 , 17 ] . One particular mechanism that allows NNs to mitigate the COD is when the target function exhibits favorable structural properties, such as a compositional structure in terms of lower-dimensional components. The role of compositionality in enabling efficient approximation has been emphasized in [ 32 ] and investigated further in various directions (see, e.g., [ 18 , 19 , 9 , 34 , 7 , 12 , 37 ] ). In this paper, we explore the role of compositionality in optimal control problems to obtain curse-of-dimensionality-free representations using neural networks. To this end, we build on the theory of neural network approximation for compositional functions developed in [ 18 ] , with a particular focus on the results in Section 6 in this reference. It has been established in [ 18 , Theorem 6.2] that, under suitable assumptions on the compositional structure and its so-called compositional features, optimal control problems with terminal costs (also known as Mayer term) that are strictly convex in the control admit a curse-of-dimensionality-free representation of the optimal control. We extend this result in two main directions. First, we examine the strict convexity assumption on the terminal cost. We demonstrate that the reformulation of a linear optimal control problem with stage costs as a terminal cost problem ensures the necessary strict convexity. Second, we prove a generalization of [ 18 , Theorem 6.2] that requires only convexity in the control input, rather than strict convexity. This relaxation comes at the expense that the network yields a control that only approximates the optimal value (a so-called “weak approximation”) rather than a control that approximates the optimal trajectory (a so-called “strong approximation”). The outline of the paper is as follows: In Section 2 we collect some preliminary results from the literature. In Section 3 , we present a neural network approximation result for discrete time optimal control problems with separated stage costs. This can be seen as a distillation of a problem class for which [ 18 , Theorem 6.2] can be applied. In Section 4 we prove the extensions of Theorem 6.1 and Theorem 6.2 in [ 18 ] for cost functionals that are convex with respect to the control input, respectively. Finally, Section 5 concludes the paper. We close this introductory section by establishing notation which is employed throughout the remainder of the paper. For a function \psi\colon\mathbb{R}^{n}\times\mathbb{R}^{q}\to\mathbb{R}^{q} , (x,u)\mapsto\psi(x,u) , and for k\in\mathbb{N} , we denote for x\in\mathbb{R}^{n} and u\in\mathbb{R}^{q} the iterates \psi^{k}(x,u)\coloneqq\psi(x,\psi^{k-1}(x,u)) with the convention \psi^{0}(x,u)\coloneqq u . Further, for a function f\colon\mathbb{R}^{n}\times\mathbb{R}^{q}\to\mathbb{R}^{n} and U=(u_{1},\dots,u_{N})\in\mathbb{R}^{qN} for some N\in\mathbb{N} , we define for any k\in\{1,\dots,N\} the k -fold composition of f via f^{k+1}(x,\cdot)(U):=f\big(f^{k}(x,\cdot)(U),\,u_{k}\big) with f^{0}(x,\cdot)(U)=x . Unless explicitly stated otherwise, for any vector x\in\mathbb{R}^{n} and any matrix A\in\mathbb{R}^{n\times n} we write \|x\| and \|A\| for the Euclidean norm of x and the corresponding induced norm of A , respectively. For x\in\mathbb{R}^{n} and r\geq 0 we define \mathcal{B}_{r}(x)\coloneqq\{y\in\mathbb{R}^{n}\mid\|x-y\|\leq r\} , i.e., the closed Euclidean ball of radius r centered at x . Further, for n,m\in\mathbb{N} and a compact set \Omega\subset\mathbb{R}^{n} let W^{\infty}_{m}(\Omega) denote the space of all functions f\colon\Omega\to\mathbb{R} whose derivatives up to order m exist almost everywhere and satisfy for every multiindex \alpha\in\mathbb{N}^{n} with \lvert\alpha\rvert\leq m that \lVert D_{\alpha}f\rVert_{\infty,\Omega}<\infty , where \lVert\cdot\rVert_{\infty,\Omega} denotes the essential supremum norm. 2 The compositional framework and applications in optimal control 2.1 Preliminaries on compositional functions Throughout this paper, we use the concept of compositional functions as introduced in [ 18 , Definition 3.1] and