Structure Preserving Approximation of Semiconcave Functions Karl Kunisch karl.kunisch@uni-graz.at, Donato Vásquez-Varas dvasquez@dim.uchile.cl , donato.vasquez-varas@ricam.oeaw.ac.at Abstract This article addresses structure-preserving smooth approximation of semiconcave functions. semiconcave functions are of particular interest because they naturally arise in a variety of variational problems, including optimal feedback control, game theory, and optimal transport. We leverage the fact that any semiconcave function can be represented as the infimum of a countable family of C 2 C^{2} functions. This infimum is expressed in a form that allows approximation by finitely many functions, combined with smoothing operations, such that each element of the approximating sequence remains semiconcave. The active sets of indices contributing to the representation of the semiconcave function and its approximations are analyzed in detail. Moreover, we show that the gradients of the elements in the expansion of the approximating functions form a probability distribution, a property of particular interest for the value function in optimal control. Approximation results are established in C ⁡ ( Ω ¯ ) C(\bar{\Omega}) and in W 1 , p ​ ( Ω ) W^{1,p}(\Omega) for p ∈ [ 1 , ∞ ) p\in[1,\infty) and p = ∞ p=\infty . Finally, numerical results are presented to illustrate the approach on a test example. Keywords: semiconcavity, approximation of semiconcave functions, exponential distance function, feedback synthesis. AMS classification: 26B25, 49J52, 41A30, 49L25. 1 Introduction This work is concerned with the approximation of semiconcave functions. Here we say that for a convex, open, and bounded set \Omega\subset\mathbb{R}^{d} and C>0 a function v\in C(\overline{\Omega}) is C- semiconcave if the mapping x\mapsto v(x)-\frac{C}{2}|x|^{2} is concave. We are particularly interested in approximations schemes which preserve the semiconcavity structure and in their asymptotic limits. Our main motivation for studying these type of functions lies in their connection with control theory. Indeed, under appropriate hypotheses, the value function of an optimal control problem is semiconcave (see [ 6 ] and [ 3 ] ). In the same direction, the semiconcavity is a natural regularity property for certain Hamilton-Jacobi-Bellman equations (see [ 18 , 9 , 11 ] ), since it provides uniqueness and it is connected with the developed of maxplus algebra methods (see [ 1 , 10 , 13 ] ). Further, Lyapunov semiconcave functions can be used to design discontinuous feedback laws (see [ 25 , 26 ] ) for problems that do not admit smooth ones. In [ 20 ] the existence of a sequence of smooth consistent feedback laws is proved provided that the value functions of the underlying control problem is semiconcave, whereas in [ 19 ] this result is used to prove the convergence of a machine learning scheme for the synthesis of optimal feedback-laws. Besides optimal control, semiconcave functions also arise in optimal transport [ 27 ] , where they are crucial for the regularity and stability of transport maps, and in the analysis of free boundary value problems, where they help to characterize the structure of the free boundary [ 14 ] . Let us also mention that in the literature also the terminology ’weakly-convex’ is used, which would, in analogy to the present setting, be referred to as semiconvex. We mention, for instance, [ 16 ] where weakly-convex functions are learned by means of neural networks and used as sparsity promoting regularizers in image reconstruction problems. In this paper we develop a method for approximating semiconcave functions with the property that all elements of the approximating family preserve semiconcavity. In order to achieve this, we design a parametrization which corresponds to a regularized version of the minimum of an array of real numbers applied to a family of smooth parametrized functions. Additionally, by means of analyzing the gradients of the regularized functions, we identify a family of sets in which the convergence of the gradients of the approximation is uniform. Remarkably, this family covers part of the discontinuities of the approximated function. As we will explain, this is particularly relevant for the approximation of solutions to Hamilton Jacobi Bellman equations. To the best of our knowledge, semiconcave preserving parametrizations have not been addressed yet. However, there are many contributions to the approximation of convex functions. We point out that many of them use as starting point the fact that convex functions are the maximum of a family of affine functions. In [ 4 ] , they are parametrized by the maximum of a finite number of affine functions, which are learned by an alternating optimization method. The convergence of this approach together with an initilization method can be found in [ 15 ] under further assumptions on the initial guess of the parameters. Concerning neural network approaches, Input Convex Neural Networks (ICNN) are introduced in [ 2 ] . They consist in a fully connected neural network with non-negative weights and increasing convex activation function. In the case of ReLU activation these types of neural networks are universal approximators of globally Lipschitz continuous and convex functions, see [ 17 ] . This approach is extended in [ 7 ] by Input Convex Recurrent Neural Network (ICRNN), where a recurrent neural network is considered. The authors used this to estimate the dynamics of a control process in a manner that the resulting approximated control problem is convex. In [ 28 ] the GroupMax Neural Network architecture is proposed and its universal approximation property with respect to convex functions is proved. Similarly to ICNN, GroupMax Neural Networks utilize increasing convex activation functions together with positive weights. The main difference between them is that GroupMax Neural Networks consider group maximization layers. In the previous cases the approximation is convex and Lipschitz, but it is not smooth. In contrast, in [ 5 ] Log-sum-exp neural networks are presented which are based on using the Log-Sum-Exp function to approximate the maximum of a family of affine functions. This architecture is smooth and it enjoys the universal approximation property for convex functions. A closer connection between semiconcavity and neural networks can be found in [ 8 ] , where a neural network architecture based on the min-plus algebras is proposed. The approximation is constructed as the minimum of a family of functions which are quadratic in the space variables and also time dependent. This corresponds to a semiconcave approximation of the value function of an optimal control problem. The organization of the article is as follow. In Section 2 the semiconcavity preserving parametrization is introduced. In Section 3 a probabilistic interpretation connected with the parametrization is introduced which helps to analyze the behavior of the gradient of the approximation. Section ( 4 ) is devoted to investigate the convergence of the approximation. Additionally, in Section 5 a semi-concave test function is proposed for which the results of the proposed parametrization are illustrated and compared towards their numerical performance. Finally, in Section 6 the main results and conclusions of this work are summarized. Before continuing, we give some notation. For a vector x\in\mathbb{R}^{d} we denote its Euclidean norm by |x| , its p- norm by |x|_{p}=\left(\sum_{i=1}^{d}|x_{i}|^{p}\right)^{\frac{1}{p}} , for p\in[1,\infty) , and the supremum norm by |x|_{\infty}=\max_{i\in\{1,\ldots,d\}}|x_{i}| . For A\subset\mathbb{R}^{d} and B\subset X , with X a normed vector space equipped with a norm \left\lVert\cdot\right\rVert_{X} , we denote the space of continuous functions from A to B by C(A;B) equipped with the norm \left\lVert v\right\rVert_{C(A;B)}=\sup_{x\in A}\left\lVert v(x)\right\rVert_{X}, where v\in C(A;B) . If A is open or it is the closure of an open set which Lipschitz boundary, for m\in\mathbb{N} we denote the space of functions form A to B which are m times continuously differentiable by C^{m}(A;B) . For A\subset\mathbb{R}^{d} measurable, B a measurable space, and p\in[1,\infty) we denote the space of p- integrable functions from A to B by L^{p}(A;B) and the space of essentially bounded functions from A to B by L^{\infty}(A;B) equipped with their usual norms. For n,m\in\mathbb{N} we denote the space of matrices of dimension n\times m by \mathbb{R}^{n\times m} equipped with the operator norm which we denote by |A|=\sup_{x\in\mathbb{R}^{m}}\frac{|Ax|}{|x|} for A\in\mathbb{R}^{n\times m} . 2 Semiconcavity preserving parametrization In this section we describe the architecture that we propose to approximate semiconcave functions while preserving this semiconcavity property. The approximation is based on the fact that a function is semiconcave if and only if it is the poinwise minimum over a family of C^{2} functions with uniformly bounded second derivatives. Hence, to approximate semiconcave functions we consider a smooth approximation of the minimum together with a parameterized family of C^{2}(\overline{\Omega}) functions. To describe the parametrization in more detail we need some concepts and results that we describe in the following. Throughout we consider \Omega to be an open, bounded, and convex set in \mathbb{R}^{d} . We start by recalling the definition of a semiconcave function. Definition 2.1 . Let v:\Omega\mapsto\mathbb{R} be a continuous function and C>0 . We say that v is C- semiconcave if x\in\Omega\mapsto v(x)-C|x|^{2} is concave. According to Proposition 1.1.3 in [ 6 ] , a semiconcave function can be characterized as the minimum over a family of C^{2} function as is stated in the following result. Here we present a slightly modified version, assuming that v is Lipschitz continuous on \bar{\Omega} , rather than on \Omega , which is more convenient for our needs. Theorem 2.1 . Let v\in C(\overline{\Omega}) . Then v is Lipschitz on \overline{\Omega} and semiconcave with constant C>0 if and only if there exists a family of functions \{\phi_{i}\}_{i\in\mathcal{I}}\subset C^{2}(\overline{\Omega}) uniformly bounded in C^{2}(\overline{\Omega}) such that \sup_{i\in\mathcal{I}}\left\lVert\nabla^{2}\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d\times d})}\leqslant C, and v(x)=\inf_{i\in\mathcal{I}}\phi_{i}(x)\mbox{ for all }x\in\overline{\Omega}, (2.1) where \mathcal{I} is an uncountable index set. Proof of Theorem 2.1 . Let us first suppose that v satisfies the specified properties and prove the existence of a family of functions \{\phi_{i}\}_{i\in\mathcal{I}}\subset C^{2}(\overline{\Omega}) satisfying the conclusions of the theorem. In the following we denote by L the Lipschitz constant of v . Due to the semiconcavity of v and the convexity of \Omega , we have by Proposition 3.3.1 in [ 6 ] that for all x,y\in\Omega , p\in D^{+}v(y)\text{ if and only if }v(x)\leqslant v(y)+p(x-y)+\frac{C}{2}|x-y|^{2}, (2.2) where D^{+}v(y) is the upper-differential of v at y , which is defined by D^{+}v(y):=\left\{p\in\mathbb{R}^{d}:\ \limsup_{x\to y}\frac{v(x)-v(y)-p\cdot(x-y)}{|y-x|}\leqslant 0\right\}. according to Definition 3.1.1 in [ 6 ] . We note that D^{+}v(x) is not empty for all x\in\Omega since v is semiconcave (see Theorem 3.3.4 (b) in [ 6 , Chapter 3] ). By continuity this inequality also holds for x\in\bar{\Omega} . We will construct the family \{\phi_{i}\}_{i\in\mathcal{I}} by using ( 2.2 ). For this purpose we verify that for every y\in\Omega the norm of the elements in D^{+}v(y) is bounded by L . Let us consider y\in\Omega and p\in D^{+}v(y) . Without loss of generality we assume p\neq 0 . Let us set x=y-\frac{\varepsilon}{|p|}p . Since \Omega is open, for \varepsilon small enough we have that x\in\Omega . Then for such \epsilon we have by means of ( 2.2 ) that v\left(y-\frac{\varepsilon}{|p|}p\right)\leqslant v(y)-\varepsilon|p|+\frac{C}{2}\varepsilon^{2}. Rearranging the terms in the previous inequality and using the Lipschitz continuity of v we obtain \varepsilon|p|\leqslant L\varepsilon+\frac{C}{2}\varepsilon^{2}. Dividing both sides of the inequality by \varepsilon and letting \varepsilon\to 0^{+} we obtain that |p|\leqslant L , which proves the claim. For y\in\partial\Omega it is not true that all the elements D^{+}v(y) are bounded. However, arguing by continuity and using ( 2.2 ) it is possible to prove that there exists at least one element satisfying ( 2.2 ) which is bounded by L . This observation proves that for every y\in\overline{\Omega} there exists p_{y}\in\mathbb{R}^{d} with |p_{y}|\leqslant L such that v(x)\leqslant v(y)+p_{y}(x-y)+\frac{C}{2}|y-x|^{2}. Then, observing that the previous inequality is attained for x=y , setting \mathcal{I}=\overline{\Omega} , and \phi_{y}(x)=v(y)+p_{y}(x-y)+\frac{C}{2}|y-x|^{2}\mbox{ for y}\in\overline{\Omega}, we obtain ( 2.1 ), and the asserted uniform bounds on \{\phi_{y}\}_{y\in{\bar{\Omega}}} . The reciprocal implication is given by Corollary 2.1.6 in [ 6 ] and the fact that the infimum over a family of Lipschitz functions is Lipschitz as well. ∎ We next assert that the index set \mathcal{I} in the previous theorem can be replaced by a countable one. Proposition 2.1 . Let v\in C(\overline{\Omega}) be a semiconcave function with constant C>0 and Lipschitz continuous in \overline{\Omega} with constant L>0 . Let \{\phi_{i}\}_{i\in\mathcal{I}} denote the family appearing in 2.1 . Then there exists \{\tilde{\phi}_{i}\}_{i=1}^{\infty}\subset\{\phi_{i}\}_{i\in\mathcal{I}} such that v_{n}(x)=\min_{i=1,\ldots,n}\tilde{\phi}_{i}(x) satisfies \lim_{n\to\infty}\left\lVert v_{n}-v\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla v_{n}-\nabla v\right\rVert_{W^{1,p}(\Omega)}=0, (2.3) for all p\in[1,\infty) , and \lim_{n\to\infty}\nabla v_{n}(x)=\nabla v(x)\mbox{ a.e. in }\Omega. (2.4) Further, for each compact subset K of \Omega , such that D^{+}v(x) is a singleton for all x\in K , we have \lim_{n\to\infty}v_{n}=v\mbox{ in }C^{1}(K). (2.5) Proof of Proposition 2.1 . For n\in\mathbb{N} let us consider a family of rectangles \{\tau_{i,h}\}_{i=1}^{N_{n}} such that diam(\tau_{i,n})\leqslant\frac{1}{n} , where diam(\cdot) denotes the diameter of \tau_{i,n} , and \overline{\Omega}\subset\bigcup_{i=1}^{N_{n}}\tau_{i,n}\mbox{ and }\overline{\Omega}\cap\tau_{i,n}\neq\emptyset\mbox{ for all }i=1,\ldots,N_{n}. For each i=1,\ldots,N_{n} we choose x_{i,n}\in\tau_{i,n}\cap\overline{\Omega} . By the definition of infimum, for each x_{i,n} there exists j(i,n) such that \phi_{j(i,n)}(x_{i,n})\leqslant v(x_{i,n})+\frac{1}{n} . This combined with the Lipschitz continuity of v on \overline{\Omega} and the uniform boundedness of \{\phi_{i}\}_{i\in\mathcal{I}} in C^{1}(\overline{\Omega}) we have for each i=1,\dots,N_{n} |\phi_{j(i,n)}(x)-v(x)|\leqslant\frac{(2L+1)}{n},\mbox{ for all }x\in\tau_{i,n}. (2.6) Let us denote by \tilde{\mathcal{I}}_{n} the finite set composed by the indices j(i,n) defined above. Further set \mathcal{I}_{n}=\bigcup_{j\leqslant n}\tilde{\mathcal{I}}_{j} and \mathcal{I}_{\infty}=\cup_{n\in\mathbb{N}}\mathcal{I}_{n} , and define v_{n}\in C(\overline{\Omega}) as follows v_{n}(x)=\min_{i\in\mathcal{I}_{n}}\phi_{i}(x). Observe that v_{n} is semiconcave. Further from ( 2.6 ) we deduce that |v_{n}(x)-v(x)|\leqslant\frac{(2L+1)}{n}\mbox{ for all }x\in\overline{\Omega}, from which the uniform convergence of v_{n} to v follows. Almost everywhere convergence of the gradients as claimed in ( 2.4 ) follows from [ 6 , Theorem 3.3.3] . The convergence of v_{n} in W^{1,p}(\Omega) for all p\in[1,\infty) is a simple consequence of the a.e. convergence of \nabla v_{n} and the dominated convergence theorem. Consequently ( 2.3 ) is verified. We now prove the last part of the result and assume that Dv^{+}(x) is a singleton for all x\in\bar{K} . Consequently v is differentiable for all v\in\bar{\Omega} . Let us denote by B\subset\Omega the set where the gradients v_{n} exists for all n , and observe that |\Omega\setminus B|=0 , where |\cdot| denotes the measure of a set. Proceeding by contradiction let us assume that v_{n} does not converge to v in W^{1,\infty}(K) . In this case, there exists \varepsilon>0 , a sequence x_{k}\in B , and a sub-sequence of v_{n} denoted by v_{n(k)} such that |\nabla v_{n(k)}(x_{k})-\nabla v(x_{k})|\geqslant\varepsilon. (2.7) Since K is compact and \{v_{n}\}_{n} is uniformly bounded in W^{1,\infty}(\Omega) , there exists \bar{x} in \bar{K} and p\in\mathbb{R}^{d} such that x_{k} converges to \bar{x} and \nabla v_{n(k)} converges to p . By the semiconcavity of v_{n} is easy to verify that v(y)-v(\bar{x})-p\cdot(y-\bar{x})\leqslant C|\bar{x}-y|^{2},\text{ for all }y\in\Omega. This implies that p\in D^{+}v(\bar{x}) and by assumption p=\nabla v(\bar{x}) . However, by ( 2.7 ) we have |p-\nabla v(\bar{x})|\geqslant\epsilon. This gives the desired contradiction, and \lim_{n\to\infty}v_{n}=v\mbox{ in }C^{1}(K) follows. ∎ Our parametrization will build on this result. It consists in replacing the infinite family \{\tilde{\phi}_{i}\}_{i=1}^{\infty} by a family of n parameterized functions and it utilizes a smooth approximation of the minimum operation \psi_{n} of n real numbers. We first describe the construction of the smooth approximation \psi_{n,\varepsilon} , \varepsilon>0 , and its properties. Then, relying on these properties, we introduce the family of parameterized functions together with the usage of \psi_{n,\varepsilon} , see ( 2.27 ) below. For n\leqslant m\in\mathbb{N}\setminus\{0\} and a\in\mathbb{R}^{m} let us denote by \psi_{n}(a) the minimum over a , that is, \psi_{n}(a)=\min_{i\in\{1,\ldots,n\}}a_{i}. (2.8) Thus, if n0 , of the positive part function (\cdot)_{+} , which satisfies the following properties \displaystyle g_{\varepsilon}(x)\geqslant 0\text{ for all }x\in\mathbb{R}, (2.12a) \displaystyle g_{\varepsilon}^{\prime}(x)\in[0,1]\text{ for all }x\in\mathbb{R}, (2.12b) \displaystyle g_{\varepsilon}^{\prime\prime}(x)\geqslant 0\text{ for all {{ almost all }} }x\in\mathbb{R}, (2.12c) \displaystyle\left\lVert(\cdot)_{+}-g_{\varepsilon}\right\rVert_{C(\mathbb{R})}\leqslant\varepsilon, (2.12d) \displaystyle\lim_{\varepsilon\to 0^{+}}g_{\varepsilon}^{\prime}=\chi_{[0,\infty)}\mbox{ in }C_{loc}(\mathbb{R}\setminus\{0\}), (2.12e) \displaystyle g_{\varepsilon}^{\prime\prime}\in L^{\infty}(\mathbb{R})\text{ for each }\varepsilon>0. (2.12f) Remark 2.2 . We provide examples of functions g_{\varepsilon} which ( 2.12 ). We shall return to them in the following section. First, we consider the Moreau envelope of the positive part function, namely, g_{\varepsilon,M}(s)=\min_{t\in\mathbb{R}}(t)_{+}+\frac{1}{2\varepsilon}|t-s|^{2}=\left\{\begin{array}[]{ll}0&\mbox{ if }s<0\\ \frac{1}{2\varepsilon}s^{2}&\mbox{ if }s\in[0,\varepsilon)\\ s-\frac{\varepsilon}{2}&\mbox{ if }s\geqslant\varepsilon\end{array}\right. It is not hard to see that g_{\varepsilon,M} satisfies ( 2.12 ). Further, it satisfies that g_{\varepsilon,M}^{\prime}(0)=0 for all \varepsilon>0 and g_{\varepsilon,M}\in C^{1,1}(\mathbb{R}) , but it is not in C^{2}(\mathbb{R}) . Another example is g_{\varepsilon,A} defined as: g_{\varepsilon,A}(s)=\frac{1}{2}\left(s+\sqrt{s^{2}+\varepsilon^{2}}-\varepsilon\right). To see that this function satisfies ( 2.12 ) we note that (s)_{+}=\frac{1}{2}(|s|+s) and that \sqrt{s^{2}+\varepsilon^{2}}-\varepsilon is a smooth approximation of the absolute value. Using these properties it is easy to see that g_{\varepsilon,A} satisfies ( 2.12 ). By replacing the positive part in ( 2.11 ) by g_{\varepsilon} we obtain a smooth approximation of \psi_{n} given by the following process: \psi_{i+1,\varepsilon}(a)=a_{i+1}-g_{\varepsilon}(a_{i+1}-\psi_{i,\varepsilon}(a)),\ i\in\{1,\ldots,n-1\},\ \psi_{1,\varepsilon}=a_{1}. (2.13) In Proposition 2.2 below, some useful properties of \psi_{n,\varepsilon} are shown. These properties will permit us to construct a semiconcavity preserving parametrization. Proposition 2.2 . Let n\in\mathbb{N}\cap[2,\infty) and \varepsilon>0 be arbitrarily fixed, and assume that g_{\varepsilon}\in C^{1,1}({\mathbb{R}}) satisfies ( 2.12 ). Then the function \psi_{n,\varepsilon} defined in ( 2.13 ) is of class C_{loc}^{1,1}(\mathbb{R}^{n}) and satisfies for all i,j\in\{1,\ldots,n\} that \frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(a)=\delta_{i,n}-g^{\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))(\delta_{i,n}-\frac{\partial\psi_{n-1,\varepsilon}}{\partial a_{i}}(a)),\mbox{ for all }a\in\mathbb{R}^{n}, (2.14) \begin{array}[]{l}\displaystyle\frac{\partial^{2}\psi_{n,\varepsilon}}{\partial a_{i},\partial a_{j}}(a)=-g^{\prime\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))\left(\delta_{i,n}-\frac{\partial\psi_{n-1,\varepsilon}}{\partial a_{i}}(a)\right)\left(\delta_{j,n}-\frac{\partial\psi_{n-1,\varepsilon}}{\partial a_{j}}(a)\right)\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle+g^{\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))\frac{\partial^{2}\psi_{n-1,\varepsilon}}{\partial a_{i},\partial a_{j}}(a),\mbox{ for almost all }a\in\mathbb{R}^{n},\end{array} (2.15) where \delta_{i,j} stand for the Kronecker delta. Further, we have that \left\lVert\psi_{n,\varepsilon}-\psi_{n}\right\rVert_{L^{\infty}(\mathbb{R}^{n})}\leqslant(n-1)\varepsilon, (2.16) \frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(a)\geqslant 0,\quad\sum_{j=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{j}}(a)=1,\mbox{ for all }a\in\mathbb{R}^{n} (2.17) -2(n-1)\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}\leqslant b^{\top}\nabla^{2}\psi_{n,\varepsilon}(a)b\leqslant 0,\mbox{ for almost all }a\in\mathbb{R}^{n}, (2.18) for all b\in\mathbb{R}^{n} with |b|=1 , and \left|\nabla^{2}\psi_{n,\varepsilon}(a)\right|\leqslant 2(n-1)\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}\mbox{ for almost all }a\in\mathbb{R}^{n}. (2.19) Proof. By the chain rule it is immediate to obtain ( 2.14 ) and ( 2.15 ). In ( 2.17 ), the positivity of the partial derivatives is a direct consequence of ( 2.12b ). For the second part of ( 2.17 ) we proceed by induction on n . The base case is \psi_{1,\epsilon}(a)=a_{1} , which clearly holds true. Let us assume as inductive hypothesis that the claim holds for n-1 with n\geqslant 2 . By ( 2.14 ) and again ( 2.12b ), we see that \nabla\psi_{n.\varepsilon}(a) is a convex combination between e_{n} (the n-th vector of the canonical basis of \mathbb{R}^{n} ) and \nabla\psi_{n-1}(a) , where the gradient is with respect to a . Since the sum of the e_{n} is equal to 1 and by the inductive hypothesis the same holds true for \nabla\psi_{n-1}(a) , we get that the sum of the elements of \nabla\psi_{n}(a) is 1 as well, which proves the second part of ( 2.17 ). Let b\in\mathbb{R}^{n} be such that |b|=1 . By ( 2.15 ) we have that \begin{array}[]{l}\displaystyle\sum_{i,j=1}^{n}\frac{\partial^{2}\psi_{n,\varepsilon}(a)}{\partial a_{i}\partial a_{j}}b_{i}b_{j}=-g^{\prime\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))((e_{n}-\nabla\psi_{n-1,\varepsilon}(a))\cdot b)^{2}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle+g^{\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))\sum_{i,j=1}^{n}\frac{\partial^{2}\psi_{n-1,\varepsilon}(a)}{\partial a_{i}\partial a_{j}}b_{i}b_{j}.\end{array} (2.20) We note that the first term in the right hand-side of the above expression is bounded from below. To see this, we first point out that ((e_{n}-\nabla\psi_{n-1,\varepsilon}(a))\cdot b)^{2}=\left(b_{n}-\sum_{i=1}^{n-1}\frac{\partial\psi_{n-1,\varepsilon}}{\partial a_{i}}(a)b_{i}\right)^{2}\leqslant 2\left(b_{n}^{2}+\sum_{i=1}^{n-1}\frac{\partial\psi_{n-1,\varepsilon}}{\partial a_{i}}(a)b_{i}^{2}\right)\leqslant 2, where we have used ( 2.17 ), Jensen inequality, |b|=1 , and the fact that (x-y)^{2}\leqslant 2(x^{2}+y^{2}) for all x,y\in\mathbb{R} . Using this and ( 2.12c ) in ( 2.20 ) we obtain \begin{array}[]{l}\displaystyle-2g^{\prime\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))+g^{\prime}_{\varepsilon}(a_{n}-\psi_{n-1,\varepsilon}(a))\sum_{i,j=1}^{n}\frac{\partial^{2}\psi_{n-1,\varepsilon}(a)}{\partial a_{i}\partial a_{j}}b_{i}b_{j}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant\sum_{i,j=1}^{n}\frac{\partial^{2}\psi_{n,\varepsilon}(a)}{\partial a_{i}\partial a_{j}}b_{i}b_{j}\leqslant\sum_{i,j=1}^{n}\frac{\partial^{2}\psi_{n-1,\varepsilon}(a)}{\partial a_{i}\partial a_{j}}b_{i}b_{j}.\end{array} Using induction in both of the above inequalities we obtain ( 2.18 ). This implies that for almost all a\in\mathbb{R}^{n} , the eigenvalues of \nabla^{2}\psi_{n,\varepsilon}(a) are contained in [-2(n-1)\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})},0] , and hence ( 2.19 ) holds. We turn now our attention to the proof of ( 2.16 ). By subtracting ( 2.11 ) from ( 2.13 ) we have that for all a\in\mathbb{R}^{n} and i=1,\ldots,n-1 \psi_{i+1,\varepsilon}(a)-\psi_{i+1}(a)=\left(a_{i+1}-\psi_{i}(a)\right)_{+}-g_{\varepsilon}\left(a_{i+1}-\psi_{i,\varepsilon}(a)\right). Subtracting and adding the term \left(a_{i+1}-\psi_{i,\varepsilon}(a)\right)_{+} on the right hand-side of the previous inequality we obtain \begin{array}[]{l}\displaystyle\psi_{i+1,\varepsilon}(a)-\psi_{i+1}(a)=\left(a_{i+1}-\psi_{i}(a)\right)_{+}-\left(a_{i+1}-\psi_{i,\varepsilon}(a)\right)_{+}+\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\left(a_{i+1}-\psi_{i,\varepsilon}(a)\right)_{+}-g_{\varepsilon}\left(a_{i+1}-\psi_{i,\varepsilon}(a)\right).\end{array} Using the 1-Lipschitz continuity of the positive part and ( 2.12d ) in the above expression we obtain that |\psi_{i+1,\varepsilon}(a)-\psi_{i+1}(a)|\leqslant\varepsilon+|\psi_{i,\varepsilon}(a)-\psi_{i}(a)|. Summing from i=1 to i=n-1 we obtain the desired estimate for all a\in\mathbb{R}^{n} |\psi_{n,\varepsilon}(a)-\psi_{n}(a)|\leqslant(n-1)\varepsilon. ∎ Remark 2.3 . It is interesting to observe that ( 2.17 ) implies that the partial derivative of \psi_{n,\varepsilon} at a point in \mathbb{R}^{n} form a probability distribution. We will delve into this in Section 3 , where via ( 2.17 ), we give a probabilistic interpretation of the partial derivatives of \psi_{n,\varepsilon} and connect it with the discontinuities of the gradient of a semiconcave function. To construct an approximation of the type ( 2.1 ) we choose a finite family of functions \{\phi_{i}\}_{i=1}^{n}\subset C^{2}(\overline{\Omega}) and set \Phi_{n}=(\phi_{1},\ldots,\phi_{n}),\quad v_{n}=\psi_{n}\circ\Phi_{n},\quad\text{ and }v_{n,\varepsilon}=\psi_{n,\varepsilon}\circ\Phi_{n}. (2.21) In Proposition 2.3 below, we prove that v_{n,\varepsilon} is a C^{1,1}(\overline{\Omega}) approximation of v_{n} and that it is semiconcave. Proposition 2.3 . Let \{\phi_{i}\}_{i=1}^{n}\subset C^{2}(\overline{\Omega}) . Then v_{n,\varepsilon} is C- semiconcave and L- Lipschitz continuous, with C=\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla^{2}\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d\times d})}\mbox{ and }L=\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}. Further, \left\lVert v_{n,\varepsilon}-v_{n}\right\rVert_{C(\overline{\Omega})}\leqslant(n-1)\varepsilon. (2.22) and v_{n,\varepsilon} is of class C^{1,1} with \left\lVert\nabla^{2}v_{n,\varepsilon}\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d\times d})}\leqslant C+2n(n-1)L^{2}\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}. (2.23) Proof. We note that v_{n,\varepsilon} is in C^{1,1}(\overline{\Omega}) since it is the composition of \psi_{n,\varepsilon}\in C^{1,1}(\mathbb{R}^{n}) and \Phi_{n}\in C^{2}(\overline{\Omega};\mathbb{R}^{n}) . For x\in\overline{\Omega} , by the chain rule we have that \nabla v_{n,\varepsilon}=\sum_{i=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(\Phi_{n}(x))\nabla\phi_{i}(x), and by ( 2.17 ) with a=\Phi_{n,\epsilon}(x) we find that \displaystyle\left|\nabla v_{n,\varepsilon}(x)\right| \displaystyle=\left|\sum_{i=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(\Phi_{n}(x))\nabla\phi_{i}(x)\right| (2.24) \displaystyle\leqslant\sum_{i=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(\Phi_{n}(x))\left\lVert\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}\leqslant\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}. (2.25) The asserted Lipschitz continuity of v_{n,\varepsilon} follows from this estimate. We next argue the semiconcavity of v_{n,\varepsilon} and the bound ( 2.23 ). For this purpose, let us consider y\in\mathbb{R}^{d} . By the chain rule we have for almost all x\in\Omega and all i,j\in\{1,\ldots,d\} that \frac{\partial v_{n,\varepsilon}}{\partial x_{i}\partial x_{j}}(x)=\sum_{k,r=1}^{n}\frac{\partial^{2}\psi_{n,\varepsilon}}{\partial a_{r}\partial a_{k}}(\Phi_{n}(x))\frac{\partial\phi_{r}}{\partial x_{i}}(x)\frac{\partial\phi_{k}}{\partial x_{j}}(x)+\sum_{k=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{k}}(\Phi_{n}(x))\frac{\partial^{2}\phi_{k}}{\partial x_{i}\partial x_{j}}(x). (2.26) We note that by ( 2.18 ), we have for almost all x\in\Omega and all y\in\mathbb{R}^{d} , with |y|=1 , that \begin{array}[]{l}\displaystyle-2n(n-1)\left\lVert g^{\prime\prime}\right\rVert_{L^{\infty}(\mathbb{R})}\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}^{2}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant\sum_{i,j=1}^{d}\sum_{k,r=1}^{n}\frac{\partial^{2}\psi_{n,\varepsilon}}{\partial a_{r}\partial a_{k}}(\Phi_{n}(x))\frac{\partial\phi_{r}}{\partial x_{i}}(x)\frac{\partial\phi_{k}}{\partial x_{j}}(x)y_{i}y_{j}=\sum_{k,r=1}^{n}z_{r}(x)\frac{\partial^{2}\psi_{n,\varepsilon}}{\partial a_{r}\partial a_{k}}(\Phi_{n}(x))z_{k}(x)\leqslant 0,\end{array} where z_{r}(x)=\sum_{i=1}^{d}\frac{\partial\phi_{r}}{\partial x_{i}}(x)y_{i} , z_{k}(x)=\sum_{j=1}^{d}\frac{\partial\phi_{k}}{\partial x_{j}}(x)y_{j} . Combining this with ( 2.26 ), ( 2.17 ), and ( 2.19 ) , we obtain -C-2n(n-1)\left\lVert g^{\prime\prime}\right\rVert_{L^{\infty}(\mathbb{R})}L^{2}\leqslant y^{\top}\cdot\nabla^{2}v_{n,\varepsilon}(x)\cdot y\leqslant C,\text{ for all }y\in\mathbb{R}^{d},\text{ with }|y|=1. This implies that the eigenvalues of \nabla^{2}v_{n,\varepsilon}(x) are in [-C-2n(n-1)\left\lVert g^{\prime\prime}\right\rVert_{L^{\infty}(\mathbb{R})}L^{2},C] from which we deduce ( 2.23 ), and that the semiconcavity constant of v_{n,\varepsilon} is bounded by C , see Proposition 1.1.3 in [ 6 ] . To conclude the proof, we note that ( 2.22 ) is a direct consequence of ( 2.16 ). ∎ We are now in position to introduce our semiconcavity preserving parametrization. With Proposition 2.1 and ( 2.21 ) in mind, for the purpose of numerical realization, it remains to choose an approximation of the family of functions \phi_{i} in order achieve a finite dimensional semiconcave parametrization for functions v . For this purpose, let us consider a finite dimensional Banach space \Theta equipped with a norm \left\lVert\cdot\right\rVert_{\Theta} and a continuous function \xi:\Theta\mapsto C^{2}(\overline{\Omega}) . For n\in\mathbb{N} and \theta=(\theta^{1},\ldots,\theta^{n})\in\Theta^{n} , we set \Xi_{n}(\theta)=(\xi(\theta^{1}),\ldots,\xi(\theta^{n})) . Thus, for \theta\in\Theta^{n} we have that \Xi_{n}(\theta) acts as a family of smooth functions which parameterizes \Phi . We equip \Theta^{n} with the supremum norm, namely, for \theta\in\Theta^{n} we use \left\lVert\theta\right\rVert_{\Theta^{n}}=\sup_{i=1,\ldots,n}\left\lVert\theta_{i}\right\rVert_{\Theta} . We call the tuple (\Theta,\xi) a setting. We propose the following semiconcavity preserving parametrization \varv_{n,\varepsilon}(\theta)=\psi_{n,\varepsilon}\circ\Xi_{n}(\theta), (2.27) with \varepsilon\geqslant 0. If \varepsilon=0 we drop the \varepsilon from the sub-index and write \varv_{n}(\theta)=\psi_{n}\circ\Xi_{n}(\theta). By 2.3 it is clear that for \theta\in\Theta^{n} fixed the semiconcavity constant of \varv_{n,\varepsilon}(\theta) will be bounded by \max_{i\in\{1,\ldots,n\}}\left\lVert\nabla^{2}\xi(\theta^{i})\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d\times d})}. (2.28) Therefore, controlling this quantity is crucial for preserving semiconcavity. In section 4 the convergence properties of \varv_{n,\varepsilon} are studied with respect to a sequence of settings \{(\Theta^{m},\xi^{m})\}_{m\in\mathbb{N}} as \varepsilon\to 0^{+} and n\to\infty . 3 Probabilistic interpretation and active sets In this section we give a probabilistic interpretation of the parametrization introduced in Section 2 . To this end, we consider a family of functions \{\phi_{i}\}_{i=1}^{n}\subset C^{2}(\overline{\Omega}) and the functions v_{n} and v_{n,\varepsilon} as in ( 2.21 ). The interpretation consists in setting for each a\in\mathbb{R}^{n} a probability \{p_{n,i,\varepsilon}(a)\}_{i=1}^{n} over the indices \{1,\ldots,n\} by using the partial derivatives of \psi_{n} . We will see that in the limit as \varepsilon\to 0^{+} , the probability \{p_{n,i,\varepsilon}(a)\}_{i=1}^{n} has support on the active set of indices \{i\in\mathbb{N}:\ 1\leqslant i\leqslant n,\ \psi_{n}(a)=a_{i}\} and we will provide hypotheses under which an explicit formula for the limit probabilities exists. This will help to characterize the active sets for v_{n,\varepsilon} and v_{n} which are the sets where \phi_{i} is equal to v_{n} , and where \nabla\phi_{i} contributes the most to the gradient of v_{n} . The relevance of this probabilitic interpretation and the active sets described above lies in the fact that the discontinuities of \nabla v_{n} occur in the boundary of the active sets, thus understanding the behavior of the probabilities and the actives sets is important regarding the characterization of the discontinuities of the gradient of v_{n} . Further, a correct representation of the active sets by the approximation v_{n,\varepsilon} is crucial for capturing the correct behavior of v_{n} and its gradient around the discontinuities. The behavior of the gradients is particularly importance if v_{n} represents the value function of an optimal control problem. In this case, the optimal control in feedback form can be expressed by means of the gradient of the value function. We explain this in more details in Remark 3.1 . We commence by observing that p_{n,j,\varepsilon}(a)=\frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(a)\text{ for }a\in\mathbb{R}^{n}\text{ and }j\in\{1,\ldots,n\}. (3.1) By( 2.17 ) the family \{p_{n,j,\varepsilon}(a)\}_{j=1}^{n} can be interpreted as a probability distribution over the indices. Furthermore, by the chain rule we have for x\in\Omega that \nabla v_{n,\varepsilon}(x)=\sum_{i=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{i}}(\Phi_{n}(x))\nabla\phi_{i}(x)=\sum_{i=1}^{n}p_{n,i,\varepsilon}(\Phi_{n}(x))\nabla\phi_{i}(x), (3.2) from where we see that p_{n,i,\varepsilon}(\Phi_{n}(x)) measure the contribution of \nabla\phi_{i}(x) in the summation and also that \nabla v_{n,\varepsilon}(x) correspond to the average of \{\nabla\phi_{i}(x)\}_{i=1}^{n} weighted by p_{n,i,\varepsilon}(\Phi_{n}(x)) . It is noteworthy that by ( 2.13 ) the following recursive relations hold p_{m,j,\varepsilon}(a)=\delta_{m,j}-g_{\varepsilon}^{\prime}\left(a_{m}-\psi_{m-1,\varepsilon}(a)\right)\left(\delta_{m,j}-p_{m-1,j,\varepsilon}(a)\right)\text{ for }j\in\{1,\ldots,n\}\text{ and }m\in\{2,\ldots,n\} (3.3) and p_{1,j,\varepsilon}(a)=\delta_{1,j}\text{ for }j\in\{1,\ldots,n\}, (3.4) for a\in\mathbb{R}^{n} , where it is understood that p_{i,j,\varepsilon}=0 for i\in\{1,\ldots,n-1\} and j\in\{i+1,\ldots,n\} . We can iterate these relations to obtain p_{m,j,\varepsilon}(a)=\left(\prod_{i=j+1}^{m}g^{\prime}_{\varepsilon}\left(a_{i}-\psi_{i-1,\varepsilon}(a)\right)\right)\left(1-g^{\prime}_{\varepsilon}(a_{j}-\psi_{j-1,\varepsilon}(a))\right) (3.5) for all m\in\{2,\ldots,n\} and j\in\{1,\ldots,m-1\} , and p_{j,j,\varepsilon}(a)=\left(1-g^{\prime}_{\varepsilon}(a_{j}-\psi_{j-1,\varepsilon}(a))\right). (3.6) Next we address the limiting behavior of the probability distributions p_{n,j,\varepsilon}(a) as \varepsilon tends to 0 . For this will make use of the following assuption on the family of functions \{g_{\varepsilon}\}_{\varepsilon>0} which approximates the positive part: g_{\varepsilon}(r)\leqslant(r)_{+}\mbox{ for all }r\in\mathbb{R}, (3.7) and \text{ there exits }s_{0}\text{ satisfying }\lim_{\varepsilon\to 0^{+}}\sup_{s\in[-s_{0},0]}|g^{\prime}_{\varepsilon}(s)|=0. (3.8) For this we will need the following technical lemma: Lemma 3.1 . Let \{g_{\varepsilon}\}_{\varepsilon>0} be a family of C^{1,1}(\mathbb{R}) functions satisfying ( 2.12 ) and ( 3.7 ). Then for all m\in\{1,\ldots,n\} we have \psi_{m}(a)\leqslant\psi_{m,\varepsilon}(a)\mbox{ for }a\in\mathbb{R}^{n}\mbox{ and all }\varepsilon\in(0,\infty). (3.9) Proof. We proceed by induction. Let us consider a\in\mathbb{R}^{n} fixed. The base case m=1 is trivial since \psi_{1,\varepsilon}(a)=a_{1}=\psi_{1}(a) . Let us assume that the claim holds for m\in\{2,\ldots,n-1\} , that is, \psi_{m}(a)\leqslant\psi_{m,\varepsilon}(a) . By ( 3.7 ) we have that \psi_{m+1,\varepsilon}(a)\geqslant a_{m+1}-(a_{m+1}-\psi_{m,\varepsilon}(a))_{+}. By the monotonicity of the positive part we have that (a_{m+1}-\psi_{m,\varepsilon})_{+}\leqslant(a_{m+1}-\psi_{m})_{+} , due to the fact that \psi_{m}(a)\leqslant\psi_{m,\varepsilon}(a) . From this we deduce that \psi_{m+1,\varepsilon}(a)\geqslant\psi_{m+1}(a) , which proves the result. ∎ In order to simplify the notation in what follows, for a\in\mathbb{R}^{n} , we define the set of active indices I_{n}(a)\subset\{1,\ldots,n\} as the argmin over the family \{{\phi_{i}(a)}\}_{i=1}^{n} , and \hat{i}_{n}(a)\in\{1,\ldots,n\} as the largest active index, that is, I_{n}(a)=\{i\in\{1,\ldots,n\}:\psi_{n}(a)=a_{i}\},\text{ and }\hat{i}_{n}(a)=\max I_{n}(a). (3.10) Proposition 3.1 . Let g_{\varepsilon}\in C^{1,1}(\mathbb{R}) with \varepsilon>0 be a family of functions satisfying ( 2.12 ). Then for a\in\mathbb{R}^{n} and all j\notin I_{n}(a) we have \lim_{\varepsilon\to 0^{+}}p_{n,j,\varepsilon}(a)=0. (3.11) If I_{n}(a) is a singleton, i.e. I_{n}(a)=\{\hat{i}_{n}(a)\} , then \lim_{\varepsilon\to 0^{+}}p_{n,\hat{i}_{n}(a),\varepsilon}(a)=1. (3.12) Further, if g_{\varepsilon} satisfies ( 3.7 ) and ( 3.8 ), then for all j\in\{1,\ldots,n\} we have \lim_{\varepsilon\to 0^{+}}p_{n,j,\varepsilon}(a)=\left\{\begin{array}[]{ll}1&\mbox{if }j=\hat{i}_{n}(a)\\ 0&\mbox{otherwise}.\end{array}\right. (3.13) Proof. Let us start by proving ( 3.11 ) and choose some j\in\{1,\ldots,n\}\setminus I_{n}(x) . We consider separately the cases a_{j}\leqslant\psi_{j-1}(a) and a_{j}>\psi_{j-1}(a) . In the first case, since j\notin I_{n}(a) , there exist i\in\{j+1,\ldots,n\} such that a_{i}<\psi_{i-1}(a) , otherwise we have that a_{j}=\psi_{n}(a) which is a contradiction. Then by ( 2.16 ) and ( 2.12e ), we have \lim_{\varepsilon\to 0^{+}}g^{\prime}_{\varepsilon}(a_{i}-\psi_{i-1,\varepsilon}(a))=0, which by means of ( 3.5 ) implies that \lim_{\varepsilon\to 0^{+}}p_{n,j,\varepsilon}(a)=0. On the other hand, if a_{j}>\psi_{j-1}(a) , there exists \delta>0 such that a_{j}-\psi_{j-1}(a)>\delta. (3.14) By ( 2.16 ) we have that for all \varepsilon\in\left(0,\frac{\delta}{2(j-2)}\right) the estimate |\psi_{j-1}(a)-\psi_{j-1,\varepsilon}(a)|\leqslant\frac{\delta}{2}. (3.15) Combining ( 3.14 ) and ( 3.15 ), we arrive at \frac{\delta}{2}\leqslant a_{j}-\psi_{j-1,\varepsilon}(a)0 . Combining this with ( 3.8 ), ( 2.12c ), and ( 2.12e ) (in the case that a_{\hat{i}_{n}(a)}-\psi_{\hat{i}_{n}(a)-1}(a)1\end{array}\right. as is depicted in Figure 1(a) (a) Unmodified functions. (b) Modified functions. Figure 1 : Illustrative example for ( 3.20 ). At x=0 the three functions \{\phi_{i}\}_{i=1}^{3} are equal to v_{3}(0) . Additionally, we have that D^{*}v_{3}(0)=\{-1,1\}. (3.24) To prove this, we note that, for x<0 , v_{3} is differentiable and v_{3}^{\prime}(x)=\exp(x) . Then clearly we have \exp(0)=1 is an element of D^{*}v_{3}(0) . For proving that -1 is an element of D^{*}v_{3}(0) , we note that for x\in(0,1) we have that v_{n}=-x and consequently v_{n}^{\prime}(x)=-1 which implies that -1\in D^{*}v_{3}(0) . It is important to observe, that D^{*}v_{3}(0) does not include any other element, since any sequence p_{n}=v_{3}^{\prime}(x_{n}) with x_{n} converging to 0 and p_{n} converging, is such that p_{n}=\exp(x_{n}) for all n large enough or p_{n}=-1 for n large enough. In addition, we have that \phi_{3}^{\prime}(0)=0 and therefore by ( 3.24 ), it is clear that \phi_{3}^{\prime}(0) is not an element of D^{*}(0) . We can remedy this issue by modifying \phi_{3} in a neighborhood of 0 in a way that it will not change v_{3} . For instance, let us consider \tilde{\phi}_{3}(x)=\phi_{3}\left(x\right)+f(2x) with f(x)=\left\{\begin{array}[]{ll}\exp(-1/(1-|x|^{2}))&\mbox{ if }x\in(-1,1)\\ 0&\mbox{ if }|x|\geqslant 1\end{array}\right. As is depicted in Figure 1(b) , we have that v_{3}(x)=\min\{\phi_{1}(x),\phi_{2}(x),\tilde{\phi}_{3}(x)\} , but now v_{3}(0)\neq\tilde{\phi}_{3}(0) and consequently the new family \{\phi_{1},\phi_{2},\tilde{\phi}_{3}\} satisfies ( 3.20 ). Using the same idea, that is, modifying the problematic \phi_{i} ’s around the point where ( 3.20 ) does not hold, we show in Remark 3.4 a general way to modify the family of functions \{\phi_{i}\}_{i=1}^{n} in such a way that ( 3.20 ) is fulfilled everywhere. In view of Proposition 3.1 with ( 3.7 ) and ( 3.8 ) holding, the expression p_{n,i}(a):=\lim_{\varepsilon\to 0^{+}}p_{n,i,\varepsilon}(a)\in\{0,1\}, (3.25) is welldefined for each a\in\mathbb{R}^{n} and i\in\{1,\ldots,n\} . Now for each i=1,\ldots,n we define the \Omega^{i} and their corresponding approximations by \Omega^{i,\varepsilon} are defined by \Omega^{i}=\{x\in\overline{\Omega}:p_{n,i}(\Phi(x))=\max_{j=1,\ldots,n}p_{n,j}(\Phi(x))\}, (3.26) \Omega^{i,\varepsilon}=\{x\in\overline{\Omega}:p_{n,i,\varepsilon}(\Phi(x))=\max_{j=1,\ldots,n}p_{n,j,\varepsilon}(\Phi(x))\}. (3.27) We refer to the sets \{\Omega^{i}\}_{i=1}^{n} respectively \{\Omega^{i,\varepsilon}\}_{i=1}^{n} as gradient active sets, since if x\in\Omega^{i,\varepsilon} , then \phi_{i} is the function with the largest contribution to \nabla v_{n,\varepsilon}(x) for \varepsilon sufficiently small. We also observe that \overline{\Omega}=\cup_{i=1}^{n}\Omega^{i} . The following convergence result with respect to the gradient active sets can be obtained. Proposition 3.2 . Let \{g_{\varepsilon}\}_{\varepsilon>0}\subset C^{1,1}(\mathbb{R}) be a family of functions satisfying ( 2.12 ), ( 3.7 ), and ( 3.8 ). Then for every x\in\overline{\Omega} we have that \lim_{\varepsilon\to 0^{+}}\chi_{\Omega_{i},\varepsilon}(x)=\chi_{\Omega_{i}}(x), where \chi_{\omega} denotes the characteristic function of \omega\subset\mathbb{R}^{d} . Proof of Proposition 3.2 . Let x\in\overline{\Omega} fixed. We start by noting that by ( 3.13 ) we have for all i\in\{1,\ldots,n\} that p_{n,j}(\Phi(x))=\left\{\begin{array}[]{ll}1,&i=\hat{i}\\ 0,&i\neq\hat{i},\end{array}\right. where \hat{i} is the largest index for which \phi_{i}(x)=v_{n}(x) . From this we deduce that there exists \varepsilon_{0}>0 such that for all \varepsilon\in(0,\varepsilon_{0}) we have p_{n,i,\varepsilon}(\Phi(x))<\frac{1}{2}\mbox{ for }i\in\{1,\ldots,n\}\setminus\{\hat{i}\},\mbox{ and }p_{n,\hat{i},\varepsilon}(\Phi(x))>\frac{1}{2}. By the definitions of \Omega_{i,\varepsilon} and \Omega_{i} this implies that for all \varepsilon\in(0,\varepsilon_{0}) it holds that \chi_{\Omega^{i,\varepsilon}}(x)=\chi_{\Omega^{i}}(x), which implies that the pointwise convergence of \chi_{\Omega_{i,\varepsilon}} as \varepsilon\to 0^{+} . ∎ Remark 3.3 . In the following we demonstrate the consequences of the limit behavior of g^{\prime}_{\varepsilon} in a neighborhood of 0 on the limiting behavior of the probability distribution given by p_{n,j,\varepsilon}(a) as \varepsilon\to 0^{+} . Returning to g_{\varepsilon,M} and g_{\varepsilon,A} introduced in Remark 2.2 , both of them satisfy ( 3.7 ) and ( 3.8 ). Therefore, by means of Proposition 3.1 we obtain for a\in\mathbb{R}^{n} and j\in\{1,\ldots,n\} that p_{n,j}(a)=\left\{\begin{array}[]{ll}1&\mbox{if }j=\hat{i}_{n}(a)\\ 0&\mbox{otherwise},\end{array}\right. where we recall the notation introduced in ( 3.25 ). Another choice of smooth approximation for the minimum of a vector of real numbers is the Log-Sum-Exp approximation which is given by \tilde{\psi}_{n,\varepsilon}(a)=-\varepsilon\log\left(\frac{1}{n}\sum_{i=1}^{n}\exp\left(-\frac{a_{i}}{\varepsilon}\right)\right). for a\in\mathbb{R}^{n} and \varepsilon>0 , which can be considered in place of \psi_{n,\varepsilon}(a) defined in ( 2.13 ). The gradient of \tilde{\psi}_{n} is given by the soft-min function: \nabla\tilde{\psi}_{n,\varepsilon}(a)=\frac{1}{\sum_{i=1}^{n}\exp\left(-\frac{a_{i}}{\varepsilon}\right)}\left(\exp\left(-\frac{a_{1}}{\varepsilon}\right),\ldots,\exp\left(-\frac{a_{n}}{\varepsilon}\right)\right). See [ 12 ] for a collection of results regarding this functions and its application to machine learning. We also point out that this approximation was used in the context of convexity preserving neural networks in [ 5 ] . Although both \psi_{n,\varepsilon} and \tilde{\psi}_{n,\varepsilon} converge to \psi_{n} uniformly as \varepsilon\to 0^{+} , the limiting behaviors as \varepsilon\to 0^{+} of the derivatives of these two approximation are different. This has an impact on the limiting properties of the approximation of \nabla v_{n} provided by \tilde{v}_{n,\epsilon}=\tilde{\psi}_{n,\varepsilon}\circ\Phi_{n} in comparison to v_{n,\varepsilon} . To see this, we note that setting I(a)=\argmin\{a_{i}:i\in\{1,\ldots,n\}\} for a\in\mathbb{R}^{n} we have for j\in\{1,\ldots,n\} that \lim_{\varepsilon\to 0^{+}}\frac{\partial\tilde{\psi}_{n,\varepsilon}}{\partial a_{j}}(a)=\left\{\begin{array}[]{ll}\frac{1}{|I(a)|}&\mbox{if }j\in I(a),\\ 0&\mbox{if }j\notin I(a).\end{array}\right. From this observation we see that \nabla\tilde{v}_{n,\varepsilon} satisfies for each x\in\Omega that \lim_{\varepsilon\to 0^{+}}\nabla\tilde{v}_{n,\varepsilon}(x)=\frac{1}{|I(\Phi_{n}(x))|}\sum_{i\in I(\Phi_{n}(x))}\nabla\phi_{i}(x), that is, \nabla\tilde{v}_{n,\varepsilon} converges point-wise to the average of the gradients of the active functions. In line with Remark 3.1 , if v_{n} is a viscosity solution of an equation of the form of ( 3.19 ), we can only ensure that \lim_{\varepsilon\to 0^{+}}F(x,\nabla\tilde{v}_{n,\varepsilon}(x))\leqslant 0, (3.28) compared to \lim_{\varepsilon\to 0^{+}}F(x,\nabla v_{n,\varepsilon}(x))=0, (3.29) if ( 3.7 ) and ( 3.8 ) hold. Consequently in the context of viscosity solutions, \psi_{n,\varepsilon} provides a better representation of v_{n} at points of discontinuity than \tilde{\psi}_{n,\varepsilon} . Remark 3.4 . Regarding Remark 3.1 , if condition ( 3.20 ) does not hold, we now explain how to modify the functions \{\phi_{i}\}_{i=1}^{n} in a manner such that v_{n} does not change and the new family satisfies ( 3.20 ). For this purpose let us first fix some i\in\{1,\ldots,n\} and define A_{i}=\{x\in\overline{\Omega}:\nabla\phi_{i}(x)\notin D^{*}v_{n}(x)\}. We argue that A_{i} is open in the relative topology of \overline{\Omega} . Indeed, let \bar{x}\in\overline{\Omega} be such that \nabla\phi_{i}(\bar{x})\notin D^{*}v_{n}(\bar{x}) , then there exists \delta>0 such that for all x\in B(\bar{x},\delta)\cap\overline{\Omega} we have \nabla\phi_{i}(x)\notin D^{*}v_{n}(x) . To prove this claim, let us proceed by contradiction. If the claim does not hold, then there exists x_{m}\in\overline{\Omega} approaching \bar{x} as m\to\infty such that \nabla\phi_{i}(x_{m})\in D^{*}v_{n}(x_{m}) . By the definition of D^{*}v(x_{m}) , for each m\in\mathbb{N} there exists a sequence x_{k,m} such that x_{k,m}\to x_{m} as k\to\infty , v_{n} is differentiable at x_{k,m} and \nabla v_{n}(x_{k,m})\to\nabla\phi_{i}(x_{m}) as k\to\infty . From this we deduce that for each m\in\mathbb{N} there exists k(m) such that |\nabla v_{n}(x_{k(m),m})-\nabla\phi_{i}(x_{m})|+|x_{k,m}-x_{m}|<\frac{1}{m}. Then by setting \tilde{x}_{m}=x_{k(m),m} we have that |\nabla v_{n}(\tilde{x}_{m})-\nabla\phi_{i}(\bar{x})|+|x_{k,m}-\bar{x}|<\frac{1}{m}+|\nabla\phi_{i}(\bar{x})-\nabla\phi_{i}(x_{m})|+|x_{m}-\bar{x}|. Thus, by the continuity of \nabla\phi_{i} and the convergence of x_{m} to \bar{x} as m\to\infty , we deduce that \lim_{m\to\infty}\nabla v_{n}(\tilde{x}_{m})=\nabla\phi_{i}(\bar{x})\mbox{ and }\lim_{m\to\infty}\tilde{x}_{m}=\bar{x}. This implies that \nabla\phi_{i}(\bar{x})\in D^{*}v_{n}(\bar{x}) , which is a contradiction and consequently A_{i} is open in the relative topolgy of \overline{\Omega} . In particular, this implies that for each x\in A_{i} there exists j\in\{1,\ldots,n\}\setminus\{i\} with v_{n}(x)=\phi_{j}(x) . Indeed, if the aforementioned assertion does not hold, then there exists x\in A_{i} such that v_{n}(x)=\phi_{i}(x) and v_{n}(x)<\phi_{j}(x) for all j\in\{1,\ldots,n\}\setminus\{i\} . By the continuity of \phi_{i} , this implies that there exists \delta>0 such that for all y\in B(x,\delta)\cap\Omega we have that \phi_{i}(y)<\phi_{j}(y) for j\in\{1,\ldots,n\}\setminus\{i\} and consequently v_{n}=\phi_{i} in B(x,\delta)\cap\Omega . From this we deduce that v_{n} is C^{1} at x and that \nabla v_{n}(x)=\nabla\phi_{i}(x) . However, this contradict the fact that x\in A_{i} . Using that for all x\in A_{i} there exists j\in\{1,\ldots,n\}\setminus\{i\} satisfying v_{n}(x)=\phi_{j}(x) , we have that adding a positive number to \phi_{i}(x) in a neighborhood of x will not change v_{n}(x) since \phi_{j}(x) remains unchanged. Since A_{i} is open and due to the Lindelof property of \mathbb{R}^{d} , there exists an open sub-covering \{B(x_{j},\delta_{j})\cap\overline{\Omega}\}_{j=1}^{\infty} of A_{i} such that A_{i}=\bigcup_{j=1}^{\infty}B(x_{j},\delta_{j})\cap\overline{\Omega}. Since A_{i} is bounded we can assume that \{\delta_{j}\}_{j=1}^{\infty} is bounded. Let us consider a function \nu:\mathbb{R}^{d}\mapsto\mathbb{R} such that \nu\in C_{c}^{\infty}(\mathbb{R}^{d}) and \nu(x)>0 in B(0,1) and \nu(x)=0 in \mathbb{R}^{d}\setminus B(0,\delta) . We define \tilde{\phi}_{i} by \tilde{\phi}_{i}(x)=\sum_{j=1}^{\infty}\frac{\delta_{j}^{2}}{2^{j}}\nu\left(\frac{x-x_{j}}{\delta_{j}}\right)+\phi_{i}(x)\mbox{ for }x\in\overline{\Omega}. We clearly have that \tilde{\phi}_{i}\in C^{2}(\overline{\Omega}) , \tilde{\phi}_{i}(x)>\phi_{i}(x) for all x\in A_{i} and \tilde{\phi}_{i}(x)=\phi_{i}(x) for all x\in\overline{\Omega}\setminus A_{i} . Then replacing \tilde{\phi}_{i} by \phi_{i} does not affect the definition of v_{n} and we have that \nabla\tilde{\phi}_{i}(x)\in D^{*}v_{n}(x) for every x\in\overline{\Omega} where \tilde{\phi}_{i}(x)=v_{n}(x) . Now we iterate from i=1 to i=n . If A_{i} is empty we do not need to do anything, on the other hand, if A_{i}\neq\emptyset , we modify \phi_{i} as above. In this manner we obtain that at the end of the i -th iteration we have v_{n}(x)=\min\left\{\min_{k\in\{1,\ldots,i\}}\tilde{\phi}_{k}(x),\min_{k\in\{i+1,\ldots,n\}}\phi_{k}(x)\right\}\text{ for all }x\in\overline{\Omega} \text{ and }\{x\in\overline{\Omega}:\nabla\tilde{\phi}_{j}(x)\notin D^{*}v_{n}(x)\mbox{ and }\tilde{\phi}_{j}(x)=v_{n}(x)\}=\emptyset for j\in\{1,\ldots,i\} . In this manner we end up with a modified family \{\tilde{\phi}_{i}\}_{i=1}^{n} such that v_{n}(x)=\min_{i\in\{1,\ldots,n\}}\tilde{\phi}_{i}(x),\text{ and }\{x\in\overline{\Omega}:\nabla\tilde{\phi}_{i}(x)\notin D^{*}v_{n}(x)\mbox{ and }\tilde{\phi}_{i}(x)=v_{n}(x)\}=\emptyset. 4 Approximation Our next goal is to analyze the universality of the parametrization \varv_{n,\varepsilon} , which was introduced at the end of Section 2 , for semiconcave functions. We also address approximation properties involving the active sets of semiconcave functions. For this purposes we introduce a sequence of settings \{(\Theta_{m},\left\lVert\cdot\right\rVert_{m}),\xi_{m}\}_{m\in\mathbb{N}} , which will be required to satisfy the following property: Hypothesis 4.1 . For all \phi\in C^{2}(\overline{\Omega}) and m\in\mathbb{N} there exist \theta_{m}\in\Theta_{m} , such that \lim_{m\mapsto\infty}\xi_{m}(\theta_{m})=\phi\mbox{ in }C^{2}(\overline{\Omega}). (4.1) In analogy to the notation introduced in Section 2 we define for the sequence of settings \{(\Theta_{m},\left\lVert\cdot\right\rVert_{m}),\xi_{m}\}_{m\in\mathbb{N}} and the mappings \Xi_{m}:(\Theta_{m})^{n}\mapsto(C^{2}(\Omega))^{n}\text{ by }\Xi_{m}(\theta_{1},\ldots,\theta_{m})=(\xi_{m}(\theta_{1}),\ldots,\xi_{m}(\theta_{n}))\text{ and} \varv_{m,n,\varepsilon}:\Theta_{m}^{n}\mapsto C^{2}(\overline{\Omega})\text{ by }\varv_{m,n,\varepsilon}(\theta)=\psi_{n,\varepsilon}(\Xi_{m}(\theta_{1},\ldots,\theta_{m})) for \theta=(\theta_{1},\ldots,\theta_{n})\in(\Theta_{m})^{n} . We start with a technical result. Proposition 4.1 . For all v\in Lip(\bar{\Omega}) and p\in[1,\infty) the following inequality holds: \left\lVert\nabla v\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant(2Kd^{2}+d^{\frac{p}{2}}|\Omega|)^{\frac{1}{p}}\big(\,\left\lVert v\right\rVert_{C(\overline{\Omega})}^{\frac{1}{p}}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{\frac{p-1}{p}}+\left\lVert v\right\rVert_{C(\overline{\Omega})}^{\frac{1}{1+p}}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{\frac{p}{1+p}}\big), (4.2) where {\color[rgb]{1,0,0}{K}}=\max_{i\in\{1,\ldots,n\}}|\Omega_{i}| with \Omega_{i}=\{y\in\mathbb{R}^{d-1}:\exists a\in\mathbb{R}\mbox{ such that }(y_{1},\ldots,y_{i-1},a,y_{i+1},\ldots,y_{d})\in\Omega\}. (4.3) Proof. We first consider the case that v\in C^{1}(\bar{\Omega}) . Let \delta>0 be arbitrary. The L^{p} norm of the gradient can be split in the following manner \int_{\Omega}|\nabla v|^{p}dx=\int_{|\nabla v|_{\infty}>\delta}|\nabla v|^{p}dx+\int_{|\nabla v|_{\infty}\leqslant\delta}|\nabla v|^{p}dx, where for x\in\mathbb{R}^{d} , |x|_{\infty}=\max_{i=1,\ldots,d}|x_{i}| and |x| is the Euclidean norm of x . Clearly the last term of the above inequality can be bounded by d^{\frac{p}{2}}|\Omega|\delta^{p} . Further, thanks to the Coarea formula, see [ 21 , Theorem 3.11, Chapter 3] ), we can express the first integral on the right hand side of the above inequality in terms of the level sets of v to obtain \int_{\Omega}|\nabla v|^{p}dx\leqslant\int_{-\left\lVert v\right\rVert_{C(\Omega)}}^{\left\lVert v\right\rVert_{C(\Omega)}}\int_{v=s,|\nabla v|_{\infty}>\delta}|\nabla v|^{(p-1)}dH_{d-1}(x)ds+d^{\frac{p}{2}}\delta^{p}|\Omega|. Here dH_{d-1} denotes the (d-1) -dimensional Hausdorff measure. Noticing that the set \{x\in\Omega:|\nabla v(x)|_{\infty}>\delta\} is a subset of \bigcup_{i=1}^{d}\{x:\left|\frac{dv}{dx_{i}}(x)\right|>\delta\} we obtain \int_{\Omega}|\nabla v|^{p}dx\leqslant\sum_{i=1}^{d}\int_{-\left\lVert v\right\rVert_{C(\overline{\Omega})}}^{\left\lVert v\right\rVert_{C(\overline{\Omega})}}\int_{v=s,\left|\frac{dv}{dx_{i}}\right|>\delta}|\nabla v|^{(p-1)}dH_{d-1}(x)ds+d^{\frac{p}{2}}\delta^{p}|\Omega|. In order to estimate the right hand-side of the above inequality, we will bound the terms inside the summation for each i\in\{1,\ldots,d\} . For this purpose, we note that by the implicit function theorem the set \{v=s,\left|\frac{dv}{dx_{i}}\right|>\delta\} is an open C^{1} sub-manifold of \{v=s\} which is short for \{x\in\Omega:v(x)=s\} . Thus for each s\in[-\left\lVert v\right\rVert_{C(\overline{\Omega})},\left\lVert v\right\rVert_{C(\overline{\Omega})}] and each i there exists an open set V_{i}(s)\subset\mathbb{R}^{d-1} and a bijective function x:V_{i}(s)\mapsto\{v=s:\left|\frac{dv}{dx_{i}}\right|>\delta\} . Further V_{i}(s) is bounded by some constant depending on \Omega , d , and \|v\|_{C(\bar{\Omega})} . This allows us to use the area formula (see Theorem 3.9 in [ 21 , Chapter 3, Section 3.3.2] ) to obtain \begin{array}[]{l}\int_{\{v=s,\left|\frac{dv}{dx_{i}}\right|>\delta\}}|\nabla v|^{(p-1)}dH_{d-1}(x)\\[6.45831pt] =\int_{V_{i}(s)}|\nabla v(x(y))|^{p-1}\left(1+\left(\frac{dv}{dx_{i}}(x(y))\right)^{-2}\sum_{j\neq i}\left(\frac{dv}{dx_{j}}(x(y))\right)^{2}\right)^{\frac{1}{2}}dy.\end{array} Here, following the notation of [ 21 , Chapter 3, Section 3.3.4.B] , we used that the Jacobian can be expressed as J(x(y))=\big(1+\big(\frac{dv}{dx_{i}}(x(y))\big)^{-2}\sum_{j\neq i}\big(\frac{dv}{dx_{j}}(x(y))\big)^{2}\big)^{\frac{1}{2}} . Since v is Lipschitz and |\frac{dv}{dx_{i}}(x(y))|>\delta for y\in V_{i} we can bound the right hand-side of the above inequality to get \int_{\{v=s,\left|\frac{dv}{dx_{i}}\right|>\delta\}}|\nabla v|^{(p-1)}dH_{d-1}(x)\leqslant d\left(\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{p-1}+\frac{1}{\delta}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{p}\right)|V_{i}(s)|. Consequently we get \int_{\Omega}|\nabla v|^{p}dx\leqslant 2d^{2}C\left\lVert v\right\rVert_{C(\overline{\Omega})}\left(\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{p-1}+\frac{1}{\delta}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{p}\right)+{d^{\frac{p}{2}}}\delta^{p}|\Omega|, where we have used that V_{i}(s)\subset\Omega_{i} for all i=1,\ldots,d and s\in[-\left\lVert v\right\rVert_{C(\overline{\Omega})},\left\lVert v\right\rVert_{C(\overline{\Omega})}] . Choosing \delta=\left\lVert v\right\rVert_{C(\overline{\Omega})}^{\frac{1}{1+p}}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{\frac{p}{1+p}} in the above inequality we obtain \int_{\Omega}|\nabla v|^{p}dx\leqslant 2d^{2}{{K}}\left\lVert v\right\rVert_{C(\overline{\Omega})}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{p-1}+(2d^{2}C+d^{\frac{p}{2}}|\Omega|)\left\lVert v\right\rVert_{C(\overline{\Omega})}^{\frac{p}{1+p}}\left\lVert\nabla v\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}^{\frac{p^{2}}{1+p}}. (4.4) This estimate implies ( 4.2 ) for the case v\in C^{1}(\overline{\Omega}) . For v\in Lip(\overline{\Omega})=W^{1,\infty}(\Omega) , let us consider \Omega_{\varepsilon}=\{x\in\Omega:\ dist(x,\partial\Omega)>\varepsilon\} for \varepsilon>0 . Since v\in Lip(\overline{\Omega}) there exists a sequence v_{n}\in C^{\infty}(\Omega) such that \lim_{n\to\infty}\|v_{n}-v\|_{C(\overline{\Omega_{\varepsilon}})}=0,\,\lim_{n\to\infty}\|v_{n}-v\|_{W^{1,p}(\Omega_{\varepsilon})}=0 , for each p\in[1,\infty) , and \|\nabla v_{n}\|_{L^{\infty}(\Omega)}\to\|\nabla v\|_{L^{\infty}(\Omega)} see e.g. [ 22 , Theorem 11.24, Exercise 11.31] . In particular v_{n}\in C^{1}(\overline{\Omega}_{\varepsilon}) for each n , and we can apply ( 4.2 ) for v_{n} with the domain \Omega replaced by \Omega_{\varepsilon} for all of the function spaces. Passing to the limit as n\to\infty we obtain that ( 4.2 ) holds with \Omega_{\varepsilon} instead of \Omega for v\in Lip(\overline{\Omega}) . Then, passing to the limit as \varepsilon\to 0^{+} , the desired estimate is obtained. ∎ Remark 4.1 . We observe that 4.1 allows to transfer information from a function to its gradient. For instance, for v=f-f_{n} , with \left\lVert f\right\rVert_{W^{1,\infty}(\overline{\Omega})}\leqslant L and \left\lVert f_{n}\right\rVert_{W^{1,\infty}(\overline{\Omega})}\leqslant L for all n\in\mathbb{N} the previous proposition allows us to measure the convergence of \nabla f_{n} to \nabla f in terms of the C(\overline{\Omega}) distance between f_{n} and f . Remark 4.2 . In the case \Omega=(a_{1},b_{1})\times\ldots\times(a_{d},b_{d}) with a,b\in\mathbb{R}^{d} and a0 and C>0 satisfying \limsup_{m\to\infty}L_{m}\leqslant L (4.6) and \limsup_{m\to\infty}C_{m}\leqslant C, (4.7) where L_{m}=\sup_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}\text{ and }C_{m}=\sup_{i\in\{1,\ldots,n\}}\left\lVert\nabla^{2}\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d\times d})}. For m\in\mathbb{N} and \varepsilon\geqslant 0 let us set v_{n}=\min_{i=1,\ldots,n}\phi_{i},\ v_{n,m,\varepsilon}=\psi_{n,\varepsilon}\circ\Phi_{n,m} where \Phi_{n,m}\in C^{2}(\overline{\Omega};\mathbb{R}^{n}) is defined by x\in\overline{\Omega}\mapsto\Phi_{n,m}(x)=(\phi_{1,m}(x),\ldots,\phi_{n,m}(x)) . Then \left\lVert v_{n}-v_{n,m,\varepsilon}\right\rVert_{C(\overline{\Omega})}\leqslant\sup_{i=1,\ldots,n}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})}+(n-1)\varepsilon, (4.8) \begin{array}[]{l}\displaystyle\left\lVert\nabla v_{n,m,\varepsilon}-\nabla v_{n}\right\rVert_{W^{1,p}(\Omega)}\leqslant(2Kd^{2}+d^{\frac{p}{2}}|\Omega|)^{\frac{1}{p}}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\Bigl\{\,((n-1)\varepsilon+\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})})^{\frac{1}{p}}(L_{n}+L)^{\frac{p-1}{p}}+\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle((n-1)\varepsilon+\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})})^{\frac{1}{1+p}}(L_{n}+L)^{\frac{p}{1+p}}\Bigr\},\end{array} (4.9) where K is the constant from the previous proposition. Further v_{n} is C- semiconcave and L-Lipschitz . Proof. To prove this result we recall that for all \varepsilon>0 , the function \psi_{n,\varepsilon} is a 1-Lipschitz for the topology induced by the norm \left\lVert\cdot\right\rVert_{\infty} . Therefore, we have that \begin{array}[]{l}\displaystyle|v_{n}(x)-v_{n,m,\varepsilon}(x)|=|\psi_{n}(\Phi(x))-\psi_{n,\varepsilon}(\Phi_{m}(x))(x)|\leqslant\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle|\psi_{n}(\Phi(x))-\psi_{n}(\Phi_{m}(x))(x)|+|\psi_{n,\varepsilon}(\Phi_{m}(x))-\psi_{n}(\Phi_{m}(x))(x)|\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant\sup_{i\in\{1,\ldots,n\}}|\phi_{i}(x)-\phi_{i,m}(x)|+(n-1)\varepsilon,\end{array} where we have used ( 2.17 ). This proves ( 4.8 ). To prove ( 4.9 ) we note that v_{n,m,\varepsilon} is L_{m} -Lipschitz, due to ( 2.17 ), ( 2.12b ), and ( 3.2 ). Therefore we have |v_{n,m,\varepsilon}(x)-v_{n,m,\varepsilon}(y)|\leqslant L_{m}|x-y|\mbox{ for all }x,y\in\overline{\Omega}. Using this, ( 4.8 ), ( 4.6 ), and the assumption that \phi_{i,m}\to\phi_{i} in C(\bar{\Omega}) we obtain |v_{n}(x)-v_{n}(y)|\leqslant L|x-y|\mbox{ for all }x,y\in\overline{\Omega}, i.e., v is L-Lipschitz . This allows us to apply Proposition 4.1 to v_{n,m,\varepsilon}-v_{n} and obtain \begin{array}[]{l}\displaystyle\left\lVert\nabla v_{n,m,\varepsilon}-\nabla v_{n}\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant(2Kd^{2}+d^{\frac{p}{2}}|\Omega|)^{\frac{1}{p}}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\quad\left(\left\lVert v_{n,m,,\varepsilon}-v_{n}\right\rVert^{\frac{1}{p}}_{C(\overline{\Omega})}(L_{m}+L)^{\frac{p-1}{p}}+\left\lVert v_{n,m,,\varepsilon}-v_{n}\right\rVert_{C(\overline{\Omega})}^{\frac{1}{1+p}}(L+L_{m})^{\frac{p}{1+p}}\right).\end{array} From this estimate and ( 4.8 ) we obtain ( 4.9 ). Finally, since v_{n,m} is C_{m} -semiconcave, we have, for all x,y\in\Omega and t\in[0,1] , tv_{n,m}(x)+(1-t)v_{n,m}(y)-v_{n,m}(tx+(1-t)y)\leqslant\frac{C_{m}}{2}t(1-t)|x-y|^{2}, see [ 6 , Proposition 1.1.3] . Applying the uniform convergence of v_{n,m} to v_{n} and ( 4.7 ) we deduce, for all x,y\in\Omega and t\in[0,1] , that tv_{n}(x)+(1-t)v_{n}(y)-v_{n}(tx+(1-t)y)\leqslant\frac{C}{2}t(1-t)|x-y|^{2}. which implies that x\mapsto v(x)-\frac{C}{2}x^{2} is concave and consequently v_{n} is C- semiconcave. ∎ Remark 4.3 . The fact that this result allows to measure the L^{p} -error between \nabla v_{n} by \nabla v_{n,m} in terms of the C(\overline{\Omega}) -error between \phi_{i} and \phi_{i,m} , is of importance for feedback control, since the feedback operator can be expressed in terms of the gradient of the value function. Semiconcavity of the value function is a well-studied property, see for instance [ 3 , 6 ] . The established estimate can also be relevant for obtaining error bounds which do not increase exponentially with the dimension. We are now in position to prove the main theorem regarding the approximation properties of the proposed architecture. Theorem 4.2 . Let v be a C-semiconcave function, which is Lipschitz continuous in \overline{\Omega} with constant L>0 , and suppose that Hypothesis 4.1 holds. Then for each p\in[1,\infty) and each \delta>0 , there exist \varepsilon>0 , m\in\mathbb{N} , n\in\mathbb{N} , and \theta_{m}=(\theta_{m,1},\ldots,\theta_{n,m})\in\Theta_{m}^{n} such that we have \left\lVert\varv_{n,m,\varepsilon}(\theta_{m})-v\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla\varv_{n,m,\varepsilon}(\theta_{m})-\nabla v\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant\delta, v_{n,m,\varepsilon} is ( L+\delta ) Lipschitz and (C+\delta) -semiconcave. Proof. Let p\in[1,\infty) , \delta>0 , and \{\phi\}_{i=1}^{\infty} be the family of function established in 2.1 . For each n\in\mathbb{N} , let us denote v_{n}=\min_{i=1,\ldots,n}\phi_{i}(x). By construction each v_{n} is semiconcave with constant C and Lipschitz continuous with constant L . By 2.1 we can find n\in\mathbb{N} such that \left\lVert v_{n}-v\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla v_{n}-\nabla v\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant\frac{\delta}{2}. (4.10) Further \left\lVert v_{n}\right\rVert_{W^{1,\infty}(\Omega)}\leqslant L , and v_{n} is C- semiconcave. In addition, by 4.1 , applied for \xi=\phi_{i} with i=\{1,\ldots,n\} , and Theorem 4.1 we have that there exists \theta_{m}=(\theta_{m,1},\ldots,\theta_{n,m})\in\Theta_{m}^{n} and \varepsilon>0 satisfying \left\lVert\varv_{n,m,\varepsilon}(\theta_{m})-v_{n}\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla\varv_{n,m,\varepsilon}(\theta)-\nabla v_{n}\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant\frac{\delta}{2}, (4.11) \left\lVert v_{n,m,\varepsilon}\right\rVert_{W^{1,\infty}(\Omega)}\leqslant L+\delta , and v_{n,m,\varepsilon} is (C+\delta)- semiconcave. Combining ( 4.10 ), and ( 4.11 )+ we arrive at \left\lVert\varv_{n,m,\varepsilon}(\theta_{m})-v\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla\varv_{n,m,\varepsilon}(\theta)-\nabla v\right\rVert_{L^{p}(\Omega;\mathbb{R}^{d})}\leqslant\delta, \left\lVert\nabla\varv_{n,m,\varepsilon}(\theta_{m})\right\rVert_{C^{1}(\overline{\Omega})}\leqslant L+\delta , and \varv_{n,m,\varepsilon}(\theta_{m}) is (C+\delta) -semiconcave. ∎ We return to 4.1 and observe that it only connects the errors in the norms of C(\overline{\Omega}) and W^{1,p}(\Omega) , with p\in[1,\infty) . However, for some applications it can be important to control the W^{1,\infty}(\Omega) error. Since the function v_{n} is only Lipschitz continuous it is not possible to obtain convergence in W^{1,\infty}(\Omega) of v_{n,m} , since such a convergence would imply that v_{n} is C^{1}(\Omega) . Nevertheless, we can still identify regions where uniform convergence of the gradients holds. This involves the set of active indices. For a given x\in\Omega , these are the indices for which \min_{i=1,\ldots,n}\phi_{i}(x) , respectively \min_{i=1,\ldots,n}\phi_{i,m}(x) , are achieved. Theorem 4.3 . Let \{\phi_{i,m}\}_{m}\subset C^{1}(\overline{\Omega}) be sequences of functions converging to \phi_{i} in C^{1}(\overline{\Omega}) for i=1,\ldots,n . Further set v_{n}=\min_{i=1,\ldots,n}\phi_{i},\ v_{n,m}=\min_{i=1,\ldots,n}\phi_{i,m}, and introduce the sets of active indices for each x\in\overline{\Omega} I_{n}(x)=\{i:\phi_{i}(x)=v_{n}(x)\},\ I_{n,m}(x)=\{i:\phi_{i,m}(x)=v_{n,m}(x)\}, and for \delta>0 the sets \Omega_{\delta}=\{x\in\overline{\Omega}:v_{n}(x)\leqslant\phi_{j}(x)-\delta\mbox{ for all }j\notin I_{n}(x)\}. Then, for all m\in\mathbb{N} such that \left\lVert v_{n}-v_{n,m}\right\rVert_{C(\overline{\Omega})}<\frac{\delta}{2} we have that I_{n,m}(x)\subset I_{n}(x) , for x\in\Omega_{\delta} , and \left\lVert\nabla v_{n}-\nabla v_{n,m}\right\rVert_{L^{\infty}(\Omega_{\delta};\mathbb{R}^{d})}\leqslant\sup_{i=1,\ldots,n}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}. (4.12) Additionally, defining v_{n,\varepsilon}=\psi_{n,\varepsilon}(\phi_{1},\ldots,\phi_{n}) and v_{n,m,\varepsilon}=\psi_{n,\varepsilon}(\phi_{1,m},\ldots,\phi_{n,m}) , if ( 3.7 ) holds, then we have for \varepsilon\in\left(0,\frac{\delta}{2(n-1)}\right) that \left\lVert\nabla v_{n}-\nabla v_{n,\varepsilon}\right\rVert_{L^{\infty}(\Omega_{\delta};\mathbb{R}^{d})}\leqslant 2L(g_{\varepsilon}^{\prime}(0)+(1-(g_{\varepsilon}^{\prime}(\delta)^{(n-1)}))) (4.13) and \begin{array}[]{l}\displaystyle\left\lVert\nabla v_{n}-\nabla v_{n.m,\varepsilon}\right\rVert_{L^{\infty}(\Omega_{\delta};\mathbb{R}^{d})}\leqslant 2L(g_{\varepsilon}^{\prime}(0)+(1-(g_{\varepsilon}^{\prime}(\delta)^{(n-1)})))+\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle 2n(n-1)L\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}\sup_{i=1,\ldots,n}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})}+\sup_{i=1,\ldots,n}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}.\end{array} (4.14) where L=\sup_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}. Proof. We first verify that I_{n,m}(x)\subset I(x) for x\in\Omega_{\delta} . For m\in\mathbb{N} let us set \delta_{m}:=\sup_{i=1,\ldots,n}\left\lVert\phi_{i,m}-\phi_{i}\right\rVert_{C(\overline{\Omega})}. Let m\in\mathbb{N} be such that \delta_{m}\leqslant\frac{\delta}{2} and consider x\in\Omega_{\delta} and i\in I_{n,m}(x) . Then we have that v_{n,m}(x)=\phi_{i,m}(x)\geqslant\phi_{i}(x)-\delta_{m}. Proceeding by contradiction, if i\not\in I_{n}(x) , then v_{n}(x)\leqslant\phi_{i}(x)-\delta. Combining these two inequalities we obtain v_{n}(x)\leqslant v_{n,m}(x)-\delta+\delta_{m}. This implies that v_{n,m}(x)-v_{n}(x)\geqslant\delta-\delta_{m} and hence |v_{n,m}(x)-v_{n}(x)|\geqslant\delta-\delta_{m}\geqslant\frac{\delta}{2}. On the other hand, we also know that |v_{n}(x)-v_{n,m}(x)|<\frac{\delta}{2} , which leads to a contradiction. Thus I_{n,m}(x)\subset I_{n}(x) for x\in\Omega_{\delta} follows. Turning to ( 4.12 ), let us first observe that \Omega_{\delta} is cloased and there measurable. Further, both functions v_{n} and v_{n,m} are a.e. differentiable in \Omega_{\delta} . Let x be an arbitrary element of \Omega_{\delta} where both functions are differentiable. Choose i\in I_{n,m}(x) . Then by the previous step we have i\in I_{n}(x)\cap I_{n,m}(x) . This implies that v_{n}(x)=\phi_{i}(x) and v_{n,m}(x)=\phi_{i,m}(x) . By Theorems 3.2.13 and 3.2.2 in [ 23 , Part I, Section 3.1, pg.37,47] , we have \nabla v_{n}(x)=\nabla\phi_{i}(x) and \nabla v_{n,m}(x)=\nabla\phi_{i,m}(x) . Furthermore, for j\in I_{n,m}(x) \nabla v_{n,m}(x)=\nabla\phi_{j,m}(x) (4.15) holds. Then it is clear that |\nabla v_{n}(x)-\nabla v_{n,m}(x)|\leqslant\sup_{j=1,\ldots,n}\left\lVert\nabla\phi_{j}-\nabla\phi_{j,m}\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}. Since v_{m} and v are differentiable a.e. the above equality holds a.e. in \Omega_{\delta} and consequently \left\lVert\nabla v_{n}-\nabla v_{n,m}\right\rVert_{L^{\infty}(\Omega_{\delta};\mathbb{R}^{d})}\leqslant\sup_{i=1,\ldots,n}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{L^{\infty}(\Omega;\mathbb{R}^{d})}, and thus ( 4.12 ) is satisfied. In order to prove ( 4.13 ) we will first prove the following: |1-p_{n,\hat{i},\varepsilon}(\Phi_{n}(x))|\leqslant g^{\prime}_{\varepsilon}(0)+\left(1-g^{\prime}_{\varepsilon}\left(\frac{\delta}{2}\right)^{n-1}\right), (4.16) for x\in\Omega_{\delta} and \hat{i}=\hat{i}_{n}(\Phi_{n}(x)) . For this purpose, from ( 3.5 ) we deduce \begin{array}[]{l}\displaystyle|1-p_{n,\hat{i},\varepsilon}(\Phi_{n}(x))|=1-\prod_{j=\hat{i}+1}^{n}g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x))\left(1-g^{\prime}_{\varepsilon}(\phi_{\hat{i}}(x)-v_{\hat{i}-1,\varepsilon}(x))\right)\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle=1-\prod_{j=\hat{i}+1}^{n}g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x))+g^{\prime}_{\varepsilon}(\phi_{\hat{i}}(x)-v_{\hat{i}-1,\varepsilon}(x))\prod_{j=\hat{i}+1}^{n}g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x)).\end{array} (4.17) We analyze separately each of the terms in rightmost expression in the previous equality. Since \hat{i}\in I_{n}(\Phi_{n}(x)) we know that \phi_{\hat{i}}(x)\leqslant v_{\hat{i}-1}(x). Additionally, since ( 3.7 ) holds, we can use Lemma 3.1 in the previous inequality to deduce that \phi_{\hat{i}}(x)\leqslant v_{\hat{i}-1,\varepsilon}(x). Since g^{\prime}_{\varepsilon} is monotonically increasing, we have g^{\prime}_{\varepsilon}(\phi_{\hat{i}}(x)-v_{\hat{i}-1,\varepsilon}(x))\leqslant g^{\prime}_{\varepsilon}(0). (4.18) From this, and using ( 2.12b ) we can bound the last term in ( 4.17 ) and obtain g^{\prime}_{\varepsilon}(\phi_{\hat{i}}(x)-v_{\hat{i}-1,\varepsilon}(x))\prod_{j=\hat{i}+1}^{n}g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x))\leqslant g^{\prime}_{\varepsilon}(0). (4.19) For the remaining term in ( 4.17 ), we note that since \hat{i}=\max\{i\in I_{n}(\Phi_{n}(x))\} and x\in\Omega_{\delta} , we have that if j\in\{\hat{i}+1,\ldots,n\} , then \phi_{j}(x)-v_{j-1}(x)\geqslant\delta. Using ( 2.16 ) in the previous inequality and the fact that \varepsilon\in\left(0,\frac{\delta}{2(n-1)}\right) we infer that \phi_{j}(x)-v_{j-1,\varepsilon}(x)>\frac{\delta}{2}. Combining this with the monotonicity of g_{\varepsilon}^{\prime} we deduce that g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x))\geqslant g^{\prime}_{\varepsilon}\left(\frac{\delta}{2}\right). This implies that 1-\prod_{j=\hat{i}+1}^{n}g^{\prime}_{\varepsilon}(\phi_{j}(x)-v_{j-1,\varepsilon}(x))\leqslant 1-g^{\prime}_{\varepsilon}\left(\frac{\delta}{2}\right)^{{{n-\hat{i}}}}\leqslant 1-g^{\prime}_{\varepsilon}\left(\frac{\delta}{2}\right)^{n-1}. (4.20) Using ( 4.19 ) and ( 4.20 ) in ( 4.17 ), we conclude that ( 4.16 ) holds. Assuming that v_{n} is differentiable at x , we have \nabla v_{n}(x)=\nabla\phi_{\hat{i}}(x) . Combining this with ( 3.2 ) and ( 4.16 ) we obtain \begin{array}[]{l}\displaystyle|\nabla v_{n,\varepsilon}(x)-\nabla v_{n}(x)|=\big|\nabla\phi_{\hat{i}}(x)(1-p_{n,\hat{i},\varepsilon}(\Phi_{n}(x)))+\sum_{\hat{i}\neq j}\nabla\phi_{j}(x)p_{n,j,\varepsilon}(\Phi_{n}(x))\big|\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant L(1-p_{n,\hat{i},\varepsilon}(\Phi_{n}(x)))+L\sum_{j\neq\hat{i}}p_{n,j,\varepsilon}(\Phi_{n}(x))\leqslant 2L(1-p_{n,\hat{i},\varepsilon}(\Phi_{n}(x)))\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant 2L\left(g^{\prime}_{\varepsilon}(0)+\left(1-g^{\prime}_{\varepsilon}\left(\frac{\delta}{2}\right)^{n-1}\right)\right),\end{array} where in the next to last inequality we used ( 2.17 ). Using the almost everywhere differentiability of v_{n} we obtain ( 4.13 ). To prove ( 4.14 ) we will first derive an upper bound of \left\lVert\nabla v_{n,m,\varepsilon}-\nabla v_{n,m}\right\rVert_{L^{\infty}(\Omega_{\delta})}. For this purpose, we note that by ( 2.19 ) we have for all x\in\overline{\Omega} \begin{array}[]{l}\displaystyle(\nabla v_{n,m,\varepsilon}(x)-\nabla v_{n,\varepsilon}(x))^{\top}=D\psi_{n,\varepsilon}(\Phi_{n,m}(x))D\Phi_{n,m}(x)-D\psi_{n,\varepsilon}(\Phi_{n}(x))D\Phi_{n}(x)\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle=(D\psi_{n,\varepsilon}(\Phi_{n,m}(x))-D\psi_{n,\varepsilon}(\Phi_{n}(x)))D\Phi_{n}(x)+D\psi_{n,\varepsilon}(\Phi_{n,m}(x))(D\Phi_{n,m}(x)-D\Phi_{n}(x)).\end{array} (4.21) where D denotes the Jacobian matrix. To bound the first term on the right hand side of ( 4.21 ) we have \begin{array}[]{l}\displaystyle|D\psi_{n,\varepsilon}(\Phi_{n,m}(x))-D\psi_{n,\varepsilon}(\Phi_{n}(x)))D\Phi_{n}(x)|\leqslant|\nabla\psi_{n,\varepsilon}(\Phi_{n,m}(x))-\nabla\psi_{n,\varepsilon}(\Phi_{n}(x))|\cdot|D\Phi_{n}^{\top}(x)|\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant n^{\frac{1}{2}}L\left\lVert\nabla^{2}\psi_{n,\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R}^{n};\mathbb{R}^{n\times n})}|\Phi_{n,m}(x)-\Phi_{n}(x)|\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant nL\left\lVert\nabla^{2}\psi_{n,\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R}^{n};\mathbb{R}^{n\times n})}\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})},\end{array} (4.22) as for the second one we have \begin{array}[]{l}\displaystyle|D\psi_{n,\varepsilon}(\Phi_{n,m}(x))(D\Phi_{n,m}(x)\!-\!D\Phi_{n}(x))|\!=\!\left(\sum_{i=1}^{d}\!\left(\sum_{j=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{j}}(\Phi_{n,m}(x))\!\left(\frac{\partial\phi_{j,m}}{\partial x_{i}}(x)\!-\!\frac{\partial\phi_{j}}{\partial x_{i}}(x)\!\right)\right)^{2}\right)^{\frac{1}{2}}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant\!\left(\sum_{i=1}^{d}\sum_{j=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{j}}(\Phi_{n,m}(x))\!\left(\frac{\partial\phi_{j,m}}{\partial x_{i}}(x)\!-\!\frac{\partial\phi_{j}}{\partial x_{i}}(x)\right)^{2}\right)^{\frac{1}{2}}\!=\!\left(\sum_{j=1}^{n}\frac{\partial\psi_{n,\varepsilon}}{\partial a_{j}}(\Phi_{n,m}(x))|\nabla\phi_{j,m}(x)\!-\!\phi_{j}(x)|\right)^{\frac{1}{2}}\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\leqslant\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})},\end{array} (4.23) where we have used Jensen’s inequality. Plugging ( 4.22 ) and ( 4.23 ) in the right hand side of ( 4.21 ) we arrive at \begin{array}[]{l}\displaystyle|(\nabla v_{n,m,\varepsilon}(x)-\nabla v_{n,\varepsilon}(x))|\leqslant nL\left\lVert\nabla^{2}\psi_{n,\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R}^{n};\mathbb{R}^{n\times n})}\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})}+\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}.\end{array} (4.24) Using ( 2.19 ) on the first term in the right hand side of the above inequality we get \begin{array}[]{l}\displaystyle|(\nabla v_{n,m,\varepsilon}(x)-\nabla v_{n,\varepsilon}(x))|\leqslant 2n(n-1)L\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})}+\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle\max_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}.\end{array} (4.25) Finally, using ( 4.25 ) and ( 4.13 ), we obtain ( 4.14 ) by the triangle inequality. ∎ Remark 4.4 . Let us discuss some consequences of the previous theorem. For this purpose we observe that by ( 2.12e ) and ( 3.8 ) the term (g_{\varepsilon}^{\prime}(0)+(1-(g_{\varepsilon}^{\prime}(\delta)^{(n-1)}))) tends to 0 as \varepsilon\to 0. Moreover let us choose \varepsilon_{m}\to 0^{+} such that in addition to ( 2.12f ) the following holds: \lim_{m\to\infty}\left(\left\lVert g_{\varepsilon_{m}}^{\prime\prime}\right\rVert_{L^{\infty}(\mathbb{R})}\max_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i,m}-\phi_{i}\right\rVert_{C(\overline{\Omega})}\right)=0. Then as a consequence of 4.3 we obtain that v_{n,m,\varepsilon_{m}} converges to \nabla v_{n} in W^{1,\infty}(\Omega_{\delta}) for each \delta>0 , as m\to\infty . As a second consequence, if we choose g_{\varepsilon}=g_{\varepsilon,M} defined in Remark 2.2 , then we have that g^{\prime}_{\varepsilon,M}(0)=0,\ g^{\prime}_{\varepsilon}\left(\delta\right)=1\text{ and }\left\lVert g^{\prime\prime}\right\rVert_{L^{\infty}(\mathbb{R})}=\frac{1}{\varepsilon}, if \varepsilon<\delta . From this we deduce that under this choice the right hand side of ( 4.14 ) is bounded by 2n(n-1)\frac{L}{\varepsilon}\sup_{i\in\{1,\ldots,n\}}\left\lVert\phi_{i,m}-\phi_{i}\right\rVert_{C(\overline{\Omega})}+\sup_{i\in\{1,\ldots,n\}}\left\lVert\nabla\phi_{i,m}-\nabla\phi_{i}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}. (4.26) Consequently, for \varepsilon\in\left(0,\frac{1}{2\delta(n-1)}\right) fixed as specified in Theorem 4.3 , v_{n,m,\varepsilon} converges to v_{n} in W^{1,\infty}(\Omega_{\delta}) as m\to\infty . Remark 4.5 . It should be noted that ( 4.14 ) does not imply convergence in C(\Omega_{\delta};\mathbb{R}^{d}) of \nabla v_{n,m,\varepsilon} . However, noticing that the function G(x)=\nabla\phi_{\hat{i}_{n}(x)}(x) is almost everywhere in \Omega equal to \nabla v_{n} and that G is continuous in \Omega_{\delta} , we can infer, by ( 4.14 ), that \begin{array}[]{l}\displaystyle\left\lVert G-\nabla v_{n.m,\varepsilon}\right\rVert_{C(\Omega_{\delta};\mathbb{R}^{d})}\leqslant 2L(g^{\prime}_{\varepsilon}(0)+(1-(g_{\varepsilon}^{\prime}(\delta)^{(n-1)})))\\ \vskip 6.0pt plus 2.0pt minus 2.0pt\cr\displaystyle+2n(n-1)L\left\lVert g^{\prime\prime}_{\varepsilon}\right\rVert_{L^{\infty}(\mathbb{R})}\sup_{i=1,\ldots,n}\left\lVert\phi_{i}-\phi_{i,m}\right\rVert_{C(\overline{\Omega})}+\sup_{i=1,\ldots,n}\left\lVert\nabla\phi_{i}-\nabla\phi_{i,m}\right\rVert_{C(\overline{\Omega};\mathbb{R}^{d})}.\end{array} (4.27) The continuity of G in \Omega_{\delta} is a consequence of the fact that the active set of incides I_{n} does not change locally, that is, for x\in\Omega_{\delta} we have I_{n}(y)=I_{n}(x) for all y\in B\left(x,\frac{\delta}{2L}\right)\cap\Omega . To prove this assertion, we note that if |y-x|<\frac{\delta}{2L} , then for all i\in\{1,\ldots,n\} we have |\phi_{i}(x)-\phi_{i}(y)|<\frac{\delta}{2}. By symmetry, it is enough to prove that I_{n}(y)\subset I_{n}(x) for all y\in B(x,\frac{\delta}{2L})\cap\Omega . If I_{n}(y)\nsubseteq I_{n}(x) for some y\in B(x,\frac{\delta}{2L})\cap\Omega , then there exists i\in I_{n}(y)\setminus I_{n}(x) and thus we obtain: v(y)=\phi_{i}(y)\geqslant\phi_{i}(x)-\frac{\delta}{2}\geqslant v(x)+\frac{\delta}{2}\geqslant v(y)+\frac{\delta}{2}, which is a contradiction. 5 Example In this section we introduce an example of a semiconcave function v_{d} for d\in\mathbb{N} , which can be explicitly represented by a family of 2d functions of class C^{2} , satisfies a Hamilton Jacobi Bellman equation, and which is not C^{1} . Additionally, we present a family of setting S_{m}=(\Theta_{m},\xi_{m}) for m\in\mathbb{N} which satisfies ( 4.1 ). Utilizing this family of settings and the approximation of the positive part g_{\varepsilon}=g_{\varepsilon,M} for \varepsilon>0 , which was introduced in Remark 2.2 , we approximate v_{d} by means of the the parametrization introduced in ( 2.27 ). In subsection 5.2 we verify that the hypotheses of Theorem 4.1 are met and we use it to prove the convergence of the approximation. Furthermore, by means 4.1 we will also prove that the the approximation is converging in W^{1,\infty}(\Omega_{\delta}) for all \delta>0 and that the approximation satisfies the same Hamilton Jacobi Bellman equation approximately. In order to highlight the properties of the proposed approximation, we compere it with the approximation resulting from using the Log-Sum-Exp function (see Remark 3.3 ) which is commonly utilized as a smooth approximation of the minimum. In contrast to the proposed approximation, the Log-Sum-Exp approximation is not able to deal with the discontinuities of the gradient and it struggles to solve the Hamilton Jacobi Bellman equation. To support this numerically, in subsection 5.3 we implement both approximations and measure theirs convergences. Remarkably, these experiments suggest that the proposed approximation solves the Hamilton Jacobi Bellman equation approximately in a uniform sense. 5.1 Exponential Distance Function In order to illustrate the properties of the proposed parametrization we introduce the Exponential Distance Function: x\in\overline{\Omega}\mapsto v_{d}(x):=\min_{i\in\{1,\ldots,2d\}}\phi_{i}(x) (5.1) with \Omega=(-1,1)^{d} and \phi_{i}(x)=\exp\left(-\frac{1}{2}|x-e_{i}|^{2}\right)\text{ and }\phi_{d+i}(x)=\exp\left(-\frac{1}{2}|x+e_{i}|^{2}\right) (5.2) for i\in\{1,\ldots,d\} where e_{i} is the i -th canocial vector of \mathbb{R}^{d} . Clearly, the function v_{d} is semiconcave thanks to ( 2.1 ) and it is a viscosity solution of the following Hamilton Jacobi Bellman equation: H(\nabla\phi(x),\phi(x))=0\text{ for all }x\in\mathbb{R}^{d}. (5.3) for the Hamiltonian H:\mathbb{R}^{d}\times\mathbb{R}^{+}\to\mathbb{R} given by H(p,a)=\left\{\begin{array}[]{ll}|p|^{2}+2\log(|a|)a^{2}&\mbox{ if }a\neq 0\\ |p|^{2}&\mbox{ if }a=0\end{array}\right.\mbox{, for }(p,a)\in\mathbb{R}^{d}\times\mathbb{R}. Below we provide the proof. Lemma 5.1 . For each i\in\{1,\ldots,2d\} the function \phi_{i} satisfies H(\nabla\phi_{i}(x),\phi_{i}(x))=0\mbox{ for all }x\in\mathbb{R}^{d}, (5.4) and v_{d} is a viscosity solution of ( 5.3 ). Proof. We start by noting that an easy calculation proves that for each i\in\{1,\ldots,n\} , the function \phi_{i} satisfies ( 5.4 ). Additionally, fixing x\in\mathbb{R}^{d} with v_{d} differentiable at x , we have that v_{d}(x)=\phi_{i}(x) and \nabla v_{d}(x)=\nabla\phi_{i}(x) for some i\in\{1,\ldots,n\} and hence we have that v_{d} satsifies ( 5.3 ) at x . Then, due to the a.e. differentiability of v_{d} , we have that v_{d} satisfies ( 5.3 ) a.e. and thus by Proposition 5.3.1 in [ 6 ] and the semiconcavity of v_{d} , we have that v_{d} is a viscosity solution of ( 5.3 ). ∎ Figure 2 : Active sets (a) \delta=10^{-1} (b) \delta=10^{-2} Figure 3 : \Omega_{\delta} sets of v_{d} . In the remainder of this section, we use d=2 for the ease of the exposition, since it allows to depict the active sets and the set \Omega_{\delta} . In Figure 2 each active set is colored differently. From this we see that the discontinuities occurs along the diagonals of the square [-1,1]^{2} . Additionally, in Figure 3 , the set \Omega_{\delta} is shown for \delta\in\{10^{-2},10^{-1}\} . As we see in Figure 3 , the sets \Omega_{\delta} include part of the diagonals of the square [-1,1]^{2} , which is where the discontinuities of \nabla v_{d} occurs. To see this, we note that along the diagonals of [-1,1]^{2} there is more than one active indices and \nabla\phi_{i}\neq\nabla\phi_{j} for i\neq j . For example, if x_{1}=x_{2} and x_{1}\in[0,1] , then \phi_{3}(x_{1},x_{2})=\phi_{4}(x_{1},x_{2}) and it can be verified that \nabla v_{3}(x_{1},x_{2})\neq\nabla v_{4}(x_{1},x_{2}) . 5.2 Setting and approximation For m\in\mathbb{N} we consider Chebyshev polynomials as setting, that is: \Theta_{m}=\mathbb{R}^{(m+1)\times(m+1)}\mbox{ and }\xi_{m}(\theta)(x)=\sum_{i=1}^{m+1}\sum_{j=1}^{m+1}\theta_{i,j}T_{i-1}(x_{1})T_{j-1}(x_{2})\mbox{ for }x\in[-1,1]^{2}\mbox{ and }\theta\in\Theta_{m}, where T_{k} is the k- th Chebyshev polynomial for k\in\mathbb{N}_{0} . By the results in [ 24 , Section 4.5.1 in Chapter 4] we see that the setting S_{m}=(\Theta_{m},\xi_{m}) satisfies 4.1 . In particular, for \phi\in C^{\infty}([-1,1]^{2}) we have that for coefficients \theta_{m}\in\Theta_{m} obtained by interpolating \phi at the Chebyshev points of degree m (see [ 24 , Section 4.5.1 in Chapter 4] ) we have \lim_{m\to\infty}\xi_{m}(\theta_{m})=\phi\mbox{ in }C^{2}([-1,1]^{2}). Concerning the approximation of the positive part, we choose s\in\mathbb{R}\mapsto g_{\varepsilon,M}(s)=\left\{\begin{array}[]{ll}0&\text{if }s<0\\ \frac{s^{2}}{2\varepsilon}&\text{if }s\in[0,\varepsilon)\\ s-\frac{\varepsilon}{2}&\text{if }s>\varepsilon.\end{array}\right. According to Remarks 2.2 and 3.3 , g_{\varepsilon,M} satisfies ( 2.12 ), ( 3.7 ) and ( 3.8 ). We name the resulting approximation of the minimum \psi_{n,\varepsilon} the MoreauRegMin since it comes from the Moreau regularization of the positive part. Defining \theta_{m}=(\theta_{1,m},\ldots,\theta_{2d,m}) with \theta_{i,m}\in\Theta_{m} as the coefficients obtained by interpolating \phi_{i} by Chebychev polynomials of total degree less or equal than m , for i\in\{1,\ldots,2d\} we propose the following approximation for v_{d} : v_{d,m,\varepsilon}=\varv_{2d,m,\varepsilon}(\theta_{m}), We will refer to this approximation of v_{d} as the MoreauRegMin approximation . By ( 4.1 ) we have \lim_{\varepsilon\to 0^{+},m\to\infty}\left\lVert v_{d,m,\varepsilon}-v_{d}\right\rVert_{C(\overline{\Omega})}+\left\lVert\nabla v_{d,m,\varepsilon}-\nabla v_{d}\right\rVert_{L^{1}(\Omega);\mathbb{R}^{d}}=0. Furthermore, for \delta>0 and \varepsilon\in(0,\frac{\delta}{2(2d-1)}) fixed, we have that \lim_{m\to\infty}\left\lVert v_{d,m,\varepsilon}-v_{d}\right\rVert_{W^{1,\infty}(\Omega_{\delta})}=0. In particular, due the continuity of H and the fact that \varv_{2d,m,\varepsilon}(\theta_{m}) is of class C^{1} , we have that \lim_{\varepsilon\to 0^{+},m\to\infty}\left\lVert H(\nabla v_{d,m,\varepsilon},v_{d,m,\varepsilon})\right\rVert_{C(\overline{\Omega_{\delta}})}=0. which in turns implies that \lim_{\varepsilon\to 0^{+},m\to\infty}H(\nabla v_{d,m,\varepsilon}(x),v_{d,m,\varepsilon}(x))=0 for all x\in\overline{\Omega} , since clearly \overline{\Omega}=\lim_{\tilde{\delta}\to 0^{+}}\Omega_{\tilde{\delta}}=\bigcup_{\tilde{\delta}>0}\Omega_{\tilde{\delta}}. It is noteworthy that the last three properties described above are not necessarily satisfied by a general approximation of v_{d} . For example, using the Log-Sum-Exp functions defined in 3.3 , the approximation of v_{d} given by \tilde{v}_{d,m,\varepsilon}=\tilde{\psi}_{n,\varepsilon}(\xi_{\theta_{1,m}},\ldots,\xi_{\theta_{2d,m}}) (5.5) converges uniformly to v_{d} as \varepsilon\to 0^{+} and m\to\infty , it is Lipschitz and semiconcave uniformly with respect to m\in\mathbb{N} , but its gradient does not converges pointwise as is explained in 3.3 and furthermore H(\nabla\tilde{v}_{d,m,\varepsilon},\tilde{v}_{d,m,\varepsilon}) does not vanishes as \varepsilon\to 0^{+} and m\to\infty pointwise nor uniformly in \Omega_{\delta} for any \delta>0 . In particular, if we consider x=\left(-\frac{1}{2},-\frac{1}{2}\right) we have that v_{d}(x)=\phi_{1}(x)=\phi_{2}(x)=\exp\left(-\frac{5}{4}\right) and \nabla\phi_{1}(x)=\left(\begin{array}[]{c}3\\ 1\end{array}\right)\frac{\exp\left(-\frac{5}{4}\right)}{2}\neq\left(\begin{array}[]{c}1\\ 3\end{array}\right)\frac{\exp\left(-\frac{5}{4}\right)}{2}=\nabla\phi_{2}(x), choosing \varepsilon_{m}=|\phi_{1,m}(x)-\phi_{2,m}(x)|^{\frac{1}{2}} we have \lim_{m\to\infty}\nabla\tilde{v}_{d,m,\varepsilon_{m}}(x)=\frac{1}{2}(\nabla\phi_{1}(x)+\nabla\phi_{2}(x))=\left(\begin{array}[]{c}1\\ 1\end{array}\right)\exp\left(-\frac{5}{4}\right), which by the continuity of H implies that \lim_{m\to\infty}H(\nabla\tilde{v}_{d,m,\varepsilon_{m}}(x),\tilde{v}_{d,m,\varepsilon_{m}}(x))=-\frac{1}{2}\exp\left(-5\right)<0. In the next subsection, we compare numerically the convergence of v_{d,m,\varepsilon} and \tilde{v}_{d,m,\varepsilon} as \varepsilon\to 0^{+} and m\to\infty . 5.3 Numerical experiments To carry out the numerical experiments we consider different degrees of the Chebyshev interpolation and regularization parameters \varepsilon>0 : m\in\{2,4,6,8,10\}\mbox{ and }\varepsilon\in\{10^{-4},10^{-2},10^{-1}\}. We will gauge the convergence of the different approximations of v_{d} in \Omega_{\delta} for \delta\in\{0,10^{-1},10^{-3}\} , where in the case \delta=0 we take that \Omega_{\delta}=\overline{\Omega} . For this, we consider a uniform grid \mathcal{X}=\{(x_{i},y_{j})\}_{i,j=0}^{1000} of [-1,1]^{2} , where \{x_{i}\}_{i=0}^{1000} is a uniform division of [-1,1] . We measure the convergence using the following metrics: D_{C}(u,\delta)=\frac{1}{|\mathcal{X}\cap\Omega_{\delta}|}\max_{x\in\mathcal{X}\cap\Omega_{\delta}}|v_{d}(x)-u(x)|, D_{W1}(u,\delta)=\frac{1}{|\mathcal{X}\cap\Omega_{\delta}|}\sum_{x\in\mathcal{X}\cap\Omega_{\delta}}|\nabla v_{d}(x)-\nabla u(x)|, D_{W\infty}(u,\delta)=\max_{x\in\mathcal{X}\cap\Omega_{\delta}}|\nabla v_{d}(x)-\nabla u(x)|, where |\cdot| denotes the cardinality of a set as well as the \mathbb{R}^{n}- norm as appropriate. Additionally, to verify the convergence of the Hamiltonian of the approxmiation we use: D_{H1}(u,\delta)=\frac{1}{|\mathcal{X}\cap\Omega_{\delta}|}\sum_{x\in\mathcal{X}\cap\Omega_{\delta}}|H(\nabla u(x),u(x))|, D_{H\infty}(u,\delta)=\max_{x\in\mathcal{X}\cap\Omega_{\delta}}|H(\nabla u(x_{i},y_{j}),u(x))|. \delta 10^{-4} 10^{-3} 10^{-2} 10^{-1} \frac{|\mathcal{X}\cap\Omega_{\delta}|}{|\mathcal{X}|} 1 0.993 0.918 0.416 Table 1 : Proportion of \frac{|\mathcal{X}\cap\Omega_{\delta}|}{|\mathcal{X}|} . (a) D_{C}(\cdot,\delta) error for \delta=0 . (b) D_{W1}(\cdot,\delta) error for \delta=0 . (c) D_{W\infty}(\cdot,\delta) error for \delta=0 . (d) D_{H1}(\cdot,\delta) error for \delta=0 . (e) D_{H\infty}(\cdot,\delta) error for \delta=0 . (f) Legend. Figure 4 : Error for \delta=0 . (a) D_{W\infty}(\cdot,\delta) error for \delta=10^{-2} . (b) D_{H\infty}(\cdot,\delta) error for \delta=10^{-2} . Figure 5 : Error for \delta=10^{-2} (a) D_{W\infty}(\cdot,\delta) error for \delta=10^{-3} . (b) D_{H\infty}(\cdot,\delta) error for \delta=10^{-3} . Figure 6 : Error for \delta=10^{-3} The results are summarized in Table 1 , where the proportion of the grid that intersects \Omega_{\delta} , for each considered \delta is recorded, and in Figures 4 - 6 , where the behavior of the errors for \delta\in\{0,10^{-3},10^{-2},10^{-1}\} are depicted. In the following, we discuss these results. We observe in Figure 3 that \Omega_{\delta} covers part of the diagonals of the square. As \delta\to 0^{+} the proportion of the diagonals covered by \Omega_{\delta} increases and for \delta=10^{-2} , at least visually, it seems that this proportion is close to 1. It is worth recalling that the discontinuities of the gradient of v_{d} occur precisely along the diagonals of the square. In this example, even if \delta is not extremely close to 0 , we can obtain a good representation of these discontinuities. Regarding the behavior of the errors in the case of \delta=0 , and thus \Omega_{\delta}=\overline{\Omega} , from Figure 4 we see that the behavior of the D_{C} , D_{W\infty} , D_{H\infty} is the same for the MoreuRegMin and the Log-Sum-Exp approximation. The main differences arise from the choice of \varepsilon . In contrast, in the case of D_{H1} and D_{W1} , independently of \varepsilon and the degree, MoreuRegMin achieves a better performance in terms of D_{W1} . This is consistent with the fact that MoreuRegMin is able to represent in a better manner the gradient of v_{d} and viscosity solutions of HJB equations. For the cases \delta=10^{-2} and \delta=10^{-3} , D_{C} , D_{W1} and D_{H1} do not differ from what was already shown in Figure 4 . Thus we decided in Figures 5 and 6 to focus on the behavior of D_{H\infty} and D_{W\infty} . It is noteworthy that for all \varepsilon and degrees, both D_{W\infty} and D_{H\infty} are above 10^{-1} for the Log-Sum-Exp approximation, this indicates that this approximation is not able to approximate the gradient of v_{d} uniformly. In contrast, we see in Figure 5 that for \delta=10^{-2} , the error D_{W\infty} of the MoreuRegMin approximation decreases with the degree. The cases \varepsilon=10^{-3} and \varepsilon=10^{-4} behave identically to each other. As explained at the end of Section 4 , this is due to the fact that g^{\prime}_{\varepsilon,M}(0)=g^{\prime}_{\varepsilon,M}(\frac{\delta}{2})=0 if \varepsilon<\delta . In the case of D_{H\infty} , the behavior for \varepsilon=10^{-3} and \varepsilon=10^{-4} is not identical because the Hamiltonian also receives as input the function itself for which the approximation error depends on \varepsilon . In agreement with these observations, in Figure 6 for \delta=10^{-3} we see that the only case in which the errors D_{W\infty} and D_{H\infty} decrease and achives values below 10^{-1} is when \varepsilon=10^{-4} for the MoreuRegMin approximation. As in the case of \delta=10^{-2} this is explained by the fact that D_{W\infty} does not depend on \varepsilon if \varepsilon<\delta . 6 Conclusions In this work a smooth, semiconcavity preserving, approximation was introduced. The proposed semiconcavity preserving approximation was devised with two components: a smooth approximation \psi_{n,\varepsilon} of the minimum of n- real-valued functions and a universal approximating parametrization of C^{2} functions. The universality of the semiconcavity preserving approximation for semiconcave functions was proved in the C(\overline{\Omega}) and W^{1,p}(\Omega) norms for p\in[1,\infty) . Further uniform error bounds were presented for the gradient of the proposed approximation in a family of sets converging to \Omega , which includes part of the dicontinuities of the gradient. Such a result is not evident since the gradient of a semiconcave function is not necessarily continuous. By analyzing the limiting behavior of the gradient of \psi_{n,\varepsilon} as \varepsilon\to 0^{+} , the pertinence of this approximation for viscosity solutions of HJB equations was shown in Remark 3.1 . It should be noted that although there exist other smooth approximations of the minimum function such as the Log-Sum-Exp, they do not necessarily exhibit the same behavior. To illustrate the results of this article, in Section 5 the exponential distance function was introduced. It is semiconcave and satisfies a HJB equation. By means of Chebyshev polynomials, a setting satisfying Hypothesis 4.1 was presented in Subsection 5.2 . The uniform convergence of the Hamiltonians in \Omega_{\delta} towards 0 was proved for this approximation, and for \varepsilon small enough, the numerical results using the MoreauRegMin framework confirm the behavior. On the other hand, the Log-Sum-Exp approximation is not able to achieve the same results. To conclude, we expect to utilize the proposed parametrization for devising new machine learning based methodologies for the resolution of HJB equations and the design of optimal feedback laws in future work. For the aforementioned task, it has been proved in [ 20 ] that the semiconcavity of the approximation plays an important role for ensuring its performance. In addition, we believe that the analysis of the parametrization developed in this article can help to understand under which conditions one can provide a parametrization which mitigates the so called curse of dimensionality.