Continuous differentiability of the signum function and Newton’s method for bang-bang control

Daniel Wachsmuth, Gerd Wachsmuth · 2025

Read Continuous differentiability of the signum function and Newton’s method for bang-bang control by Daniel Wachsmuth, Gerd Wachsmuth (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24829.txt.

Introduction

Daniel Wachsmuth and Gerd Wachsmuth investigate in 2025 whether a classic root finding method can solve bang-bang control problems, where the control switches abruptly between extremes. Their key step is showing that the sign function, which captures the switch, can be differentiated in a strong sense between the right function spaces. Numerical experiments then test the resulting method. They show it can be applied in practice for this hard class of problems.

Catalog record

CREATORDaniel Wachsmuth, Gerd Wachsmuth
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24829

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Continuous differentiability of the signum function and Newton’s method for bang-bang control Daniel Wachsmuth, Gerd Wachsmuth Abstract We investigate bang-bang control problems and the possibility to apply Newton’s method to solve such kind of problems numerically. To this end, we show that the signum function is Fréchet differentiable between appropriate function spaces. Numerical experiments show the applicability of the resulting method. keywords Bang-bang controls, Newton method, signum function MSC (2020) 49M15 , 49K30 , 49M41 1 Introduction We are interested in the numerical solution of optimal control problems of the type \min_{u\in L^{2}(\Omega)}\frac{1}{2}\|S(u)-y_{d}\|_{L^{2}(\Omega)}^{2} subject to |u|\leq 1\text{ almost everywhere on }\Omega. Here, \Omega is a bounded domain in \mathbb{R}^{d} and S:L^{2}(\Omega)\to L^{2}(\Omega) is the (possibly nonlinear) control-to-state mapping. In addition, y_{d}\in L^{2}(\Omega) is a given desired state. For such problems, optimal controls are often bang-bang, i.e., at almost all points of the domain, optimal controls only attain the control bounds \pm 1 . Typically, the first-order necessary and sufficient optimality condition can be written in this case as \bar{u}=\operatorname{sign}(-\bar{p}),\qquad\bar{p}=S^{\prime}(\bar{u})^{*}(S(\bar{u})-y_{d}), where \bar{u} is an optimal control and \bar{p} is the associated adjoint state. In order to solve this system with Newton’s method, we need to show that the signum function \operatorname{sign} is differentiable between appropriate function spaces. Our main result Theorem 3.9 shows that \operatorname{sign}\colon C^{1}(\bar{\Omega})\to W^{-1,q}(\Omega)^{\star} is indeed differentiable at points w\in C^{1}(\bar{\Omega}) satisfying a certain regularity condition. We also show that this gives rise to local superlinear convergence of Newton’s method applied to an optimal control problem governed by linear or semilinear elliptic PDEs, see Section 4 . Numerical examples show the efficiency of our proposed methods, see Section 5 . Second-order optimality conditions for the control of semilinear equations without a control regularization term have been given in Casas 2012 ; Christof & Wachsmuth 2018 ; Wachsmuth & Wachsmuth 2022 . A-priori error estimates for a variational discretization where given in Deckelnick & Hinze 2012 , while Fuica 2025 ; Fuica & Jork 2025 derived a-posteriori error estimates. Finally, we mention that second-order derivatives of the functional \lVert\cdot\rVert_{L^{1}(\Omega)} on H_{0}^{1}(\Omega) have been analyzed in Christof 2018 ; Christof & Meyer 2019 , which is related to our work, since the signum function can be seen as the first derivative of \lVert\cdot\rVert_{L^{1}(\Omega)} . Let us report on existing approaches to solve bang-bang control problems. Due to their simplicity, projected gradient Hinze et al. 2009 , Section 2.2.2 and conditional gradient methods Kunisch & Walter 2024 can be applied. Frequently, fixed point methods are used to compute bang-bang controls Deckelnick & Hinze 2012 ; Fuica 2025 ; Fuica & Jork 2025 ; Daniels & Hinze 2020 . With the help of the results of this paper, the convergence of fixed-point methods can be explained, see Remark 4.5 below. For controls that only depend on time, switching point optimization methods can be used Glashoff & Sachs, 1977/78 1977/78 ; Eppler & Tr\"oltzsch 1986 . Control problems for ordinary differential equations are amenable to the Goh transform and the transformed system can be solved by Newton’s method Felgenhauer 2016 . Another popular approach is to apply Tikhonov regularization Daniels 2018 ; Wachsmuth & Wachsmuth 2011 . 2 Preliminaries We use standard notation. We denote by \lambda the Lebesgue measure on \mathbb{R}^{d} and by \mathcal{H}^{d-1} the (d-1) -dimensional Hausdorff measure. For an open set \Omega\subset\mathbb{R}^{d} , the vector space of all continuous (continuously differentiable) functions from \Omega to \mathbb{R} is denoted by C(\Omega) ( C^{1}(\Omega) ). Lebesgue and Sobolev spaces are denoted by L^{p}(\Omega) and W^{k,p}(\Omega) . An index “ c ” at a function space indicates subspaces of functions with compact support. We define \operatorname{sign}\colon\mathbb{R}\to\mathbb{R} and \operatorname{Sign}\colon\mathbb{R}\rightrightarrows\mathbb{R} via \operatorname{sign}(x):=\begin{cases}-1&\text{if }x<0,\\ 0&\text{if }x=0,\\ 1&\text{if }x>0,\end{cases}\qquad\operatorname{Sign}(x):=\begin{cases}\{-1\}&\text{if }x<0,\\ [-1,1]&\text{if }x=0,\\ \{1\}&\text{if }x>0.\end{cases} We mention that open and closed balls with radius r>0 and center x (in a metric space) are denoted by U_{r}(x) and B_{r}(x) , respectively. 2.1 Weak differentiability of the signum function We want to show that \operatorname{sign} is directionally differentiable (in a weak sense) at certain points in C^{1}(\Omega) w.r.t. directions having compact support. First, we recall the differentiability result from Wachsmuth & Wachsmuth 2022 , Theorem 3.4 . Theorem 2.1 . Let U\subset\mathbb{R}^{d} be a bounded open set. Let w\in C^{1}(U) be given such that \nabla w\neq 0 on \{w=0\} . Further, let z\in C_{c}(U) be given. For all t>0 , we define U_{t}:=\{\operatorname{sign}(w)\neq\operatorname{sign}(w+tz)\} . Then, for all \psi\in C(U) we have \displaystyle\frac{1}{t}\int_{U_{t}}\psi\mathop{}\!\mathrm{d}\lambda \displaystyle\to\int_{\{w=0\}}\frac{\psi\lvert z\rvert}{\lvert\nabla w\rvert}\mathop{}\!\mathrm{d}\mathcal{H}^{d-1}, (2.1a) \displaystyle\frac{1}{t}\int_{U_{t}}\psi\operatorname{sign}(z)\mathop{}\!\mathrm{d}\lambda \displaystyle\to\int_{\{w=0\}}\frac{\psi z}{\lvert\nabla w\rvert}\mathop{}\!\mathrm{d}\mathcal{H}^{d-1} (2.1b) as t\searrow 0 . This result can be used to obtain a weak form of differentiability of the signum function w.r.t. directions z with compact support. Corollary 2.2 . Let U\subset\mathbb{R}^{d} be a bounded open set. Let w\in C^{1}(U) be given such that \nabla w\neq 0 on \{w=0\} . Further, let z\in C^{1}_{c}(U) and \psi\in C(U) be given. Then, \displaystyle\int_{U}\frac{\operatorname{sign}(w+tz)-\operatorname{sign}(w)}{t}\psi\mathop{}\!\mathrm{d}\lambda \displaystyle\to 2\int_{\{w=0\}}\frac{\psi z}{\lvert\nabla w\rvert}\mathop{}\!\mathrm{d}\mathcal{H}^{d-1}, (2.2a) \displaystyle\int_{U}\frac{\lvert\operatorname{sign}(w+tz)-\operatorname{sign}(w)\rvert}{t}\psi\mathop{}\!\mathrm{d}\lambda \displaystyle\to 2\int_{\{w=0\}}\frac{\psi\lvert z\rvert}{\lvert\nabla w\rvert}\mathop{}\!\mathrm{d}\mathcal{H}^{d-1} (2.2b) as t\searrow 0 . Proof. Combining \nabla w\neq 0 on \{w=0\} with Stampacchia’s lemma, we get \nabla w=0 a.e. on \{w=0\} . Thus, \lambda(\{w=0\})=0 . Further, the compactness of the support of z ensures that \nabla(w+tz)\neq 0 on \{w+tz=0\} whenever t is small enough. Consequently, \lambda(\{w+tz=0\})=0 . This implies that \operatorname{sign}(w+tz)-\operatorname{sign}(w)=2\chi_{U_{t}}\operatorname{sign}(z)\qquad\text{$\lambda$-a.e.\ on $\Omega$}, where U_{t} is defined as in Theorem 2.1 . Thus, the claim follows from \Hy@safe@activestrue ?? \Hy@safe@activesfalse . ∎ 2.2 Extension of C^{1} functions In this section, we recall Whitney’s extension theorem. We start with some definitions, see also Fefferman 2007 , Section 2 . Definition 2.3 . Let d\in\mathbb{N} be given. We define the function space C_{\mathrm{b}}^{1}(\mathbb{R}^{d}):=\left\{f\in C^{1}(\mathbb{R}^{d})\nonscript\;\middle|\nonscript\;\mathopen{}\text{$f$ and $\nabla f$ are bounded}\right\} equipped with the usual supremum norm \lVert f\rVert_{C_{\mathrm{b}}^{1}(\mathbb{R}^{d})}:=\sup\left\{\lvert\partial^{\alpha}f(x)\rvert\nonscript\;\middle|\nonscript\;\mathopen{}\lvert\alpha\rvert\leq 1,x\in\mathbb{R}^{d}\right\}<\infty\qquad\forall f\in C_{\mathrm{b}}^{1}(\mathbb{R}^{d}). Let \Omega\subset\mathbb{R}^{d} be open and bounded. We define C^{1}(\bar{\Omega}):=\{f\in C^{1}(\Omega)\nonscript\;|\nonscript\;\mathopen{}\partial^{\alpha}f\text{ uniformly continuous }\forall\lvert\alpha\rvert\leq 1\} with norm \lVert f\rVert_{C^{1}(\bar{\Omega})}:=\sup\left\{\lvert\partial^{\alpha}f(x)\rvert\nonscript\;\middle|\nonscript\;\mathopen{}\lvert\alpha\rvert\leq 1,x\in\Omega\right\}<\infty\qquad\forall f\in C^{1}(\bar{\Omega}). For f\in C^{1}(\bar{\Omega}) we denote the uniquely determined continuous extensions of f\colon\Omega\to\mathbb{R} and \nabla f\colon\Omega\to\mathbb{R}^{d} to \bar{\Omega} also by f\colon\bar{\Omega}\to\mathbb{R} and \nabla f\colon\bar{\Omega}\to\mathbb{R}^{d} , respectively. Finally, for a compact set K\subset\mathbb{R}^{d} , we define C_{\mathrm{jet}}^{1}(K) as the set of all families (P^{x})_{x\in K} of affine functions P^{x}\colon\mathbb{R}^{d}\to\mathbb{R} satisfying (i) For all \varepsilon>0 there exists \delta>0 such that \lvert P^{x}(y)-P^{y}(y)\rvert\leq\varepsilon\lvert x-y\rvert\qquad\text{and}\qquad\lvert\partial_{i}P^{x}(y)-\partial_{i}P^{y}(y)\rvert\leq\varepsilon holds for all i\in\{1,\ldots,d\} and all x,y\in K with \lvert x-y\rvert<\delta . (ii) There exists a constant M\geq 0 such that \displaystyle\lvert P^{x}(x)\rvert \displaystyle\leq M, \displaystyle\lvert\partial_{i}P^{x}(x)\rvert \displaystyle\leq M, \displaystyle\lvert P^{x}(y)-P^{y}(y)\rvert \displaystyle\leq M\lvert x-y\rvert,\qquad\text{and} \displaystyle\lvert\partial_{i}P^{x}(y)-\partial_{i}P^{y}(y)\rvert \displaystyle\leq M holds for all i\in\{1,\ldots,d\} and all x,y\in K . The norm \lVert(P^{x})_{x\in K}\rVert_{C_{\mathrm{jet}}^{1}(K)} is defined to be the smallest constant M satisfying these inequalities. Definition 2.4 . We say that a set \Omega\subset\mathbb{R}^{d} is uniformly locally quasiconvex with constants r>0 and L\geq 1 if for any x,y\in\Omega with \lvert y-x\rvert\leq r there exists a Lipschitz continuous curve \gamma\in C^{0,1}([0,1];\Omega) with \gamma(0)=x , \gamma(1)=y and Lipschitz constant at most L\lvert y-x\rvert . We recall the following result from Wachsmuth & Walter 2024 , Lemma 5.3 . Lemma 2.5 . Let \Omega\subset\mathbb{R}^{d} be open and bounded. Further, we require that \Omega is a Lipschitz set in the sense that for every point p\in\partial\Omega , there exists r>0 and a bijection l_{p}\colon B_{r}(p)\to B_{1}(0) such that l_{p} and l_{p}^{-1} are Lipschitz, l_{p}(\Omega\cap B_{r}(p))=\{z\in B_{1}(0)\nonscript\;|\nonscript\;\mathopen{}z_{n}>0\},\quad\text{and}\quad l_{p}(\partial\Omega\cap B_{r}(p))=\{z\in B_{1}(0)\nonscript\;|\nonscript\;\mathopen{}z_{n}=0\}. Then, \Omega is uniformly locally quasiconvex. As a further

Read the complete text