Modified projected Gauss-Newton method for constrained nonlinear least-squares: application to power flow analysis
Yassine Nabou, Lucian Toma, Ion Necoara · 2025
Read Modified projected Gauss-Newton method for constrained nonlinear least-squares: application to power flow analysis by Yassine Nabou, Lucian Toma, Ion Necoara (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00783.txt.
Introduction
Power flow analysis gets a faster solver from Yassine Nabou, Lucian Toma, and Ion Necoara in a 2025 paper. The solver is a modified projected Gauss-Newton method for constrained nonlinear least-squares problems. Functional constraints are assumed smooth, while the other constraints form a simple closed convex set, which matches the structure of many engineering problems in practice.
The problem is cast with the Euclidean norm as a merit function. At each step, the method linearizes the functional constraints inside that function and adds a quadratic regularization. That yields a strongly convex subproblem that is easy to solve, and its solution is the next iterate. Global convergence guarantees are proved under mild assumptions, with rates under a further property. Tests use several IEEE bus cases.
Catalog record
| CREATOR | Yassine Nabou, Lucian Toma, Ion Necoara |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modified projected Gauss-Newton method for constrained nonlinear least-squares: application to power flow analysis Yassine Nabou, Lucian Toma, Ion Necoara Abstract In this paper, we consider a modified projected Gauss-Newton method for solving constrained nonlinear least-squares problems. We assume that the functional constraints are smooth and the the other constraints are represented by a simple closed convex set. We formulate the nonlinear least-squares problem as an optimization problem using the Euclidean norm as a merit function. In our method, at each iteration we linearize the functional constraints inside the merit function at the current point and add a quadratic regularization, yielding a strongly convex subproblem that is easy to solve, whose solution is the next iterate. We present global convergence guarantees for the proposed method under mild assumptions. In particular, we prove stationary point convergence guarantees and under Kurdyka-Lojasiewicz (KL) property for the objective function we derive convergence rates depending on the KL parameter. Finally, we show the efficiency of this method on the power flow analysis problem using several IEEE bus test cases. I INTRODUCTION In many areas of engineering, such as maximum likelihood estimations, non-linear data fitting, parameter estimation or power flow analysis, one finds applications that can be recast as nonlinear least-squares problems of the form [ 11 , 8 , 6 ] : \displaystyle\min\|F(x)\| (1) \displaystyle s.t.\;x\in\mathbf{C}\subseteq\mathbb{R}^{n}, where \mathbf{C} is a closed convex set and F=(F_{1},\cdots,F_{m}) , F_{i}:\mathbb{R}^{n}\to\mathbb{R} for i=1:m , are nonlinear differentiable functions. When \mathbf{C}=\mathbb{R}^{n} and m=n , problem ( 1 ) is equivalent to a squared system of nonlinear equations. Hence several algorithms were proposed for solving this problem, among these algorithms the most popular is Newton-Raphson method (NR) [ 22 ] . In Newton-Raphson method one uses the inverse of the Jacobian matrix in order to update the iterations, i.e., the iterations are of the following form: \displaystyle x^{+}=x-\nabla F(x)^{-1}F(x), where x is the current iteration and \nabla F(x) is the Jacobian matrix of F(x) . Although NR has fast convergence, it has several drawbacks. First of all, it can happen that at current test point the Jacobian is degenerate; in this case the method is not well-defined. Secondly, this convergence is not guaranteed when the initial point x_{0} is far from the optimum [ 13 ] . Many approaches have been proposed in order to deal with these challenges, e.g., improving the starting point [ 3 ] , or using different approximations for the Jacobian [ 4 , 1 ] . In [ 17 ] , Nesterov proposed a modified Gauss-Newton scheme (M-GN) for solving unconstrained nonlinear least-squares problems. The M-GN method constructs a convex model by linearizing the nonlinear function F inside a sharp merit function and adding a quadratic regularization term, i.e.: \displaystyle x^{+}=\arg\min\limits_{y\in\mathbb{R}^{n}}\|F(x)+\nabla F(x)(y-x)\|+\frac{M}{2}\|y-x\|^{2}. When M=0 , we recover the NR method described above. In [ 17 ] it was proved that, under a nondegenerate assumption (i.e., \sigma_{\text{min}}(\nabla F(x))>0 for all x in the level set of \|F(x_{0})\| , where x_{0} is the starting point and \sigma_{\text{min}} denotes the smallest singular value), this scheme has global convergence. Moreover, the solution of each subproblem can be computed with a standard convex optimization solver. Further, problem ( 1 ) is equivalent to the following composite optimization problem: \displaystyle\min\limits_{x\in\mathbb{R}^{n}}\|F(x)\|^{2}+{\color[rgb]{0,0,0}I}_{\mathbf{C}}(x), (2) where I_{\mathbf{C}} is the indicator function of the convex set \mathbf{C} . Note that using only the norm \|\cdot\| as the merit function is beneficial than using \|\cdot\|^{2} , since in the latest case the condition number is doubled. Another possible algorithm for solving this problem is the Projected Gradient Descent (PGD) [ 18 , 9 , 20 , 21 ] . The standard PGD algorithm is given by: \displaystyle x^{+}=\Pi_{\mathbf{C}}\left(x-\alpha\nabla F(x)F(x)\right), where \Pi_{\mathbf{C}} is the projection operator (see Section II ) and \alpha is a step size. PGD descent is a simple method easy to implement, but the main drawback is that it has slow convergence. A natural questions arises whether we can prove global convergence of MG-N method without assuming the nondegeneracy assumption on the Jacobian \nabla F(x) , i.e., without assuming \sigma_{\text{min}}(\nabla F(x))>0 for all x in the level set of \|F(x_{0})\| (see ( 5 )). Such a condition is conservative and it is not always satisfied in practice. In this paper we answer positively to this question, i.e., we consider a Modified Projected Gauss-Newton method (MPG-N) for solving problem ( 1 ), where \mathbf{C} is a simple closed convex set. At each iteration, MPG-N aims to solve the following strongly convex subproblem: \displaystyle x_{k+1}\!=\!\arg\min\limits_{x\in\mathbf{C}}\|F(x_{k})\!+\!\nabla F(x_{k})(x\!-\!x_{k})\|\!+\!\frac{M}{2}\|x-x_{k}\|^{2}, (3) which is a slightly modified version of [ 17 ] as it considers constraints x\in\mathbf{C} . We prove, under mild assumptions, that this scheme can achieve global convergence without any assumption on the Jacobian matrix. More precisely, we prove that any limit point of the sequence generated by MPG-N is a stationary point and under the Kurdyka-Lojasiewicz (KL) property, we derive convergence rates in function value depending on the KL parameter. Finally, we consider solving a power flow analysis problem, with functional constraints which do not usually satisfy the non-degenerate assumption, while it satisfies the KL property. We compare the performance of such a scheme with the projected gradient scheme and demonstrate its efficiency of the proposed method on several IEEE bus test cases. Content . The rest of the paper is organized as follows: Section II provides some notations and preliminaries, Section III presents the new algorithm and the convergence results, Section IV describes the power flow analysis problem and numerical results on several IEEE bus test cases. II Notations and preliminaries We denote a finite-dimensional real vector space with \mathbb{E} and by \mathbb{E}^{*} its dual space composed of linear functions on \mathbb{E} . Using a self-adjoint positive-definite operator D:\mathbb{E}\rightarrow\mathbb{E}^{*} (notation D=D^{*}\succ 0 ), we can endow these spaces with conjugate Euclidean norms: \displaystyle\lVert x\rVert=\langle Dx,x\rangle{{}^{\frac{1}{2}}},\quad x\in\mathbb{E},\qquad\lVert g\rVert_{*}=\langle g,D^{-1}g\rangle^{\frac{1}{2}},\quad g\in\mathbb{E}^{*}. For simplicity, we consider in the following \mathbb{E}=\mathbb{R}^{n} and D is the identity matrix. Let F=(F_{1},\cdots,F_{m}) , where F_{i} ’s, i=1:m , are differentiable functions and the Jacobian is Lipschitz continuous, i.e.: \displaystyle\|\nabla F(x)-\nabla F(y)\|\leq L_{F}\|x-y\|\;\;\forall x,y\in\mathbb{R}^{n}. It follows that [ 17 ] : \displaystyle\|F(x)\|\!\!-\!\!\|F(y)\!+\!\nabla F(y)(x\!\!-\!\!y)\|\leq\frac{L_{F}}{2}\|x\!\!-\!\!y\|^{2}\;\;\forall x,y\!\in\!\mathbb{R}^{n}. (4) Let h be proper lower semicontinuous function and \mu>0 . Then, the proximal operator with respect to h is: \displaystyle\text{prox}_{\mu h}(x)=\arg\min_{y}h(y)+\frac{\mu}{2}\|y-x\|^{2}, and the Moreau envelop is defined as: \displaystyle h_{\mu}(x)=\min_{y}\;h(y)+\frac{\mu}{2}\|y-x\|^{2}. When h is the indicator function of a convex set C , I_{C} , then the proximal operator is the projection: \displaystyle\text{prox}_{\mu{\color[rgb]{0,0,0}I}_{\mathbf{C}}}(x) \displaystyle=\Pi_{\textbf{C}}(x)=\arg\min_{y\in C}\|y-x\|^{2}. We say that h is \mu -weakly convex if the function x\mapsto h(x)+\frac{\mu}{2}\|x\|^{2} is convex. The level set of h at x_{0} is defined: \displaystyle\mathcal{L}(h(x_{0})):=\{x\in\mathbb{R}^{n}:h(x)\leq h(x_{0})\}. (5) Next, we provide few definitions and properties concerning subdifferential calculs (see also [ 14 , 19 ] ). Definition 1 (Subdifferential): Let f:\mathbb{R}^{n}\to\bar{\mathbb{R}} be a proper lower semicontinuous function. For a given x\in\text{dom}\;f , the Frechet subdifferential of f at x , written \widehat{\partial}f(x) , is the set of all vectors g_{x}\in\mathbb{R}^{n} satisfying: \lim\limits_{x\neq y,y\to x}\frac{f(y)-f(x)-\langle g_{x},y-x\rangle}{\lVert x-y\rVert}\geq 0. When x\notin\text{dom}\;f , we set \widehat{\partial}f(x)=\emptyset . The limiting-subdifferential, or simply the subdifferential, of f at x\in\text{dom}\,f , written \partial f(x) , is defined through the following closure process [ 14 ] : \displaystyle\partial f(x):= \displaystyle\left\{g_{x}\in\mathbb{E}^{*}\!\!:\exists x^{k}\to x\;\text{with}\;f(x^{k})\to f(x)\;\right. \displaystyle\quad\left.\text{and}\;\exists g_{x}^{k}\in\widehat{\partial}f(x^{k})\;\;\text{with}\;\;g_{x}^{k}\to g_{x}\right\}. Note