A Guaranteed-Stable Neural Network Approach for Optimal Control of Nonlinear Systems

Anran Li, John P. Swensen, Mehdi Hosseinzadeh · 2025

Read A Guaranteed-Stable Neural Network Approach for Optimal Control of Nonlinear Systems by Anran Li, John P. Swensen, Mehdi Hosseinzadeh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17333.txt.

Introduction

Anran Li, John Swensen, and Mehdi Hosseinzadeh built in 2025 a neural method for steering nonlinear systems that carries a proof of stability. A standard approach re-linearizes the system and solves a fresh optimization at each instant, which is too slow for small computers. A neural network can copy that scheme, but keeping the loop stable forces changes that make the training data hard to generate.

Their neural optimization machine turns the hard optimization into a training problem itself. Proofs show that a network trained this way keeps all signals bounded and drives the system toward the target, within a gap the user can tune. Simulations and lab tests back the claims. The method targets robots and machines with modest onboard computing.

Catalog record

CREATORAnran Li, John P. Swensen, Mehdi Hosseinzadeh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-17333

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Guaranteed-Stable Neural Network Approach for Optimal Control of Nonlinear Systems Anran Li, John P. Swensen, Mehdi Hosseinzadeh Abstract A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online optimization, it can be computationally expensive, and thus unrealistic for systems with limited computing resources. One potential solution to this issue is to incorporate a Neural Network (NN) into the control loop to emulate the behavior of the optimal control scheme. Ensuring stability and reference tracking in the resulting NN-based closed-loop system requires modifications to the primary optimization problem. These modifications often introduce non-convexity and nonlinearity with respect to the decision variables, which may surpass the capabilities of existing solvers and complicate the generation of the training dataset. To address this issue, this paper develops a Neural Optimization Machine (NOM) to solve the resulting optimization problems. The central concept of a NOM is to transform the optimization challenges into the problem of training a NN. Rigorous proofs demonstrate that when a NN trained on data generated by the NOM is used in the control loop, all signals remain bounded and the system states asymptotically converge to a neighborhood around the desired equilibrium point, with a tunable proximity threshold. Simulation and experimental studies are provided to illustrate the effectiveness of the proposed methodology. I Introduction Nonlinear systems are a common and significant aspect of real-world control problems. Achieving control objectives in nonlinear systems requires sophisticated control strategies that can accurately capture and manage the nonlinearities inherent in these systems. One possible approach to deal with nonlinear systems is to use nonlinear control techniques (see, e.g., [ 1 , 2 , 3 , 4 ] ); however, guaranteeing stability at all operating points with nonlinear control techniques can be challenging [ 5 , 6 ] . Another approach is to, first, use an appropriate linearization technique (see, e.g, [ 1 , 7 ] ) to linearize the system, and then utilize well-established theories on linear control system (see, e.g., [ 8 , 9 ] ). A different approach is to linearize the nonlinear system at each time instant, compute the control input for the linearized system, and repeat this procedure at the next time instant; examples are iterative Linear Quadratic Regulator (LQR) [ 10 , 11 , 12 ] and nonlinear Model Predictive Control (MPC) [ 13 , 14 , 15 ] . Despite being promising, this approach requires computational capabilities that may not be realistic for systems with limited computational resources. One possible approach to address this challenge is to use Neural Networks (NN) in the control loop and in combination with Lyapunov theory to ensure stability of the resulting closed-loop system. In this context, [ 16 ] proposes combining an LQR with an online NN model to stabilize nonlinear systems, although it does not provide stability guarantees. A NN-based controller which provides a Lyapunov function for stability is presented in [ 17 ] , without addressing control objectives and performance metrics. A stabilizing NN-based control law for personal aerial vehicles has been developed in [ 18 , 19 ] , without providing stability guarantees with the developed NN in the loop. Optimization-based projection layers have been integrated into a NN-based policy in [ 20 ] ; this method improves robustness and performance of the system, however it is limited to linear systems. A NN-based adaptive control has been developed in [ 21 , 22 ] , without providing stability and convergence proofs. A NN-based Lyapunov-induced control law is presented in [ 23 ] ; this method stops as soon as one feasible control Lyapunov function is detected, and thus it may lead to a poor performance. To the best of our knowledge, the above-mentioned efforts on NN-based control lacks theoretical guarantees for stability and performance. Recently, the authors have developed a provably-stable NN-based control method in [ 24 ] , where the NN is trained to imitate the behavior of a one-step-ahead predictive control policy, and, despite prior work, provides strong guarantees for stability and tracking performance. Experimental results and theoretical analysis reported in [ 24 ] indicate a potential path for controlling a wide range of nonlinear control systems. However, its implementation can be challenging, as the training dataset should be generated by solving a nonlinear, non-convex optimization problem for every operating point, while existing solvers may not be able to solve the corresponding optimization problem. To address this issue, we develop a Neural Optimization Machine (NOM) [ 25 , 26 ] to solve the corresponding optimization problem, which uses the NN’s built-in backpropagation algorithm to convert the problem of solving an optimization problem into the training problem. This paper analytically investigates stability and tracking properties of the closed-loop system when the NN trained on data generated by the NOM is used in the control loop. The key contributions of this paper are: i) developing a NOM to solve the non-convex, nonlinear optimization problem detailed in [ 24 ] ; ii) developing a NN-based control scheme based on the NOM-generated dataset, and analytically proving its stability and convergence properties; and iii) evaluating the effectiveness of the proposed methodology through simulation and experimental studies. Notation: We denote the set of real numbers by \mathbb{R} , the set of positive real numbers by \mathbb{R}_{>0} , and the set of non-negative real numbers by \mathbb{R}_{\geq 0} . For the matrix A , A\succ 0 indicates that A is positive definite, and A\succeq 0 indicates that A is positive semi-definite. We denote the transpose of matrix A by A^{\top} . We use \lambda_{\max}(A) and \lambda_{\min}(A) to indicate the largest and smallest eigenvalue of A , respectively. Given x\in\mathbb{R}^{n} and Q\in\mathbb{R}^{n\times n} , \left\|x\right\|_{Q}=\sqrt{\left|x^{\top}Qx\right|} . For a function Y(x) , Y(x)|_{x=x^{\dagger}} indicates that the function Y(x) is evaluated at x=x^{\dagger} . We use \odot to indicate Hadamard product. We use \star to represent matrix elements that can be interpreted from the matrix structure. The mark \ast is used to indicate optimality. We use \text{diag}\{a_{1},a_{2},\cdots,a_{n}\} to denote a n\times n matrix with diagonal entries a_{1},a_{2},\cdots,a_{n}\in\mathbb{R} . II Problem Statement Problem Setting: Consider the following discrete-time affine nonlinear system: \displaystyle x(t+1)= \displaystyle f\left(x(t)\right)+g\left(x(t)\right)u(t), (1a) \displaystyle y(t)= \displaystyle h\left(x(t),u(t)\right), (1b) where x(t)=[x_{1}(t)~\cdots~x_{n}(t)]^{\top}\in\mathbb{R}^{n} is the state vector at time instant t , u(t)=[u_{1}(t)~\cdots~u_{q}(t)]^{\top}\in\mathbb{R}^{q} is the control input at time instant t , y(t)=[y_{1}(t)~\cdots~y_{m}(t)]^{\top}\in\mathbb{R}^{m} is the output vector at time instant t , and f:\mathbb{R}^{n}\rightarrow\mathbb{R}^{n} , g:\mathbb{R}^{n}\rightarrow\mathbb{R}^{n\times q} , and h:\mathbb{R}^{n}\times\mathbb{R}^{q}\rightarrow\mathbb{R}^{m} are known nonlinear functions. Let \mathcal{X}\subset\mathbb{R}^{n} be the operating region of the system 1 1 1 This paper does not aim at enforcing the operating region as a constraint. Future work will discuss how to extend the proposed methodology to enforce state and input constraints. . We assume that the linearized system inside the operating region \mathcal{X} is stabilizable; that is, the pair (A,B) is stabilizable, where A=\frac{\partial f(x)}{\partial x} and B=g(x) for any x\in\mathcal{X} . We also assume that g(x) is \mu_{g} Lipschitz continuous throughout \mathcal{X} . For any given desired reference r\in\mathbb{R}^{m} , we denote the corresponding steady state and input by \bar{x}_{r} and \bar{u}_{r} , respectively; that is, \displaystyle\bar{x}_{r}=f\left(\bar{x}_{r}\right)+g\left(\bar{x}_{r}\right)\bar{u}_{r},~~r=h\left(\bar{x}_{r},\bar{u}_{r}\right). (2) The

Read the complete text