A Quadratic Control Framework for Dynamic Systems

Igor Ladnik · 2025

Read A Quadratic Control Framework for Dynamic Systems by Igor Ladnik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15396.txt.

Introduction

Igor Ladnik presents a unified quadratic control framework for dynamic systems in this 2025 paper. The goal is to keep a system's states and inputs close to set target paths. A quadratic cost counts each deviation, so large errors weigh far more.

For linear systems, the classic regulator solution comes from dynamic programming. It yields step-by-step feedback and feedforward terms. For nonlinear systems, an iterative version linearizes the model again and again. Each round solves a simpler problem until the plan settles. A software set puts the method into practice. Engineers can use it for tracking tasks in robots, vehicles, and process plants. Worked examples show each step on real dynamic systems.

Catalog record

CREATORIgor Ladnik
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15396

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Quadratic Control Framework for Dynamic Systems Igor Ladnik Abstract This article presents a unified approach to quadratic optimal control for both linear and nonlinear discrete-time systems, with a focus on trajectory tracking. The control strategy is based on minimizing a quadratic cost function that penalizes deviations of system states and control inputs from their desired trajectories. For linear systems, the classical Linear Quadratic Regulator (LQR) solution is derived using dynamic programming, resulting in recursive equations for feedback and feedforward terms. For nonlinear dynamics, the Iterative Linear Quadratic Regulator (iLQR) method is employed, which iteratively linearizes the system and solves a sequence of LQR problems to converge to an optimal policy. To implement this approach, a software service was developed and tested on several canonical models, including: Rayleigh oscillator, inverted pendulum on a moving cart, two-link manipulator, and quadcopter. The results confirm that iLQR enables efficient and accurate trajectory tracking in the presence of nonlinearities. To further enhance performance, it can be seamlessly integrated with Model Predictive Control (MPC), enabling online adaptation and improved robustness to constraints and system uncertainties. 1 Introduction Quadratic optimal control remains one of the most fundamental and practically significant problems in control theory, with wide-ranging applications from robotics and aerospace systems to economics and biological motion modeling. Classical Linear Quadratic Regulator (LQR) theory provides an elegant closed-form solution for optimal control in linear systems with quadratic cost, offering both efficiency and robustness. However, many real-world systems exhibit nonlinear dynamics, rendering direct application of LQR ineffective. To address this, the iterative Linear Quadratic Regulator (iLQR) [ 1 ] method extends LQR to nonlinear domains through a sequence of linearizations and optimizations. This iterative approach preserves the computational efficiency of LQR while offering improved performance in nonlinear settings. This article presents a unified treatment of both LQR and iLQR within a discrete-time trajectory tracking framework. The cost function is expressed relative to desired trajectories for both states and controls. The resulting method is applicable to a wide range of practical systems and is demonstrated through detailed simulations of Rayleigh oscillator, an inverted pendulum on a moving cart, a two-link robotic manipulator and a quadcopter stabilization problem. In addition, the iLQR method can be efficiently combined with Model Predictive Control (MPC). MPC is an advanced control technique that solves a finite-horizon optimization problem at each time step using the current system state as the initial condition. By integrating iLQR into the MPC framework, one can rapidly compute optimal control sequences for nonlinear systems while continuously updating the control policy based on real-time feedback. This hybrid iLQR–MPC scheme is particularly advantageous for systems with constraints, disturbances, or time-varying dynamics, where both predictive adaptation and computational tractability are critical. 2 Problem Statement We begin by formulating the optimal control problem for a nonlinear dynamical system governed by the differential equation: \dot{x}(t)=f(t,x(t),u(t)),\qquad t\in[0,T], (2.1) where x(t)\in\mathbb{R}^{n} is the system state, and u(t)\in\mathbb{R}^{m} is the control input (Figure 1 ). Figure 1 : Open-loop control system. Our objective is to minimize the following quadratic cost function: \displaystyle J(u)=\int_{0}^{T}\Big[ \displaystyle(\hat{x}(t)-x(t))^{\top}Q(t)(\hat{x}(t)-x(t))+(\hat{u}(t)-u(t))^{\top}R(t)(\hat{u}(t)-u(t))\Big]dt, (2.2) where \hat{x}(t) and \hat{u}(t) denote the desired state and control trajectories. The matrices Q(t) and R(t) are symmetric and time-dependent, with Q(t) positive semi-definite and R(t) positive definite. This formulation corresponds to a standard trajectory tracking problem , commonly encountered in control theory. The goal is to determine an optimal control input u(t) such that the system follows the desired trajectories as closely as possible while minimizing the cost. In the following sections, we first examine the linear case, deriving the optimal solution using dynamic programming in discrete time. We then extend this approach to nonlinear systems using an iterative linearization technique, corresponding to the iLQR method [ 1 ] . 3 Linear Case First, we consider a linear dynamic system governed by the well-known differential equation: \dot{x}(t)=\bar{A}(t)\,x(t)+\bar{B}(t)\,u(t) where x(t) is the state vector, u(t) is the control input, and \bar{A}(t) and \bar{B}(t) are the system and input matrices, respectively. In discrete form, this equation can be approximated as: x_{k+1}=A_{k}\,x_{k}+B_{k}\,u_{k} (3.1) with the discrete-time matrices A_{k} and B_{k} defined by: \begin{split}A_{k}&\approx I+\bar{A}(k\Delta t)\,\Delta t\\ B_{k}&\approx\bar{B}(k\Delta t)\,\Delta t\end{split} where I is the identity matrix and \Delta t is the discretization time step. Suppose that \hat{x}_{0}=x_{0} . Then the discretization of the cost function ( 2.2 ) can be presented with the following expression J_{N}(u)=\sum_{k=0}^{N-1}[(\hat{x}_{k+1}-x_{k+1})^{\top}Q_{k}(\hat{x}_{k+1}-x_{k+1})+(\hat{u}_{k}-u_{k})^{\top}R_{k}(\hat{u}_{k}-u_{k})] (3.2) Let’s denote minimum of J_{N}(u) as m_{N}(x_{0})=\min_{(u_{0},u_{1},...,u_{N-1})}J_{N}(u) and the minimum of the cost function on the last N-(k+1) steps of the process is m_{N-(k+1)}(x_{k+1}) . Consider the k -th step of the process. Assuming that the control over the last N-(k+1) steps is optimal, and applying Bellman’s principle of optimality, the following relation is obtained: \begin{split} m_{N-k}(x_{k})=\min_{u_{k}}\big[(\hat{x}_{k+1}-x_{k+1})^{\top}Q_{k}(\hat{x}_{k+1}-x_{k+1})+(\hat{u}_{k}-u_{k})^{\top}R_{k}(\hat{u}_{k}-u_{k})+m_{N-(k+1)}(x_{k+1})\big]\end{split} (3.3) where k=0,1,2,...,N-1 . At k=N , we have m_{0}(x_{N})=0 . Let’s assume that m_{N-k}(x_{k}) can be presented as m_{N-k}(x_{k})=x_{k}^{\top}P_{N-k}x_{k}-2v_{N-k}^{\top}x_{k}+a_{N-k} (3.4) where P is symmetric positively semi-defined matrix, v is vector and a is a value independent on x . Replacing in ( 3.3 ) m_{N-(k+1)}(x_{k+1}) with expression ( 3.4 ) for (k+1) -th step, getting \begin{split} m_{N-k}(x_{k})=\min_{u_{k}}\big[&(\hat{x}_{k+1}-x_{k+1})^{\top}Q_{k}(\hat{x}_{k+1}-x_{k+1})+(\hat{u}_{k}-u_{k})^{\top}R_{k}(\hat{u}_{k}-u_{k})+\\ &x_{k+1}^{\top}P_{N-(k+1)}x_{k+1}-2v_{N-(k+1)}^{\top}x_{k+1}+a_{N-(k+1)}\big]\end{split} (3.5) The control sequence u_{k} is determined by substituting the expression for x_{k+1} from equation ( 3.1 ) into equation ( 3.5 ), and setting to zero the partial derivative with respect to u_{k} of the expression in square brackets in ( 3.5 ). u_{k}=c_{N-k}-F_{N-k}x_{k} (3.6) where \begin{split} &W_{N-k}=B_{k}^{\top}(Q_{k}+P_{N-(k+1)})B_{k}+R_{k}\\[4.30554pt] &c_{N-k}=W_{N-k}^{-1}\left[B_{k}^{\top}(Q_{k}\hat{x}_{k+1}+v_{N-(k+1)})+R_{k}\hat{u}_{k}\right]\\[4.30554pt] &F_{N-k}=W_{N-k}^{-1}\left[B_{k}^{\top}(Q_{k}+P_{N-(k+1)})A_{k}\right]\end{split} (3.7) If matrix W is near-singular, then a product of the regularization parameter (as in Levenberg–Marquardt regularization) and the identity matrix may be added to it. Substituting ( 3.6 ), ( 3.7 ) and ( 3.1 ) into ( 3.5 ), an expression for m_{N-k}(x_{k}) is derived in the form corresponding to ( 3.4 ), where \begin{split}&Z_{k}=A_{k}-B_{k}F_{N-k}\\[4.30554pt] &P_{N-k}=Z_{k}^{\top}(Q_{k}+P_{N-(k+1)})Z_{k}+F^{\top}_{N-k}R_{k}F_{N-k}\\[4.30554pt] &v_{N-k}=Z_{k}^{\top}(Q_{k}\hat{x}_{k+1}+v_{N-(k+1)}-(Q_{k}+P_{N-(k+1)})B_{k}c_{N-k})+F_{N-k}^{\top}R_{k}(c_{N-k}-\hat{u}_{k})\end{split} (3.8) Expressions ( 3.6 )–( 3.8 ) define the optimal control of the open-loop system u_{k} , as illustrated in Figure 2 , where c_{N-k} represents the control vector of the closed-loop system, and F_{N-k} is the feedback gain matrix applied to all coordinates of the state vector. Both of these parameters are generally time-dependent. Figure 2 : Closed-loop control system. Theoretically, different combinations of c_{N-k} and F_{N-k} can yield the same values of u_{k} in equation ( 3.6 ). However, such variations can significantly affect the system’s response to unmodeled disturbances. Clearly, not all coordinates of the state vector are directly measurable. The unmeasured components are estimated using various observers, such as the Kalman filter. The computation process proceeds as follows: First, during the backward pass, the parameters c_{N-k} and F_{N-k} are computed using equations ( 3.7 ) and ( 3.8 ), starting from the final time step. Next, in the forward pass, the control vector u_{k} is computed using equation ( 3.6 ), and the corresponding state vector is then updated via the system dynamics described in equation ( 2.1 ). The overall procedure is illustrated in Figure 3 . Figure 3 : Computation schema. 4 Nonlinear Case Now we extend the above result to the nonlinear systems. The main idea is using the above recurrent mechanism, to obtain control policy with iterations for linearized control object. For that matter we linearize discrete representation of ( 2.1 ) x_{k+1}=f(k,\ x_{k},\ u_{k}) (4.1) For i -th iteration (trajectory) the controlled object

Read the complete text