Gradient- and Newton-Based Unit Vector Extremum Seeking Control

Roberto Luo, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic · 2025

Read Gradient- and Newton-Based Unit Vector Extremum Seeking Control by Roberto Luo, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08485.txt.

Introduction

Roberto Luo and three co-authors build controllers that hunt for a peak without a model of the system, in a 2025 paper. Extremum seeking control nudges a system with a wiggle signal and climbs the response slope toward the best setting. It is used where the map from settings to performance is unknown and shifts over time.

Their twist swaps smooth feedback for relay-type switching drawn from sliding mode control, a style known for finite-time and fixed-time settling. Both slope-based and Newton-based versions are built on unit vector control, the first such use inside the classic seeking scheme. For unknown curved performance maps with several inputs, the slope version’s speed depends on the map’s bend. The design aims at fast, steady climbing in real-time tuning tasks.

Catalog record

CREATORRoberto Luo, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08485

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gradient- and Newton-Based Unit Vector Extremum Seeking Control Roberto Luo, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic Abstract This paper presents novel methods for achieving stable and efficient convergence in multivariable extremum seeking control (ESC) using sliding mode techniques. Drawing inspiration from both classical sliding mode control and more recent developments in finite-time and fixed-time control, we propose a new framework that integrates these concepts into Gradient- and Newton-based ESC schemes based on sinusoidal perturbation signals. The key innovation lies in the use of discontinuous "relay-type" control components, replacing traditional proportional feedback to estimate the gradient of unknown quadratic nonlinear performance maps with Unit Vector Control (UVC). This represents the first attempt to address real-time, model-free optimization using sliding modes within the classical extremum seeking paradigm. In the Gradient-based approach, the convergence rate is influenced by the unknown Hessian of the objective function. In contrast, the Newton-based method overcomes this limitation by employing a dynamic estimator for the inverse of the Hessian, implemented via a Riccati equation filter. We establish finite-time convergence of the closed-loop average system to the extremum point for both methods by leveraging Lyapunov-based analysis and averaging theory tailored to systems with discontinuous right-hand sides. Numerical simulations validate the proposed method, illustrating significantly faster convergence and improved robustness compared to conventional ESC strategies, which typically guarantee only exponential stability. The results also demonstrate that the Gradient-based method exhibits slower convergence and higher transients since the gradient trajectory follows the curved and steepest-descent path, whereas the Newton-based method achieves faster convergence and improved overall performance going straightly to the extremum. \papertype PREPRINT SUBMITTED TO ARXIV.ORG \paperfield 2025 \corraddress Corresponding author: V. H. P. Rodrigues \corremail [email protected] \fundinginfo This research was supported by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), and Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ). keywords Newton-based extremum seeking, Gradient-based extremum seeking, unit vector control, sliding mode control 1 Introduction Extremum seeking control (ESC) is a real-time adaptive method designed to maintain the output of an objective function in the vicinity of its optimal value, whether to maximized or minimized, without requiring the knowledge of the system dynamics. The classical extremum seeking works by introducing a small periodic sinusoidal signal into the control input and output to estimate the gradient direction. As the estimate gradient approaches to zero, the output and input of the cost function converges to the vicinity of its extremum value [ 15 ] . This control method has been employed in theoretical and application studies, such as in optimization field [ 5 , 45 ] for a wide class of problems: in the presence of delays or dynamics modeled by Partial Differential Equations (PDEs) [ 23 ] , for uncertain nonlinear systems subject to constraints [ 12 ] or underactuated systems with symmetry [ 42 ] as well as for an iterative auto-tuning of the feedback gains for a class of nonlinear systems [ 7 , 19 , 30 ] ; in non-cooperative games to seek the Nash equilibrium [ 28 , 27 ] , and with event-triggered control [ 35 , 36 ] in order to reduce control effort. All these works cited are based on a gradient method, the convergence rate speed is proportional to the unknown Hessian (second derivative) of the nonlinear map. Reference [ 16 ] has introduced a Newton-like method to estimate the second derivative of the map, to increase the convergence rate speed. Later, [ 9 ] proposed a dynamic estimator of the inverse of the Hessian in the form of a Riccati differential equation to eliminate the Hessian dependence and make it user-assignable. Therefore, the convergence rate speed of the system and the estimator of the Hessian inverse are independent of the unknown Hessian of the objective function. Due to this control strategy, it has been explored in extremum seeking field, for examples, in power optimization for photovoltaic to improve the transient performance [ 10 ] , the design of multivariable extremum seeking for static maps with different time delays [ 24 ] , to ensure uniform convergence rate of the system’s parameters for a multivariable static map [ 11 ] , by using the static event-triggered control with a Newton-based extremum seeking [ 38 ] , the controller updated less than the gradient-based method and for fast and accurate impedance-matching control [ 13 ] . In the literature on ESC based on sliding modes, a notable contribution is the work by Özgüner and coauthors [ 29 ] , which introduced a periodic switching function to enable a state-feedback control approach. Building on this, Oliveira et al. [ 22 , 25 ] extended the methodology to rely solely on output feedback. The same research group also proposed an alternative sliding mode-based ES controller employing monitoring functions [ 1 , 2 ] , including experimental validation by means of the source seeking application [ 3 ] . However, none of these ESC strategies adopt the original and simplest structure characterized by sinusoidal periodic perturbations, as introduced in [ 15 ] . In our previous work [ 37 ] , we presented the first sliding-mode Nash equilibrium seeking (NES) strategy based on relay extremum seeking with sinusoidal perturbations. The approach featured two key characteristics in its distributed control architecture: (1) each player independently generated sinusoidal perturbations to estimate its pseudogradient without inter-agent communication, and (2) a discontinuous sliding-mode control law ensured finite-time convergence to the Nash equilibrium. The method combined extremum seeking principles with switching control actions to achieve model-free equilibrium seeking in quadratic duopoly games. Recently, interesting developments have emerged in the context of fixed-time strategies for ESC [ 32 , 33 ] —which are time-invariant and non-smooth—as well as prescribed-time schemes for extremum seeking [ 44 ] and source seeking [ 43 ] , which are time-varying and smooth. In particular, [ 32 , 33 ] introduce control laws reminiscent of those used in higher-order sliding mode control (SMC). A well-known example of second-order SMC is the super-twisting algorithm (STA) [ 18 ] . More broadly, an entire family of finite-time (or fixed-time) SMC strategies exists [ 17 ] , offering potential for application in extremum seeking. Despite this, the idea of applying variable structure or sliding mode ESC strategies with finite (though not fixed) convergence time has yet to be fully explored within the SMC community. We believe this direction holds significant promise and, as a starting point, we focus on the simplest and most widely known case: first-order SMC (FOSMC), implemented via a relay function. Although FOSMC is discontinuous, it guarantees finite-time convergence. In this context, Unit-Vector Control (UVC) is a control strategy that normalizes the control input to unit magnitude, enforcing finite-time convergence of the system’s state trajectory through the application of a discontinuous control law [ 6 , 21 ] . UVC it is a branch of Sliding Mode Control (SMC) tailored for multivariable systems, offering a distinct advantage in the design of robust controllers for systems subject to uncertainties. To bridge the existing gaps, our paper extends the classical multivaribale Gradient- and Newton-based ESC algorithms [ 9 ] by incorporating UVC in place

Read the complete text