Online ResNet-Based Adaptive Control for Nonlinear Target Tracking

Cristian F. Nino, Omkar Sudhir Patil, Jordan C. Insinger, Marla R. Eisman, Warren E. Dixon · 2025

Read Online ResNet-Based Adaptive Control for Nonlinear Target Tracking by Cristian F. Nino, Omkar Sudhir Patil, Jordan C. Insinger, Marla R. Eisman, Warren E. Dixon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14372.txt.

Introduction

Cristian Nino and four co-authors design a neural adaptive controller that tracks targets for nonlinear systems whose dynamics are in part unknown. The controller uses a residual network modified for control work. It has pre-activation shortcuts and a zeroth-layer block that reconciles input and output sizes that do not match. Unknown dynamics and disturbances fight the tracking the whole time.

An adaptation law based on Lyapunov theory updates the network online. Theory pledges exponential convergence into a neighborhood of the target state in spite of the unknowns. A test that sets it next to rivals backs the analysis. The team put generalized residual architectures forth as a flexible function approximator for adaptive control. It extends past designs that took matching dimensions as given right through the network.

Catalog record

CREATORCristian F. Nino, Omkar Sudhir Patil, Jordan C. Insinger, Marla R. Eisman, Warren E. Dixon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14372

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Online ResNet-Based Adaptive Control for Nonlinear Target Tracking Cristian F. Nino, Omkar Sudhir Patil, Jordan C. Insinger, Marla R. Eisman, Warren E. Dixon Abstract A generalized ResNet architecture for adaptive control of nonlinear systems with black box uncertainties is developed. The approach overcomes limitations in existing methods by incorporating pre-activation shortcut connections and a zeroth layer block that accommodates different input-output dimensions. The developed Lyapunov-based adaptation law establishes exponential convergence to a neighborhood of the target state despite unknown dynamics and disturbances. Furthermore, the theoretical results are validated through a comparative experiment. I Introduction Neural networks (NNs) are well established for approximating unstructured uncertainties in continuous functions over compact domains [ 1 , 2 , 3 , 4 ] . The evolution of NN-based control has progressed from single-layer architectures with Lyapunov-based adaptation [ 5 , 6 , 7 ] to more complex deep neural network (DNN) implementations, motivated by numerous examples of improved function approximation efficiency [ 8 , 9 , 10 ] . Early DNN approaches develop Lyapunov-based adaptive update laws for the output layer while the inner layers are updated either in an iterative offline manner as in [ 11 ] and [ 12 ] , or using modular adaptive update laws [ 13 ] . Recent developments have established frameworks for real-time adaptation of all DNN layers [ 14 , 15 ] for various DNN architectures, addressing issues in transient performance [ 16 ] and leveraging persistence of excitation [ 17 ] . Deep residual neural network (ResNet) architectures have emerged as particularly promising candidates for adaptive control applications. The ResNet architecture is popular because it addresses optimization challenges that arise with increasing network depth, making them potentially valuable for modeling complex system uncertainties. The key innovation of ResNets is the introduction of skip connections that create direct paths for information to flow through the network during backpropagation as in [ 18 ] and [ 19 ] . These skip connections help prevent the degradation of gradient information as it passes through multiple layers—a phenomenon known as the vanishing gradient problem where the magnitude of gradients becomes too small for effective weight updates in deep networks. Rather than learning completely new representations at each layer, ResNets learn the difference (or "residual") between the input and the desired output of a layer, which simplifies the optimization process. Theoretical analyses have demonstrated that ResNets possess favorable optimization properties, including smoother loss landscapes [ 20 ] , absence of spurious local optima with every local minimum being a global minimum as in [ 21 ] and [ 22 ] , and stability of gradient descent equilibria [ 23 ] . The universal approximation capabilities of ResNets have also been investigated [ 24 , 25 , 26 ] , confirming their ability to approximate any continuous function on a compact set to arbitrary accuracy. A critical advancement in ResNet design was the introduction of pre-activation shortcuts by [ 27 ] , which position the skip connection before activation functions, improving the flow of information through the network and enhancing the network’s ability to generalize to unseen data. This architectural modification shares conceptual similarities with DenseNets [ 28 ] , which strengthen feature propagation through dense connectivity patterns that connect each layer to every other layer, facilitating feature reuse and enhancing information flow throughout the network. Recently, [ 29 ] introduced the first Lyapunov-based ResNet for online learning in control applications. However, their implementation utilized the original ResNet architecture without incorporating the pre-activation shortcut connections that have been demonstrated to improve performance [ 27 ] . This limitation potentially restricts the learning capabilities and convergence properties of their approach. Additionally, this approach requires the inputs and outputs of the ResNet architecture to be of the same dimensions, thus limiting the applicability of the development. These limitations potentially restrict the learning capabilities and convergence properties of their approach. This work presents a generalized ResNet architecture featuring pre-activation shortcut connections and a zeroth layer block designed for target tracking of nonlinear systems. The developed approach positions the skip connection before activation, with post-activation feeding into the DNN block, leveraging the improved information propagation through the network established by [ 27 ] . Additionally, the zeroth layer block can compensate for uncertainties with different input and output size, overcoming the limitations of the approaches in [ 29 ] . Similar to DenseNets [ 28 ] , the developed architecture facilitates stronger feature propagation and reuse, and is specifically designed for online learning in control applications. The key contribution of this work is the development and analysis of a Lyapunov-based adaptation law for this generalized ResNet architecture, which establishes exponential convergence to a neighborhood of the target state despite unknown dynamics and disturbances. Furthermore, the theoretical results are validated through a comparative experiment. II Deep Residual Neural Network Model Consider a fully connected feedforward ResNet with b\in\mathbb{Z}_{\geq 0} building blocks, input x\in\mathbb{R}^{L_{\text{in}}} , and output y\in\mathbb{R}^{L_{\text{out}}} . For each block index i\in\left\{0,\ldots,b\right\} , let k_{i}\in\mathbb{Z}_{>0} be the number of hidden layers in the i^{\text{th}} block, let \kappa_{i}\in\mathbb{R}^{L_{i,0}} denote the block input (with \kappa_{0}\triangleq x and L_{0,0}\triangleq L_{\text{in}} ), and let \theta_{i}\in\mathbb{R}^{p_{i}} be the vector of parameters (weights and biases) associated with the i^{\text{th}} block. For each block i\in\left\{0,\ldots,b\right\} , let L_{i,j}\in\mathbb{Z}_{>0} denote the number of neurons in the j^{\text{th}} layer for j\in\left\{0,\ldots,k_{i}+1\right\} . Furthermore, define the augmented dimension L_{i,j}^{a}\triangleq L_{i,j}+1 , for all \left(i,j\right)\in\left\{0,\ldots,b\right\}\times\left\{0,\ldots,k_{i}\right\} . Each block function \Phi_{i}:\mathbb{R}^{L_{i,0}^{a}}\times\mathbb{R}^{p_{i}}\to\mathbb{R}^{L_{i,k_{i}+1}} is a fully connected feedforward DNN, with L_{i,k_{i}+1}\triangleq L_{\text{out}} for all \left(i,j\right)\in\left\{0,\ldots,b\right\}\times\left\{0,\ldots,k_{i}\right\} . For any input v\in\mathbb{R}^{L_{i,j}^{a}} , the DNN is defined recursively by \varphi_{i,j}\left(v\right)\triangleq\begin{cases}V_{i,0}^{\top}v,&j=0,\\ V_{i,j}^{\top}\phi_{i,j}\left(\varphi_{i,j-1}\left(v\right)\right),&j\in\left\{1,\ldots,k_{i}\right\},\end{cases} (1) with \Phi_{i}\left(v,\theta_{i}\right)=\varphi_{i,k_{i}}\left(v\right) . For each j\in\left\{0,1,\ldots,k_{i}\right\} the matrix V_{i,j}\in\mathbb{R}^{L_{i,j}^{a}\times L_{i,j+1}} contains the weights and biases; in particular, if a layer has n (augmented) inputs and the subsequent layer has m nodes, then V\in\mathbb{R}^{n\times m} is constructed so that its \left(i,j\right)^{\text{th}} entry represents the weight from the i^{\text{th}} node of the input to the j^{\text{th}} node of the output, with the last row corresponding to the bias terms. For the DNN architecture described by ( 1 ), the vector of DNN weights of the i^{\text{th}} block is \theta_{i}\triangleq\left[\begin{array}[]{ccc}\text{vec}\left(V_{i,0}\right)^{\top}&\cdots&\text{vec}\left(V_{i,k_{i}}\right)^{\top}\end{array}\right]^{\top}\in\mathbb{R}^{p_{i}} , where p_{i}\triangleq\sum_{j=0}^{k_{i}}L_{i,j}^{a}L_{i,j+1} , and \text{vec}\left(V_{i,j}\right) denotes the vectorization of V_{i,j} performed in column-major order (i.e., the columns are stacked sequentially to form a vector). The activation function \phi_{i,j}:\mathbb{R}^{L_{i,j}}\to\mathbb{R}^{L_{i,j}^{a}} is given by \phi_{i,j}\left(\varphi_{i,j-1}\right) = \left[\varsigma_{i,1}\left(\left(\varphi_{i,j-1}\right)_{1}\right)\right. \begin{array}[]{c}\varsigma_{i,2}\left(\left(\varphi_{i,j-1}\right)_{2}\right)\end{array} \begin{array}[]{c}\cdots\end{array} \begin{array}[]{c}\varsigma_{i,L_{i,j}}\left(\left(\varphi_{i,j-1}\right)_{L_{i,j}}\right)\end{array} \left.1\right]^{\top} \in\mathbb{R}^{L_{i,j}^{a}} where \left(\varphi_{i,j-1}\right)_{\ell} denotes the \ell^{\text{th}} component of \varphi_{i,j-1} , each \varsigma_{i,j}:\mathbb{R}\to\mathbb{R} denotes a smooth activation function, and 1 denotes the augmented hidden layer that accounts for the bias term. Figure 1: Deep Residual Neural Network Architecture A pre-activation design is used so that, before each block (except block 0 ), the output of the previous block is processed by an external activation function. Specifically, for each block i\in\left\{1,\ldots,b\right\} , define the pre-activation mapping \psi_{i}:\mathbb{R}^{L_{i,k_{i}+1}}\to\mathbb{R}^{L_{i,k_{i}+1}^{a}} by \psi_{i}\left(\kappa_{i}\right) = \left[\varrho_{i,1}\left(\left(\kappa_{i}\right)_{1}\right)\right. \varrho_{i,2}\left(\left(\kappa_{i}\right)_{2}\right) \begin{array}[]{c}\cdots\end{array} \varrho_{i,L_{i,k_{i}+1}}\left(\left(\kappa_{i}\right)_{L_{i,k_{i}+1}}\right) \left.1\right]^{\top} \in\mathbb{R}^{L_{i,k_{i}+1}^{a}} where \left(\kappa_{i}\right)_{\ell} denotes the \ell^{\text{th}} component of \kappa_{i} , each \varrho_{i,j+1}:\mathbb{R}\to\mathbb{R} denotes a smooth activation function, and 1, again, accounts for the bias term. The output of \psi_{i} serves as the input to block i and the residual connection is implemented by adding the current block output to the pre-activated output from the previous block. Hence, the ResNet recursion

Read the complete text