Lyapunov-Based Graph Neural Networks for Adaptive Control of Multi-Agent Systems
Brandon C. Fallin, Cristian F. Nino, Omkar Sudhir Patil, Zachary I. Bell, Warren E. Dixon · 2025
Read Lyapunov-Based Graph Neural Networks for Adaptive Control of Multi-Agent Systems by Brandon C. Fallin, Cristian F. Nino, Omkar Sudhir Patil, Zachary I. Bell, Warren E. Dixon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15360.txt.
Introduction
Brandon Fallin and co-authors present in 2025 graph neural network controllers that learn online to coordinate groups of agents. Graph networks pass messages between nodes, which suits distributed control, but past controllers were trained offline before use. Their controllers update weights during the task, driven by a stability method, to track a moving target whose dynamics are unknown.
Theory based on a classic stability tool guarantees that estimates and agent states converge near the target. In simulations, the graph based controller cut position tracking error by about a fifth against a plain network. A version with attention cut error by almost half. Readers get the first stability driven online graph controllers for this task.
Catalog record
| CREATOR | Brandon C. Fallin, Cristian F. Nino, Omkar Sudhir Patil, Zachary I. Bell, Warren E. Dixon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 160 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15360
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lyapunov-Based Graph Neural Networks for Adaptive Control of Multi-Agent Systems Brandon C. Fallin, Cristian F. Nino, Omkar Sudhir Patil, Zachary I. Bell, Warren E. Dixon Abstract Graph neural networks (GNNs) have a message-passing framework in which vector messages are exchanged between graph nodes and updated using feedforward layers. The inclusion of distributed message-passing in the GNN architecture makes them ideally suited for distributed control and coordination tasks. Existing results develop GNN-based controllers to address a variety of multi-agent control problems while compensating for modeling uncertainties in the systems. However, these results use GNNs that are pre-trained offline. This paper provides the first result on GNNs with stability-driven online weight updates to address the multi-agent target tracking problem. Specifically, new Lyapunov-based distributed GNN and graph attention network (GAT)-based controllers are developed to adaptively estimate unknown target dynamics and address the second-order target tracking problem. A Lyapunov-based stability analysis is provided to guarantee exponential convergence of the target state estimates and agent states to a neighborhood of the target state. Numerical simulations show a 20.8 % 20.8\% and 48.1 % 48.1\% position tracking error performance improvement by the GNN and GAT architectures over a baseline DNN architecture, respectively. I Introduction Multi-agent systems often operate in uncertain environments which may include unknown, heterogeneous agent dynamics or unknown disturbances. To address these uncertainties, traditional machine learning approaches train neural networks (NNs) offline by minimizing a loss function over a pre-collected dataset and deploying the trained model to the system. However, the datasets required to train these models can be difficult to obtain, may not match the operating conditions of the environment, and do not adjust online to a mismatch between the pretrained data and actual data. Adaptive control can offer a powerful alternative by enabling real-time estimation of unknown model parameters with stability guarantees for the system. Lyapunov-based adaptive update laws for NN-based controllers are well established for real-time learning for dynamical systems. Motivation exists to generalize such update laws to online deep learning because of the improved approximation performance of deep NNs (DNNs) [ 1 ] . However, this generalization has been technically challenging because the unknown DNN weights are embedded in a nested cascade of nonlinear functions, preventing a structure that is suitable for Lyapunov-based analysis. The authors of [ 2 ] provided the first breakthrough to enable real-time learning methods for uncertain weights in all layers of DNNs by taking advantage of the compositional structure of the architecture. The Lyapunov-based DNN (Lb-DNN) approach developed in [ 2 ] for fully connected feedforward networks has been extended to incorporate a variety of deep learning architectures [ 3 , 4 , 5 , 6 , 7 , 8 , 9 ] , enabling broad applications including: online approximation of unknown dynamics [ 10 , 11 , 12 , 13 ] , herding agents with unknown interaction dynamics [ 14 ] , control input determination using historical sensor data [ 15 ] , safety constraint enforcement under uncertain dynamics [ 16 ] , and development of end-to-end learning methods [ 17 , 18 ] . Much of the multi-agent adaptive NN literature relies on single-layer NNs to compensate for unknown, heterogeneous agent dynamics [ 19 , 20 , 21 ] . Although NNs with a single hidden layer are capable of approximating general nonlinear functions over a compact domain, DNNs provide improved performance [ 1 ] . Fig. 1: Overview of the message-passing framework employed at each GNN layer in which nodes aggregate messages from their local neighborhoods. This figure shows a two-layer implementation of the message-passing model [ 22 ] . Traditional deep learning architectures have specific structural limitations: convolutional neural networks (CNNs) operate on grid-structured data like images, while recurrent neural networks (RNNs), long short-term memory (LSTM) blocks, and transformers process sequential data [ 22 , 23 , 24 ] . Initially conceived as a spatial analogue to RNNs [ 25 ] , graph neural networks (GNNs) were developed to extend deep learning to graph-valued data. As depicted in Fig. 1 , GNNs operate through a message-passing framework where nodes exchange vector messages that are updated using feedforward NN layers. At every layer, the GNN aggregates outputs from each agent’s neighborhood, multiplies by the layer weights, and produces an update using an elementwise activation function. The traditional GNN architecture can also be augmented with an attention mechanism to form the graph attention network (GAT) architecture [ 26 ] . The attention mechanism enables each node to rank the importance of messages from its neighbors. Leveraging attention is particularly useful in applications where some nodes are more informative than others [ 22 ] . Unlike traditional NNs, GNNs efficiently process and share information across networked agents, making them ideally suited for distributed tasks among multiple agents. GNNs have been used extensively in the offline learning literature for a variety of applications, including (i) node classification, which aggregates information from neighboring nodes to sort graph nodes into distinct categories [ 27 ] , (ii) graph classification, which combines local node features into global graph representations [ 28 ] , and (iii) link prediction, which uses graph-valued data to determine likely future connections in settings like social media networks and online shopping platforms [ 29 ] . Only recently have GNNs received attention in the multi-agent literature, where they have been used to develop decentralized controllers [ 30 ] , perform coordinated path planning [ 31 , 32 ] and perimeter defense [ 33 ] , facilitate deep reinforcement learning [ 34 ] , and classify data from distributed sensor networks [ 35 ] . Moreover, GNNs have been used to solve the multi-robot decentralized tracking problem through an imitation learning framework [ 36 ] . In [ 36 ] , the robots must jointly select actions to maximize target tracking performance with local communications. The GNN in [ 36 ] was trained on an action set of a state-of-the-art expert target tracking algorithm offline, and its performance was shown to generalize for large networks of robots. This method differs from the application of GNNs in our work, in which we do not require offline training, and update GNN parameters in real-time. These works show the promise of the GNN architecture when controlling complex, distributed systems. We build on these applications by providing stability guarantees for a new GNN-based adaptive controller. Many results have leveraged feedforward NNs to solve the distributed target tracking problem, in which multiple agents are tasked with monitoring, engaging with, or intercepting a target [ 37 , 38 , 39 , 40 ] . However, none have used graph-theoretic learning methods to enhance the NN’s ability to approximate the target dynamics. Most notably, [ 40 ] considered the use of deep neural networks (DNNs) updated in real-time to achieve a target tracking objective with unknown target dynamics and partial state feedback. This objective was accomplished by developing an adaptive update law for each agent’s DNN and a distributed observer employing the DNN estimate to learn the unknown state of the target. Despite its contribution to distributed estimation capabilities of multi-agent systems, this work did not leverage the underlying communication topology of the graph to inform its DNN estimate. By not leveraging