Graph Neural Network-Based Distributed Optimal Control for Linear Networked Systems: An Online Distributed Training Approach

Zihao Song, Shirantha Welikala, Panos J. Antsaklis, Hai Lin · 2025

Read Graph Neural Network-Based Distributed Optimal Control for Linear Networked Systems: An Online Distributed Training Approach by Zihao Song, Shirantha Welikala, Panos J. Antsaklis, Hai Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06439.txt.

Introduction

Running a network of linked machines at its best, when each machine can only use local news, is a hard control problem that grows with the network. Zihao Song and co-authors teach graph-based neural controllers to do it in a 2025 paper. Their controllers learn on the job, in place, rather than in one central training run done in advance.

Training is cast as the network grading its own work, with no outside answer key. Each node works out its share of the learning step and trades notes with neighbors until the group agrees, in the style of group optimization. The authors also prove the loop stays stable under stated bounds on the controller's curves. Tests in a custom simulator show the learned controllers steering the network well, a step toward control that survives node loss.

Catalog record

CREATORZihao Song, Shirantha Welikala, Panos J. Antsaklis, Hai Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06439

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Graph Neural Network-Based Distributed Optimal Control for Linear Networked Systems: An Online Distributed Training Approach Zihao Song, Shirantha Welikala, Panos J. Antsaklis, Hai Lin Abstract In this paper, we consider the distributed optimal control problem for linear networked systems. In particular, we are interested in learning distributed optimal controllers using graph recurrent neural networks (GRNNs). Most of the existing approaches result in centralized optimal controllers with offline training processes. However, as the increasing demand of network resilience, the optimal controllers are further expected to be distributed, and are desirable to be trained in an online distributed fashion, which are also the main contributions of our work. To solve this problem, we first propose a GRNN-based distributed optimal control method, and we cast the problem as a self-supervised learning problem. Then, the distributed online training is achieved via distributed gradient computation, and inspired by the (consensus-based) distributed optimization idea, a distributed online training optimizer is designed. Furthermore, the local closed-loop stability of the linear networked system under our proposed GRNN-based controller is provided by assuming that the nonlinear activation function of the GRNN-based controller is both local sector-bounded and slope-restricted. The effectiveness of our proposed method is illustrated by numerical simulations using a specifically developed simulator 1 1 1 Publicly available at https://github.com/NDzsong2/fdTrainGRNN_NetCtrl-main.git . I Introduction Designing distributed optimal controllers for networked systems has gained plenty of attention over the years due to the wide applications in many fields, such as intelligent transportation systems, power grid networks, and robotic networks. The main objective is to design a controller with a prescribed structure, as opposed to the traditional centralized controller, for a networked system consisting of an arbitrary number of interacting local subsystems. The main challenges of this problem lie in the sparsity of the communication topologies between subsystems and the scalability of the control methods with respect to the network size. As is shown in [ 1 , 2 ] , the sparsity of the communication topologies may cause the non-convexity of the distributed optimal control problem or even make the problem intractable. Besides, as the network size grows, the performance of the controllers may not be preserved. Existing works for the distributed optimal control problem focus on distributed optimization methods (e.g., consensus-based methods [ 3 ] and primal-dual decomposition [ 4 ] ), distributed model predictive control (DMPC) [ 5 ] , multi-agent reinforcement learning (MARL) [ 6 ] , or other learning-based methods (e.g., a distinct multi-layer perceptron (MLP) [ 7 ] and adaptive critic control [ 8 ] ). Even though these methods admit convex formulations, they may usually result in complex solutions that do not scale with the size of the networks. Compared to traditional approaches, learning-based methods do not require the full model knowledge and provide more adaptability to complex systems and better robustness with the minimum communication overheads. Among the learning-based methods, Graph Neural Networks (GNNs) [ 9 ] , as a special type of NNs, are especially suitable for the distributed optimal control problem, since the networked systems can be naturally modeled as graphs, where the subsystems are modeled as the nodes and the communication links are represented by edges. In particular, GNNs consist of a cascade of blocks (commonly known as layers), each of which applies a bank of graph filters followed by an element-wise nonlinearity to aggregate data from different nodes [ 9 ] and can be trained inductively without the knowledge of the whole graph (as oppose to transductive training). Moreover, GNNs are naturally local and distributed (in each layer), permutation equivariant and Lipschitz continuous to changes in the network. These unique advantages make GNNs scalable (with respect to the computational complexity and graph size) and transferable. So far, graph convolution neural networks (GCNNs) and graph recurrent neural networks (GRNNs) have been used to solve the distributed optimal control problem, as seen in [ 10 , 9 ] . However, the GNN models applied in these works are actually not distributed since the multi-layer convolution operation (as in GCNN models in [ 9 ] ) or the information propagation between the hidden states (as in GRNN models [ 10 ] ) make the input data for each node depending not only on itself and its neighboring nodes but also on the neighbors’ neighboring nodes. The basic architecture and the information dependencies of the existing GCNN and GRNN models can be seen in Fig. 1 . Despite recent progress in GNNs [ 11 ] , GNN-based controller design remains challenging, especially when the optimality is required. A comparison table is shown in Tab. I for existing methods. TABLE I : Comparison of different methods. Method Nonlinear Systems Non-convex costs Physical Constr. Scalability GCNNs Yes (via learning) Possible (in training) Easily involved O(N^{2}) or O(N^{3}) Primal Decomp. Limited (convex only) No (requires convexity) Coupling constraints O(NM^{2}) Dual Decomp. Limited (convex only) No (strong duality fails) Only soft constraints O(NM^{2}) + delays DMPC Yes (nonlinear MPC possible) Heuristic only Hard constraints O(N\times T\times M^{3}) Our Method Yes (spatial + temporal) Yes Penalties or layers O(N) (a) Existing works using GCNN-based controller [ 9 ] (b) Existing works using GRNN-based controller [ 10 ] Fig. 1 : Architectures of the closed-loop networked system: (a) Existing works using GCNN-based controller [ 9 ] ; (b) existing works using GRNN-based controller [ 10 ] . Apart from the distributed optimal control design, training the GNN-based controllers in an online distributed manner is another key point in this problem, as required by the increasing demand for network resilience. Even though there are some GNN-related works in network resilient tasks, they usually consider the problems such as edge rewiring [ 12 ] , critical node/link identification [ 13 ] , and fault/attack detection [ 14 ] and reinforcement learning-based control [ 15 ] . Nevertheless, these methods do not consider the feedback dynamics structure, and the closed-loop stability of the entire network is generally not guaranteed. Through online distributed training, the adaptivity of the controllers can be correspondingly enhanced to adapt to network perturbations, failures, or adversarial attacks so that the performance of the network will not deteriorate. Motivated by the above discussions, inspired by [ 16 ] , we aim to consider the distributed optimal control problem using a GRNN-based method, which is trained in an online distributed manner. We first propose our GRNN-based controller for the distributed optimal control problem, and we cast this problem as a self-supervised learning problem. Then, the online distributed learning process is shown via the distributed gradient computation and online weights update law, where this update law is inspired by consensus-based distributed optimization. Furthermore, we prove the local closed-loop stability by assuming that the nonlinear activation function of the GRNN-based controller is both local sector-bounded and slope-restricted. Eventually, the effectiveness of our results is verified by a specifically developed simulator. Our primary contributions can be summarized as follows: 1. Different from the existing GNN-based methods [ 10 , 9 ] , which are actually not distributed, we propose a GRNN-based distributed optimal control method; 2. Our GRNN-based distributed optimal controllers are trained in an online distributed fashion; 3. The closed-loop stability of the networked system under our GRNN-based controller is proved by

Read the complete text