Neural Cooperative Reach-While-Avoid Certificates for Interconnected Systems

Jingyuan Zhou, Haoze Wu, Kaidi Yang · 2026

Read Neural Cooperative Reach-While-Avoid Certificates for Interconnected Systems by Jingyuan Zhou, Haoze Wu, Kaidi Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20324.txt.

Introduction

Jingyuan Zhou, Haoze Wu, and Kaidi Yang work on formal safety guarantees for neural network controllers in large interconnected systems. Such controllers are hard to certify, above all when many units interact. The authors use neural certificates that capture cooperative behavior between units, expressing the idea of reaching a goal while avoiding bad states.

The challenge is twofold: the certificates must model cooperation, and they must be verified at scale. Existing methods fall short on both fronts, the authors argue. Progress here would let engineers deploy learned controllers in grids, traffic, and robot fleets with proof-backed safety.

Catalog record

CREATORJingyuan Zhou, Haoze Wu, Kaidi Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20324

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Cooperative Reach-While-Avoid Certificates for Interconnected Systems Thanks: Jingyuan Zhou and Kaidi Yang are with the Department of Civil and Environmental Engineering, National University of Singapore, Singapore 119077. Email:[email protected], [email protected]. ( Corresponding Author: Kaidi Yang ) Thanks: Haoze Wu is with the Department of Computer Science, Amherst College, P.O. Box 5000, Amherst, MA 01002. Jingyuan Zhou, Haoze Wu, Kaidi Yang Abstract Providing formal guarantees for neural network-based controllers in large-scale interconnected systems remains a fundamental challenge. In particular, using neural certificates to capture cooperative interactions and verifying these certificates at scale is crucial for the safe deployment of such controllers. However, existing approaches fall short on both fronts. To address these limitations, we propose neural cooperative reach-while-avoid certificates with Dynamic-Localized Vector Control Lyapunov and Barrier Functions, which capture cooperative dynamics through state-dependent neighborhood structures and provide decentralized certificates for global exponential stability and safety. Based on the certificates, we further develop a scalable training and verification framework that jointly synthesizes controllers and neural certificates via a constrained optimization objective, and leverages a sufficient condition to ensure formal guarantees considering modeling error. To improve scalability, we introduce a structural reuse mechanism to transfer controllers and certificates between substructure-isomorphic systems. The proposed methodology is validated with extensive experiments on multi-robot coordination and vehicle platoons. Results demonstrate that our framework ensures certified cooperative reach-while-avoid while maintaining strong control performance. I Introduction Large-scale interconnected systems are prevalent in real-world applications such as intelligent transportation [ 53 ] , robotics [ 27 ] , and smart grids [ 29 ] . Advances in sensing and communication technologies have made these systems increasingly complex and tightly coupled. A central challenge in controlling such systems is ensuring both stability and safety. Control strategies for ensuring stability and safety in interconnected systems can be broadly categorized into model-based and learning-based approaches. Model-based controllers, such as barrier Lyapunov function-based control [ 46 ] , model predictive control [ 17 ] , and sliding mode control [ 9 ] , explicitly incorporate safety and stability into control objectives and constraints. However, these approaches often rely on accurate system models and may become ineffective when facing the complex and uncertain dynamics typical of large-scale interconnected systems. To overcome these limitations, learning-based controllers [ 7 , 8 , 49 , 36 , 2 , 16 , 52 ] , particularly those based on neural networks, have gained increasing popularity due to their ability to manage complex dynamics and uncertainties. However, the black-box nature of neural networks makes it challenging to provide guarantees for stability and safety. In most existing neural network-based controllers, safety and stability are treated as soft constraints (e.g., included in the loss or reward function), without offering rigorous theoretical assurances. To the best of our knowledge, few studies have addressed the challenge of verifying and ensuring stability and safety in neural network-based controllers for large-scale interconnected systems. One notable attempt is [ 47 ] , which incorporates neural graph control barrier function certificates with nominal controllers for large-scale multi-agent systems. However, this approach does not account for cooperation among agents and lacks formal performance verification. Another relevant work [ 51 ] considers neural string stability certificates and employs neural network verification tools to guarantee system-level string stability. However, it focuses solely on stability while neglecting safety, and does not consider the limited communication range inherent in interconnected systems. Several studies have attempted to provide formal guarantees for local stability and safety [ 4 , 40 , 48 , 21 , 20 ] . For example, [ 20 ] leverages Lyapunov barrier certificates to formally verify deep reinforcement learning (RL) controllers, demonstrating safe and reliable training in aerospace applications. However, these approaches are not readily extensible for large-scale interconnected systems for two reasons. First, these approaches often overlook inter-agent cooperation and interaction, and thus the resulting controllers may be overly conservative. Second, it is computationally inefficient to train and verify large-scale interconnected systems. Consequently, formally guaranteeing stability and safety in large-scale interconnected systems remains an open and challenging problem. Statement of Contribution . In this paper, we focus on a special class of control problems in interconnected systems, namely, multi-agent reach-while-avoid, whereby a set of agents seek to reach a goal set (encoded via global asymptotic stability) while avoiding collisions. Our contributions are three-fold. First, we initiate neural cooperative reach-while-avoid (Co-RWA) certificates with dynamic-localized vector control Lyapunov and barrier functions that provide theoretical guarantees of exponential global stability and safety for interconnected systems with cooperation consideration and dynamic neighborhoods. Second, we formulate a scalable verification framework by encoding the proposed neural dynamic-localized Lyapunov and barrier functions into a neural network verification problem. Specifically, we propose a sufficient condition for verification considering dynamics modeling errors and design a counterexample-guided synthesis (CEGIS) framework to verify and train the neural controllers. In the CEGIS framework, an initial controller is trained using RL or by imitating traditional model-based controllers, and is subsequently fine-tuned using counterexamples generated by a verification process that identifies violations of the certification conditions. Compared with existing CEGIS-based frameworks that tend to focus on low-dimensional single-agent systems, we enhance the scalability to large-scale systems by proposing a mechanism to transfer synthesized controllers and neural certificates from small systems to large ones. Third, we validate the proposed framework on multi-robot coordination and vehicle platoon scenarios. Simulation results demonstrate that our approach ensures Co-RWA for large-scale interconnected systems while maintaining control performance. The rest of the paper is organized as follows. Section II reviews related work. Section IV introduces the proposed neural Co-RWA certificates. Section V presents the scalable synthesis and verification framework. Section VI reports numerical simulations in different scenarios. Section VII concludes the paper. II Related Work This work makes contributions in two main research areas: (i) controller design for large-scale interconnected systems, and (ii) neural certificates and neural network verification. Control of Large-Scale Interconnected Systems. Model-based control strategies for interconnected systems have been extensively studied using methods such as distributed model predictive control [ 17 ] and barrier Lyapunov functions [ 27 , 30 , 46 ] . While these approaches explicitly encode stability and safety constraints, they typically rely on accurate system models. In contrast, model-free approaches [ 31 , 46 ] , such as RL-based controllers [ 41 , 16 , 52 ] , have demonstrated strong performance without requiring precise models. However, these methods generally lack formal guarantees of safety and stability. To the best of the authors’ knowledge, no existing work provides certified neural controllers for large-scale interconnected systems with cooperative safety and stability guarantees. Neural Certificates and Formal Verification. To provide guarantees for learning-based controllers, several works propose training with Lyapunov or barrier certificates [ 4 , 3 , 26 , 40 , 42 , 45 , 48 , 28 , 12 , 33 , 47 , 21 , 24 , 51 , 25 , 43 , 35 ] . Such certificates can be formally verified with tools like \alpha - \beta -crown [ 34 ] , Marabou [ 37 ] , and NNV [ 19 ] . These tools further allow for counterexample-guided inductive synthesis (CEGIS) [ 5 , 20 , 50 ] or certified training [ 23 ] , thereby systematically synthesizing controllers

Read the complete text