Imitation Learning with Safety and L 2 L^{2} Stability Certificates for Boundary Control of Reaction–Diffusion PDEs

Paulo Henrique F. Biazetto, Mirko Fiacchini, Christophe Prieur, Gustavo Artur de Andrade · 2025

Read Imitation Learning with Safety and L 2 L^{2} Stability Certificates for Boundary Control of Reaction–Diffusion PDEs by Paulo Henrique F. Biazetto, Mirko Fiacchini, Christophe Prieur, Gustavo Artur de Andrade (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11997.txt.

Introduction

Paulo Henrique Foganholo Biazetto and three co-authors train neural network controllers with proof certificates. The plant is a reaction-diffusion system. It is steered through one boundary, while the other obeys a fixed condition. That shape is common in thermal and chemical process control. Simulations alone are not enough for such plants.

A cut-down model from a spectral split captures the unstable dynamics. Convex conditions combine Lyapunov theory with quadratic bounds on the network's activation functions. They guarantee local stability and safety, plus robustness to the cutting error. Learning by imitation supplies the controller, and the certificates supply the proof. Certified learning-based control is what regulated industries need.

Catalog record

CREATORPaulo Henrique F. Biazetto, Mirko Fiacchini, Christophe Prieur, Gustavo Artur de Andrade
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-11997

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Imitation Learning with Safety and L 2 L^{2} Stability Certificates for Boundary Control of Reaction–Diffusion PDEs Paulo Henrique F. Biazetto, Mirko Fiacchini, Christophe Prieur, Gustavo Artur de Andrade Abstract This paper proposes an imitation learning (IL) framework for synthesizing neural network (NN) controllers that achieve boundary stabilization of systems governed by reaction–diffusion partial differential equations (PDEs). The plant is assumed to be actuated through a Dirichlet boundary condition and subject to a Neumann condition on the unactuated side. The design is based on a finite-dimensional truncated model that captures the unstable dynamics of the original infinite-dimensional system, which is obtained via spectral decomposition. Convex stability and safety conditions are then derived for this truncated model by combining Lyapunov theory with local quadratic constraints (QC), which bound the nonlinear activation functions of the NN and guarantee robustness to model truncation, thus addressing the spillover problem. These conditions are integrated into the IL process to jointly minimize the imitation loss and maximize the volume of the certified region of attraction (ROA). The proposed framework is validated on an unstable reaction–diffusion PDE, demonstrating that the resulting NN controller efficiently reproduces the expert policy while ensuring formal stability guarantees. I Introduction Many engineering systems are inherently governed by partial differential equations (PDEs), whose distributed-parameter nature poses major challenges for achieving performance, safety, and efficiency [ 12 ] . When accurate models are available, methods such as backstepping [ 7 ] , semigroup and operator-theoretic techniques [ 4 ] , Lyapunov and energy approaches [ 1 ] , and optimal control formulations [ 9 ] have shown remarkable success in stabilizing infinite-dimensional systems with rigorous guarantees. However, obtaining and calibrating such models often demands costly and time-consuming identification and validation procedures that remain sensitive to modeling uncertainties. Data-driven methods based on neural networks (NNs) have recently emerged as powerful alternatives. These approaches approximate the dynamics of PDE systems by identifying governing parameters [ 14 ] or by learning the underlying solution operators [ 10 ] . A more direct paradigm learns the control policy itself, for example, through reinforcement learning [ 11 ] or operator-learning techniques [ 2 , 19 ] . While effective in practice, most analyses still provide only a posteriori verification of robustness and stability after training. A promising approach to bridge this gap is the integration of robust control theory within the learning architecture. In finite-dimensional settings, this has enabled tractable formulations for controller synthesis endowed with formal Lyapunov-based stability certificates. Recent results demonstrate that imitation learning (IL) can be cast as a constrained optimization problem that simultaneously minimizes the imitation loss and maximizes a certified region of attraction (ROA) [ 17 ] , while multi-objective extensions introduce tunable trade-offs between tracking fidelity and prescribed stability margins [ 13 ] . These frameworks rely on quadratic constraint (QC) formulations to bound neural network (NN) nonlinearities and ensure closed-loop stability during training [ 18 ] . However, extending such guarantees to systems governed by PDEs remains a major theoretical challenge. The work in [ 5 ] provided an initial IL formulation for NN-based controllers of linear PDEs, yet key issues remain open—particularly, the robustness of the Lyapunov certificate to finite-dimensional projections and the explicit enforcement of exponential stability rates within the synthesis procedure. Motivated by these challenges, this work proposes an IL framework for the boundary stabilization of reaction–diffusion PDEs. The plant is actuated through a Dirichlet boundary condition and subject to a Neumann condition on the unactuated side. The methodology begins with a spectral decomposition of the PDE, grounded in Sturm–Liouville theory, to obtain a finite-dimensional model that captures the dominant dynamics of the original system. An expert model predictive controller (MPC) is then designed for this truncated model to generate optimal control trajectories that respect physical and operational constraints. Extending prior work, our framework synthesizes a continuous-time NN controller, learned via the IL framework, that emulates the expert policy while incorporating formal stability guarantees directly from this discrete-time training data. Convex stability and safety conditions are formulated as linear matrix inequalities (LMIs) by combining Lyapunov theory with QCs. Crucially, these LMIs not only bound the NN nonlinearities and ensure robustness to model truncation, but also enforce a desired exponential decay rate (a stability margin). This rigorous treatment of the model reduction mitigates the spillover effect and guarantees stabilization of the infinite-dimensional system in the L^{2} -norm. The derived LMIs are embedded in the IL process to jointly minimize the imitation loss and maximize the certified ROA. Simulation results validate the effectiveness of the proposed framework. The remainder of this paper is organized as follows. Section 2 reviews the mathematical preliminaries on Sturm-Liouville theory. Section 3 formally states the control problem and describes the finite-dimensional modeling approach. Section 4 details our main contribution: the IL framework for synthesizing NN controllers with certified stability. Section 5 presents numerical results to validate the proposed methodology. Finally, Section 6 provides the conclusion. II Overview of Sturm-Liouville Theory We begin by recalling the mathematical framework for our analysis. Let L^{2}(0,1) be the Hilbert space of square-integrable functions on the interval [0,1] , equipped with the inner product \langle f,g\rangle_{L^{2}(0,1)}=\int_{0}^{1}f(x)g(x)dx . Definition 1 (Sturm-Liouville Operator) A Sturm-Liouville operator \mathcal{A}:D(\mathcal{A})\subset L^{2}(0,1)\rightarrow L^{2}(0,1) is a second-order differential operator of the form \mathcal{A}f=-(p(x)f^{\prime})^{\prime}, (1) for all f in the domain \displaystyle D(\mathcal{A})=\{f\in L^{2}(0,1):\,\, \displaystyle\cos(\theta_{0})f(0)-\sin(\theta_{0})f^{\prime}(0)=0, \displaystyle\cos(\theta_{1})f(1)+\sin(\theta_{1})f^{\prime}(1)=0\}, where p\in{C}^{1}([0,1]) with p(x)>0 , and the domain D(\mathcal{A}) is a subspace of L^{2}(0,1) defined by a set of homogeneous boundary conditions, where \theta_{0},\theta_{1}\in[0,\pi) . The self-adjointness of \mathcal{A} guarantees the existence of a countable set of real eigenvalues \{\lambda_{n}\}_{n=1}^{\infty} with no finite accumulation point, and a corresponding set of eigenfunctions \{\Phi_{n}\}_{n=1}^{\infty} that form a complete orthonormal basis for L^{2}(0,1) [ 4 , Theorem 3.2.8] . This means any function f\in L^{2}(0,1) can be uniquely represented by its spectral expansion: f(x)=\sum_{n=1}^{\infty}f_{n}\Phi_{n}(x),\quad\text{where}\quad f_{n}=\langle f,\Phi_{n}\rangle_{L^{2}(0,1)}. The action of the operator \mathcal{A} on a function f\in D(\mathcal{A}) simplifies to scaling each mode by its eigenvalue \mathcal{A}f=\sum_{n=1}^{\infty}\lambda_{n}f_{n}\Phi_{n}(x) . III Problem Statement We focus on the stabilization of an unstable one-dimensional linear reaction-diffusion equation. The specific control objective is to steer the system to its zero equilibrium profile, while respecting constraints imposed on the state and the control action. This system serves as a basis example of a PDE where model-based control is well-understood in the literature, providing a clear and solid performance and criterion baseline for our learning NN-based approach with stability guarantees. In the remainder of this section, we will demonstrate how the Sturm-Liouville operator theory is applied to transform the infinite-dimensional boundary control problem into a tractable reduced-order model, providing a tractable foundation for controller synthesis and the IL process. III-A The Reaction-Diffusion System We consider the following one-dimensional linear reaction-diffusion system [ 8 ] : \displaystyle z_{t}(t,x)=(p(x)z_{x}(t,x))_{x}+q_{c}z(t,x), (2) \displaystyle z_{x}(t,0)=0,\quad z(t,1)=u(t), (3) where t\in[0,\infty) is time, x\in[0,1] is space, q_{c}\in\mathbb{R} , and z(0,x)=z_{0}(x) is the initial condition. The control u(t) produces a non-homogeneous condition at the boundary x=1 , preventing the direct application of the Sturm-Liouville theory outlined before. To address this, we introduce a change of variables w(t,x)=z(t,x)+b(x)u(t) to transform the system into an equivalent one with homogeneous boundary conditions, yielding: \displaystyle w_{t}(t,x) \displaystyle=(p(x)w_{x}(t,x))_{x}+q_{c}w(t,x) \displaystyle+a(x)u(t)+b(x)\dot{u}(t), (4) \displaystyle w_{x}(t,0) \displaystyle=0,\quad w(t,1)=0, (5) where a(x)=-(p(x)b^{\prime}(x))^{\prime}-q_{c}b(x) .

Read the complete text