Set-Based Value Function Characterization and Neural Approximation of Stabilization Domains for Input-Constrained Discrete-Time Systems
Mohamed Serry, S. Sivaranjani, Jun Liu · 2026
Read Set-Based Value Function Characterization and Neural Approximation of Stabilization Domains for Input-Constrained Discrete-Time Systems by Mohamed Serry, S. Sivaranjani, Jun Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00305.txt.
Introduction
Serry and two colleagues propose a framework for finding stabilization domains for input-limited discrete-time nonlinear systems, mapping each domain through value functions on metric spaces of compact sets. They establish their core traits and derive Bellman-type equations. A physics-informed neural network then learns them by building them into training. Two test examples show the method estimates these domains well and builds stabilizing controls from the learned functions.
Catalog record
| CREATOR | Mohamed Serry, S. Sivaranjani, Jun Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49715 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00305
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Set-Based Value Function Characterization and Neural Approximation of Stabilization Domains for Input-Constrained Discrete-Time Systems Mohamed Serry, S. Sivaranjani, Jun Liu Abstract Analyzing nonlinear systems with stabilizable controlled invariant sets (CISs) requires accurate estimation of their domains of stabilization (DOS) together with associated stabilizing controllers. Despite extensive research, estimating DOSs for general nonlinear systems remains challenging due to fundamental theoretical and computational limitations. In this paper, we propose a novel framework for estimating DOSs for controlled input-constrained discrete-time systems. The DOS is characterized via newly introduced value functions defined on metric spaces of compact sets. We establish the fundamental properties of these value functions and derive the associated Bellman-type (Zubov-type) functional equations. Building on this characterization, we develop a physics-informed neural network (NN) framework that learns the value functions by embedding the derived functional equations directly into the training process. The proposed methodology is demonstrated through two numerical examples, illustrating its ability to accurately estimate DOSs and synthesize stabilizing controllers from the learned value functions. largesymbols”03 largesymbols”02 I Introduction A fundamental problem in control theory is the design of stabilizing controllers for nonlinear systems where the goal is to construct a feedback law, that is, a mapping from the state to the control input, such that the resulting closed-loop system is asymptotically stable with respect to a desired equilibrium point or a target set of interest. Closely related to this objective is the characterization of the set of initial conditions that can be driven asymptotically to the target set, commonly referred to as the domain of stabilization (DOS). An overview of DOS estimation for continuous-time systems can be found in, e.g., [ 1 , 2 ] . In this work, we study DOSs for controlled discrete-time nonlinear systems. The stabilization of such systems has been extensively investigated, with a wide range of approaches including linearization-based methods [ 3 ] , control Lyapunov functions [ 4 , 5 ] , sliding mode control [ 6 , 7 ] , feedback linearization [ 8 ] , and model predictive control [ 9 ] . While these methods have demonstrated effectiveness across a broad range of applications, a fundamental challenge remains: the resulting controllers do not, in general, guarantee that all initial states within the DOS are driven asymptotically to the target set or equilibrium point. In particular, stabilization guarantees are often local, and the domain of attraction of the closed-loop system does not necessarily coincide with the DOS, especially in the presence of input constraints. As a result, the domain of attraction of the implemented controller may be strictly smaller than the true DOS. An alternative and well-established framework for studying stabilization is based on value functions. In this approach, a running cost is introduced to penalize deviations from the desired behavior, and the associated value function is defined as the optimal accumulated cost. This function satisfies a Bellman-type equation [ 10 ] , which can, in principle, be solved via dynamic programming. This framework provides a principled way to construct stabilizing controllers and to characterize the DOS exactly as sublevel sets of the value function. However, its practical implementation typically requires state-space discretization, leading to exponential growth in computational complexity. Recently, learning-based approaches have been proposed for synthesizing neural controllers and estimating domains of attraction of the resulting closed-loop systems [ 11 , 12 , 13 , 14 ] . These methods typically enforce Lyapunov-type decrease conditions during training. While effective in practice, they generally do not guarantee maximality of the resulting DOS estimates. Certification of learned neural Lyapunov functions and controllers is commonly performed using formal verification tools, such as those based on interval arithmetic or mixed-integer programming [ 12 , 15 , 16 ] . Although neural network verification remains computationally demanding, recent advances in linear bound propagation and branch-and-bound techniques have significantly improved scalability [ 17 , 18 , 19 , 20 , 21 ] . These developments have motivated ongoing efforts toward obtaining certifiable neural Lyapunov functions and controllers valid over large regions of the state space. A natural direction is to combine the theoretical guarantees of value-function-based methods with the scalability of learning-based approaches, with the goal of learning maximal Lyapunov functions. Such ideas have been explored for uncontrolled systems (see, e.g., [ 22 , 23 ] ). However, extending these approaches to controlled systems introduces several challenges. First, evaluating value functions requires solving infinite-horizon optimal control problems, which are generally intractable; even finite-horizon approximations lead to large-scale nonconvex optimization problems. Second, the Bellman equations involve infimum operators over the control inputs, which complicates their direct incorporation into physics-informed learning frameworks, i.e., learning frameworks that embed governing equations into the loss functions. Physics-informed learning is particularly attractive in control applications, as it incorporates system dynamics and stability conditions directly into the training process, thereby improving the approximation quality of the learned neural functions compared to purely data-driven approaches [ 24 , 25 ] . Motivated by these challenges, we develop a novel framework for estimating DOSs associated with prescribed CISs for discrete-time nonlinear systems, together with corresponding neural network controllers. The proposed approach integrates two key components: (i) set-based value functions that characterize the DOS, and (ii) neural network approximations to represent these functions. Specifically, we introduce value functions defined on metric spaces of compact sets that characterize the DOS while enabling tractable evaluation via reachable-set approximations. These value functions satisfy Bellman-type functional equations without explicit infimum operators, allowing practical evaluation of residual errors through finite-dimensional embeddings of set representations. This structure facilitates physics-informed learning of the value functions. The remainder of the paper is organized as follows. Section II introduces preliminaries and notation. Section III presents the problem formulation. Section IV introduces the proposed value functions and their theoretical properties. Section VI presents numerical examples demonstrating the potential of our framework in DOS estimation and control synthesis, and Section VII concludes the paper. II Notation and preliminaries Let \mathbb{R} , \mathbb{R}_{+} , \mathbb{Z} , and \mathbb{Z}_{+} denote the sets of real numbers, nonnegative real numbers, integers, and nonnegative integers, respectively, and define \mathbb{N}:=\mathbb{Z}_{+}\setminus\{0\} . For a,b\in\mathbb{R} with a\leq b , let [a,b] , \orbrack a,b\clbrack , [a,b\clbrack , and \orbrack a,b] denote the closed, open, and half-open intervals in \mathbb{R} with endpoints a and b . Their discrete counterparts are denoted by [a;b] , \orbrack a;b\clbrack , [a;b\clbrack , and \orbrack a;b] , respectively. Let \|\cdot\| denote any vector norm on \mathbb{R}^{n} and \mathbb{B}_{n} be the n -dimensional closed unit ball induced by \|\cdot\| . The Minkowski sum of X,Y\subseteq\mathbb{R}^{n} is defined as X+Y\mathrel{:=}\left\{x+y\,\middle|\,x\in X,~y\in Y\right\}. The class of nonempty compact subsets of X\subseteq\mathbb{R}^{n} is denoted by \mathcal{K}(X) . Given a point x\in\mathbb{R}^{n} and a set \Omega\subseteq\mathbb{R}^{n} , define the distance from x to \Omega as \mathrm{dist}(x,\Omega)\mathrel{:=}\inf_{y\in\Omega}\|x-y\|. This distance function is used to define both the asymmetric and symmetric Hausdorff distances, denoted by \mathbf{d}_{\mathrm{H}}^{\mathrm{a}} and \mathbf{d}_{\mathrm{H}}^{\mathrm{s}} , respectively (see, e.g., [ 23 , 26 ] ). Note that, for X\subseteq\mathbb{R}^{n} , \mathcal{K}(X) , equipped with the Hausdorff distance \mathbf{d}_{\mathrm{H}}^{\mathrm{s}} , is a metric space. Given f\colon X\rightarrow Y and P\subseteq X , the image of f on P is defined as f(P)\mathrel{:=}\left\{f(x)\,\middle|\,x\in P\right\} . Given f\colon X\rightarrow X and x\in X , f^{0}(x)\mathrel{:=}x , and for