Joint Chance Constrained Safe-Optimal Control
Niklas Schmid, Jared Miller, Tristan Zeller, Marta Fochesato, Tobias Sutter, John Lygeros · 2026
Read Joint Chance Constrained Safe-Optimal Control by Niklas Schmid, Jared Miller, Tristan Zeller, Marta Fochesato, Tobias Sutter, John Lygeros (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30829.txt.
Introduction
Niklas Schmid and five colleagues rethink how to control a system safely when its future is uncertain. In joint chance constrained control, a policy must keep the probability of ever entering a failure state above a set level while minimising cost. Standard practice averages the cost over all trajectories, safe and failed alike, which rewards policies that give up on some runs to save effort. The team argue the cost of a crashed run is often irrelevant, like the battery use of a crashed quadcopter.
Their formulation minimises only the expected cost of safe trajectories. It can be recast as a constrained Markov decision problem on an enlarged state space and solved by dynamic programming. They bound the safety loss from grid approximations and test the approach on a simulated unicycle robot.
Catalog record
| CREATOR | Niklas Schmid, Jared Miller, Tristan Zeller, Marta Fochesato, Tobias Sutter, John Lygeros |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30829
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Joint Chance Constrained Safe-Optimal Control Niklas Schmid, Jared Miller, Tristan Zeller, Marta Fochesato, Tobias Sutter, John Lygeros Abstract We consider the finite-time optimal control of stochastic systems subject to a probabilistic constraint on the trajectories’ safety. Such formulations are known as joint chance constrained optimal control problems. The common practice is to jointly minimise the expected cost of all trajectories, safe and unsafe. This leads to policies which invite constraint violations to exploit low-cost unsafe trajectories. When constraints represent states of critical failure, such behaviour is undesirable. We demonstrate that this behaviour can be overcome by only minimizing the expected cost of safe trajectories. The underlying rationale follows a practical intuition: In many applications, the cost incurred by unsafe trajectories is irrelevant (e.g., the battery usage of a crashed quadcopter), and one is usually interested in minimizing the cost of trajectories that are safe. We show that this problem can be cast as a constrained Markov Decision Process over an augmented state space. This allows solving it via dynamic programming. We derive bounds on the policies’ safety under errors resulting from gridding approximations when the system’s state space is continuous. Finally, we empirically compare dynamic programming as well as reinforcement learning solutions on a simulated 2D unicycle system in cluttered reach-avoid environments. I Introduction JCC Optimal Control: \displaystyle\begin{aligned} &\ \min&&\text{Cost}({\color[rgb]{0,0.6211,0.4492}\blacksquare}+{\color[rgb]{0.8359,0.3672,0}\blacksquare})\\ &\ \ \text{s.t.}&&\mathbb{P}({\color[rgb]{0,0.6211,0.4492}\blacksquare})\geq\alpha\end{aligned} JCC Safe -Optimal Control: \displaystyle\begin{aligned} &\hskip 18.49988pt\ \min&&\text{Cost}({\color[rgb]{0,0.6211,0.4492}\blacksquare})\\ &\hskip 18.49988pt\ \ \text{s.t.}&&\mathbb{P}({\color[rgb]{0,0.6211,0.4492}\blacksquare})\geq\alpha\end{aligned} Fig. 1 : Trajectories of a perturbed delivery robot. The aim is to minimise actuation costs while safely reaching the target with probability \alpha=0.6 . The standard joint chance constrained control policy from the literature (left) achieves a low cost by occasionally "giving up" on the delivery objective, and following a long but safe route otherwise. In contrast, we exclusively optimize the cost of trajectories that safely reach the target (right), and disregard the cost of all others, leading to a lower actuation cost for those successful trajectories ( 21.8 left vs. 19.7 right over 1000 Monte-Carlo simulations), see Section IV for details. Black: Unsafe Set; Blue striped: Target Set; Trajectories are green if they reach the target, red otherwise; Initial state: (0.5,1) . Safe autonomy under stochastic uncertainty is a fundamental challenge in control, robotics and machine learning: Autonomous driving [ 34 , 25 ] promises fast but safe travel in hard-to-predict traffic environments, precision agriculture [ 28 ] aims for resource efficient irrigation with low risks in crop losses under uncertain weather predictions, and medical devices [ 16 ] must sustain life-critical performance under tight safety constraints despite biological variability. Accordingly, stochastic control problems with joint chance constraints (JCC) are common in the control literature. Typical formulations comprise two components, a cost assigned to each trajectory (which, for the sake of the argument, we consider to be financial), and a constraint encoded by a set of safe trajectories (joint chance constraint). The aim of the control policy is to minimize the financial cost while ensuring that the probability that the closed loop trajectories remain safe is above a specified value. Solution approaches to JCC problems range from stochastic model predictive control [ 9 , 31 , 4 , 24 , 23 , 22 ] , constrained Markov Decision Processes (MDPs) solved through dynamic programming (DP) [ 26 , 18 , 32 , 14 ] , linear programming [ 27 , 13 , 8 , 11 ] , and reinforcement learning (RL) [ 6 , 33 , 35 , 7 , 30 , 21 ] , as well as Lyapunov-based methods [ 19 ] . In many applications, the violation of constraints is reversible. For instance, comfort constraint violations in buildings ( 26\text{\,}\mathrm{\SIUnitSymbolCelsius} rather than the nominal 23\text{\,}\mathrm{\SIUnitSymbolCelsius} in the summer) are not a source of major concern and the constraints can be reentered after violation. If unsafe trajectories have a lower cost, this leads to a trade-off between constraint violation and cost: The resulting controller will ensure safety with the specified probability but take advantage of financial savings, potentially by violating constraints. In other applications, however, constraint violation is catastrophic and irreversible. For example, consider an airline optimizing flight paths for minimum fuel while ensuring a sufficient level of safety. In such cases, trading-off safety for cost is meaningless; the fuel cost of trajectories that violate the constraint by crashing the airplane is irrelevant and should not be included in the operating profit of an airline. The fact that JCC control policies systematically exploit low-cost unsafe trajectories has been reported in the literature [ 26 , 27 , 21 , 11 ] and makes their applicability to systems with irreversible constraints unclear. Motivated by these reports, we study the problem of only optimizing safe trajectories in the financial cost and ignoring the cost of unsafe trajectories. Fig. 1 displays how this modification affects the behaviour of JCC control policies on a delivery robot that minimizes battery usage. The standard JCC control policy occasionally "gives up" on the delivery-constraint to achieve a low-cost trajectory. In contrast, our approach achieves lower costs on safe trajectories at the risk of high-cost unsafe trajectories. We summarize the contributions of this paper: • We introduce a novel control problem where costs of safe trajectories are minimized subject to a JCC. • We prove that the problem can be reformulated as a constrained MDP over an augmented state space, whose optimal policies coincide with those of the original problem. • We derive bounds on the policies’ safety under errors from gridding based approximations. • We empirically validate our DP method in numerical experiments and compare with a state-of-the-art alternative based on RL. Outline. We introduce necessary preliminaries and our problem formulation in Section II , cast it as a constrained MDP and derive DP approximation error bounds in Section III , and numerically evaluate our formulation in Section IV . We conclude with a summary in Section V . Notation. We denote by [N] the set \{0,1,\hbox to10.00002pt{.\hss.\hss.},N\},N\in\mathbb{N} . The indicator function of a set \mathcal{A} yields \mathbb{1}_{\mathcal{A}}(x)=1 if x\in{\mathcal{A}} and \mathbb{1}_{\mathcal{A}}(x)=0 otherwise. The set-wise difference of \mathcal{A} and \mathcal{X} is \mathcal{A}\setminus\mathcal{X}=\{x\in\mathcal{A}:x\notin\mathcal{X}\} . For a topological space S , we denote by C_{b}(S) the space of continuous bounded real-valued functions on S and by \mathcal{B}(S) the Borel \sigma -algebra of S . Further, \bm{M}_{+} and \mathcal{P} are the sets of finite non-negative measures and probability measures on (S,\mathcal{B}(S)) . The Dirac-delta distribution centered at s\in S is \delta_{s}(\cdot) . For a function f with domain S we denote the \mathcal{L}_{\infty} -norm as \|f\|_{\infty}=\sup_{s\in S}|f(s)| . II Preliminaries and Problem Formulation We introduce three optimal control problems. Equation ( 1 ) defines a joint-chance constrained MDP, which we generalize in equation ( 2 ) to optimize over safe trajectories only. In Section III-A we describe how to rewrite ( 2 ) as a constrained MDP of form ( 3 ), which is solvable through DP. Markov Decision Process. We refer to [ 15 ] for a detailed treatment of MDPs. An MDP over a finite time horizon N is a tuple \mathcal{M}=(\mathcal{X},\mathcal{U},\mathcal{Q}) , where the state space \mathcal{X} and the input space \mathcal{U} are Borel subsets of complete separable metric spaces equipped with the \sigma -algebras \mathcal{B}(\mathcal{X}) and \mathcal{B}(\mathcal{U}) ,