Efficient Dynamic Shielding for Parametric Safety Specifications
Davide Corsi, Kaushik Mallik, Andoni Rodríguez, César Sánchez · 2025
Read Efficient Dynamic Shielding for Parametric Safety Specifications by Davide Corsi, Kaushik Mallik, Andoni Rodríguez, César Sánchez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22104.txt.
Introduction
Davide Corsi, Kaushik Mallik, Andoni Rodríguez, and César Sánchez design safety shields that adapt on the fly as rules change, in a 2025 paper. A shield watches an AI controller and steps in when an action could break safety. Classic shields are built for one fixed rule set, so a change mid-task forces a full rebuild, which can be too slow. Their dynamic shields are prepared in advance for a whole family of possible rules.
When the true rule reveals itself during operation, a fast adaptation step reshapes the shield in well under a few seconds. In robot navigation tests with newly found obstacles, adaptation beat rebuilding from scratch by up to five times.
Catalog record
| CREATOR | Davide Corsi, Kaushik Mallik, Andoni Rodríguez, César Sánchez |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22104
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Dynamic Shielding for Parametric Safety Specifications Davide Corsi, Kaushik Mallik, Andoni Rodríguez, César Sánchez Abstract Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield, which is a runtime safety enforcement tool that needs to monitor and intervene the AI controller’s actions if safety could be compromised otherwise. Traditional shields are designed statically for a specific safety requirement. Therefore, if the safety requirement changes at runtime due to changing operating conditions, the shield needs to be recomputed from scratch, causing delays that could be fatal. We introduce dynamic shields for parametric safety specifications, which are succinctly represented sets of all possible safety specifications that may be encountered at runtime. Our dynamic shields are statically designed for a given safety parameter set, and are able to dynamically adapt as the true safety specification (permissible by the parameters) is revealed at runtime. The main algorithmic novelty lies in the dynamic adaptation procedure, which is a simple and fast algorithm that utilizes known features of standard safety shields, like maximal permissiveness. We report experimental results for a robot navigation problem in unknown territories, where the safety specification evolves as new obstacles are discovered at runtime. In our experiments, the dynamic shields took a few minutes for their offline design, and took between a fraction of a second and a few seconds for online adaptation at each step, whereas the brute-force online recomputation approach was up to 5 times slower. 1 Introduction Most critical autonomous systems like self-driving cars are nowadays controlled by machine-learned (ML) controllers, and ensuring their safety is an important agenda in artificial intelligence and formal methods research. Despite the recent advancements in the formal verification of ML controllers [ 23 , 21 , 3 ] , most methods either do not scale to the size and complexity of the ML components, or they do not support infinite-horizon safety properties [ 3 ] . Moreover, all these verification approaches assume knowledge of the ML components’ parameters, which might not be true if the controller is designed by a third party and appears as a black-box. One promising solution is shielding [ 7 , 2 , 6 , 28 ] , where we deploy a formally verified runtime enforcement tool, called the shield , that monitors—and, if necessary, overrides—the actions of an ML controller during deployment. Usually shield synthesis is cheaper than verifying the entire system, because the synthesis happens on a small system abstraction that concerns only the safety aspects. Furthermore, the synthesis process treats the ML controller as a black-box, thereby bypassing the aforementioned shortcomings of the traditional verification approaches. Shielding has been successfully applied in tandem with complex machine-learned controllers in a large variety of applications, including safe human-robot interactions [ 20 ] and safe autonomous driving [ 38 ] . State-of-the-art shield synthesis algorithms offer statically designed shields, crafted for a specific safety objective provided at the design time. In reality, safety specifications often vary over time, and there are no principled approaches to dynamically adapt a (statically designed) shield as new safety objectives are uncovered at runtime. This type of dynamic safety specifications appears naturally in designing navigation controllers for robots in previously unknown workspaces, which is the motivating use case of our work and is described as follows. We are given a robot in a workspace filled with static obstacles, and the robot must always avoid colliding with them. However, the visibility of the robot is limited by the range of its sensors, and therefore it can see the obstacles only when it gets close to them. If the entire map were visible to the shield, it could use the locations of the obstacles to define its static safety specification. However, due to its limited sensing power, the safety specification would only concern its immediate neighborhood, and would keep changing in real-time as it moves. We present a novel framework of dynamic shielding with respect to evolving safety specifications. We assume that we are given a perturbed, discrete-time dynamical model of the system, and a parameterized (finite) set of all possible safety specifications that could be encountered at runtime. Specifically, as the specification, we are given a finite collection of safety objectives of the form \left\{\Box\,G_{i}\right\}_{i} , called the parameter set , where G_{i} is a set of safe states of the system, and \Box\,G_{i} is a linear temporal logic (LTL) formula specifying that G_{i} must not be left at any time. Each formula \Box\,G_{i} represents an atomic safety objective, and the actual safety specification encountered at runtime will be the conjunction of an arbitrary subset of atomic safety objectives. The aim is to statically design a shield for the statically provided parameter set \left\{\Box\,G_{i}\right\}_{i} , such that the shield can dynamically adapt itself for every dynamically generated safety specification. Naturally, shielding against parametric safety would require coordination between the offline and online design phases, and the two extreme ends of the coordination spectrum are as follows. The pure offline approach would design one (static) shield for each subset of \left\{\Box G_{i}\right\}_{i} , so that the right shield could be instantly deployed at runtime. However, this would require solving an exponential number of offline shield synthesis problems which will not scale if the parameter set is large. In contrast, the pure online approach would perform no computation in the offline phase, and at runtime, whenever a new safety specification is revealed, it would compute the corresponding (static) shield at that moment. This would create delays in deploying the shield, and could be fatal in most cases. We present an efficient dynamic shielding algorithm that creates a harmony between the offline and online design phases. In the offline design phase, one (static) atomic shield \mathcal{S}_{i} is computed for each atomic safety specification \Box G_{i} , solving a linear number of shield synthesis problems as opposed to the exponential case of the pure offline algorithm. In the online deployment phase, as a new safety specification \Phi=\Box\,G_{j}\land\Box\,G_{k}\land\ldots is encountered, the respective atomic shields \mathcal{S}_{j},\mathcal{S}_{k},\ldots are composed to obtain the shield for the specification \Phi . The composition operation utilizes simple known features like maximal permissiveness of safety shields, giving rise to a fast composition algorithm involving shield “intersections” followed by iterative deadlock removals. Similar style of composition operations are known in the literature in the context of the richer class of parity specifications [ 4 ] , though their use in the specialized case of (dynamic) safety shielding is novel. In summary, our composition algorithm leads to a lightweight shield adaptation mechanism that is significantly cheaper than computing a new shield for \Phi from scratch (the naïve pure online approach). We propose abstraction-based synthesis algorithms for our dynamic shields, though other alternatives could also be pursued [ 45 ] . Concretely, we first create an abstract model of the system by following standard procedure [ 39 ] , namely discretizing the system’s state and input space using uniform grids, and then conservatively approximating the system dynamics over the discrete spaces. Afterwards, we adapt existing abstraction-based synthesis algorithms [ 39 ] for the offline design and online adaptation of our dynamic shields. These procedures are compatible with