Conformal Predictive Monitoring for Multi-Modal Scenarios
Francesca Cairoli, Luca Bortolussi, Jyotirmoy V. Deshmukh, Lars Lindemann, Nicola Paoletti · 2025
Read Conformal Predictive Monitoring for Multi-Modal Scenarios by Francesca Cairoli, Luca Bortolussi, Jyotirmoy V. Deshmukh, Lars Lindemann, Nicola Paoletti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01338.txt.
Introduction
Systems that move through the world in several distinct modes, such as a drone that may hover or dash, are hard to monitor with one prediction range. Francesca Cairoli, with four co-authors, studies runtime forecasting of whether a system will meet a stated temporal logic property, a formal rule about its behavior over time. Fast learned stand-ins give prediction ranges with statistical guarantees, but ignoring modes makes those ranges too wide.
Their method, GenQPM, uses score-based diffusion models, a class of generative models, to capture the system's multi-modal dynamics faithfully. Separate ranges can then reflect each mode's likely satisfaction level, instead of one blurred average. Cairoli and the team aim for timely warnings against predicted rule violations, with ranges sharp enough to guide real intervention rather than blanket caution.
Catalog record
| CREATOR | Francesca Cairoli, Luca Bortolussi, Jyotirmoy V. Deshmukh, Lars Lindemann, Nicola Paoletti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01338
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conformal Predictive Monitoring for Multi-Modal Scenarios Francesca Cairoli, Luca Bortolussi, Jyotirmoy V. Deshmukh, Lars Lindemann, Nicola Paoletti Abstract We consider the problem of quantitative predictive monitoring (QPM) of stochastic systems, i.e., predicting at runtime the degree of satisfaction of a desired temporal logic property from the current state of the system. Since computational efficiency is key to enable timely intervention against predicted violations, several state-of-the-art QPM approaches rely on fast machine-learning surrogates to provide prediction intervals for the satisfaction values, using conformal inference to offer statistical guarantees. However, these QPM methods suffer when the monitored agent exhibits multi-modal dynamics, whereby certain modes may yield high satisfaction values while others critically violate the property. Existing QPM methods are mode-agnostic and so would yield overly conservative and uninformative intervals that lack meaningful mode-specific satisfaction information. To address this problem, we present GenQPM, a method that leverages deep generative models, specifically score-based diffusion models, to reliably approximate the probabilistic and multi-modal system dynamics without requiring explicit model access. GenQPM employs a mode classifier to partition the predicted trajectories by dynamical mode. For each mode, we then apply conformal inference to produce statistically valid, mode-specific prediction intervals. We demonstrate the effectiveness of GenQPM on a benchmark of agent navigation and autonomous driving tasks, resulting in prediction intervals that are significantly more informative (less conservative) than mode-agnostic baselines. 1 INTRODUCTION Predictive monitoring is an advanced form of runtime verification that leverages forecasts of a system’s future behavior to detect safety violations before they occur. Traditional runtime verification checks whether a system trace satisfies a temporal logic property in real time but only considers the observed prefix of the trajectory, i.e., it cannot reason about possible future evolutions of the system [ 19 ] . In contrast, predictive monitoring incorporates a model of system dynamics to predict future trajectories and assess, in an online manner, whether a violation is imminent from the current state, thereby enabling preemptive and timely safety interventions. This paper focuses on predictive monitoring for stochastic systems , where future behavior is inherently uncertain. In such systems, the satisfaction of temporal logic specifications becomes a stochastic quantity (some evolutions can be safe, others unsafe). Although probabilistic model checking (PMC) [ 2 ] can provide exact satisfaction probabilities, it requires full knowledge of the system model and becomes intractable for large or continuous state spaces. Statistical Model Checking (SMC) [ 34 ] alleviates some of these problems by estimating satisfaction probabilities from sampled trajectories, but it must be run at each state during execution. This makes both PMC and SMC impractical for online predictive monitoring. In particular, we focus on correctness specifications given as Signal Temporal Logic (STL) formulas [ 23 , 14 ] and on monitoring STL robustness, i.e., the logic’s quantitative semantics indicating the degree of satisfaction of an STL formula by a trajectory. We call this problem Quantitative Predictive Monitoring (QPM) . Our work builds on recent QPM methods [ 12 , 21 , 36 , 10 ] , which rely on machine-learning models for trajectory predictions and employ the conformal prediction framework [ 32 , 1 ] to produce prediction intervals for STL robustness with guaranteed coverage. However, these methods fail to provide useful results in scenarios with multi-modal dynamics . Figure 1: Left: Vehicle facing multiple possible choices. Right: Distribution of the robustness values of these choices/modalities w.r.t. an STL safety requirement. Bottom-right: uninformative mode-agnostic prediction interval vs informative mode-specific intervals. The main concern in this paper is the predictive monitoring of multi-modal systems, i.e., systems that can evolve along qualitatively different future behaviors (or “modes”). For instance, consider the example in Fig. 1 -left, where we see an autonomous vehicle approaching an intersection. The vehicle might turn left, turn right, or go straight — each representing a distinct mode. The first two modes lead to safe scenarios, i.e., scenarios that satisfy the safety requirements (positive STL robustness), whereas the latter mode violates safety/traffic rules (negative STL robustness). Fig. 1 -right highlights the multi-modal distribution of STL robustness values in such an environment. In such settings, the above-mentioned methods would fail to capture the impact of different modes. So, they would produce overly conservative regions that cover a broad range of outcomes, losing valuable information about which modes are safe or unsafe. To address this limitation, our goal is to develop a predictive monitor that can quantify the mode-specific satisfaction of STL requirements. That is, rather than providing a single large prediction interval over possible robustness values, we aim to produce separate prediction intervals for each mode, offering insights into which modes are likely to lead to violations or satisfaction, thus enhancing the decision-making process of the agent. To this purpose, we propose GenQPM , a novel dynamics-aware quantitative predictive monitor that leverages deep generative models and conformal inference to provide reliable and mode-specific prediction intervals. First, we use score-based diffusion models [ 16 ] , a class of state-of-the-art generative models, to learn a probabilistic surrogate of the stochastic system dynamics and generate possible future trajectories. Second, we partition these trajectories into distinct dynamical modes using a mode classifier , which may be known or learned from data (in either a supervised or unsupervised fashion). For each mode, we estimate the distribution of STL robustness values and compute prediction intervals by applying conformalized quantile regression (CQR) [ 26 ] . Doing so, our approach ensures statistically valid coverage, even if the generative surrogate model is approximate. In summary, the main contributions of this paper are: 1. We introduce GenQPM, a method that combines diffusion models with conformal inference to enable STL predictive monitoring for multi-modal stochastic systems. 2. GenQPM provides probabilistic guarantees and supports both known and learned mode predictors. 3. We evaluate GenQPM on four case studies, including a 2D navigation task and a multi-agent cross-road scenario. Our method yields mode-specific robustness intervals that are more interpretable and substantially tighter than mode-agnostic QPM baselines. 2 PROBLEM STATEMENT Stochastic Process. We consider systems that can be described as stochastic processes (as in [ 12 ] ), defined by a collection of random variables {\mathbf{S}(i,\omega)}_{i\in\mathcal{I},\omega\in\Omega} over a probability space (\Omega,\mathcal{F},\mathbb{P}) . Here, \Omega is the sample space (all possible outcomes), \mathcal{F} is the event space (all subsets of \Omega ), and \mathbb{P} is the probability function, assigning each event a value in [0,1] . \mathcal{I}={0,1,\ldots} is a discrete-time index set, and each \mathbf{S}(i,\omega) maps to a measurable state space S\subseteq\mathbb{R}^{n} . A realization \mathbf{S}(\cdot,\omega):\mathcal{I}\rightarrow S is a sample trajectory. For a horizon H , \vec{s} denotes a realization of the random sequence \vec{\mathbf{S}}=(\mathbf{S}(0,\cdot),\ldots,\mathbf{S}(H-1,\cdot)) , where \mathbf{S}(k,\cdot) is the state – a random variable – at time k . Signal Temporal Logic (STL). STL [ 23 , 14 ] specifies properties of real-valued signals via the syntax: \phi:=\mathit{true}\ |\ \mu\ |\ \neg\phi\ |\ \phi\land\phi\ |\ \phi\ U_{I}\ \phi , where predicates \mu\equiv g(\cdot)>0 are evaluated based on a predicate function g:S\to\mathbb{R} and where I=[a,b]\subseteq\mathbb{T} are time intervals. Derived operators include \mathit{false} , \lor , F_{I}\phi (eventually), and G_{I}\phi (globally). The Boolean semantics is defined as follows: \displaystyle(\vec{s},t)\models\mu \displaystyle\Leftrightarrow \displaystyle\hskip 8.61108ptg(\vec{s}(t))>0\vskip 1.4457pt \displaystyle(\vec{s},t)\models\neg\phi \displaystyle\Leftrightarrow \displaystyle\hskip 8.61108pt\neg((\vec{s},t)\models\phi)\vskip 1.4457pt \displaystyle(\vec{s},t)\models\phi_{1}\wedge\phi_{2} \displaystyle\Leftrightarrow \displaystyle\hskip 8.61108pt(\vec{s},t)\models\phi_{1}\wedge(\vec{s},t)\models\phi_{2}\vskip 1.4457pt \displaystyle(\vec{s},t)\models\phi_{1}U_{[a,b]}\phi_{2} \displaystyle\Leftrightarrow \displaystyle\hskip 8.61108pt\exists\ t^{\prime}\in[t+a,t+b]\ \text{s.t.}\ (\vec{s},t^{\prime})\models\phi_{2}\ \forall\;t^{\prime\prime}\in[t,t^{\prime}],\ (\vec{s},t^{\prime\prime})\models\phi_{1}