Certified Guidance for Planning with Deep Generative Models

Francesco Giacomarra, Mehran Hosseini, Nicola Paoletti, Francesca Cairoli · 2025

Read Certified Guidance for Planning with Deep Generative Models by Francesco Giacomarra, Mehran Hosseini, Nicola Paoletti, Francesca Cairoli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12815.txt.

Introduction

Francesco Giacomarra and co-authors add guarantees to guided planning with generative models in this 2025 paper. Diffusion and adversarial models can draft plans and behaviors for autonomous systems. Guidance tricks steer their output toward set goals without retraining.

Those tricks, though, promise nothing about the final plan. The team introduce certified guidance, which reshapes a model so its outputs must meet a stated spec. The change is made without training the model again. Planners can then trust that generated behavior stays within bounds. This matters where failure is costly, such as robots or vehicles. The method bridges creative generation and the strict needs of safety checks.

Catalog record

CREATORFrancesco Giacomarra, Mehran Hosseini, Nicola Paoletti, Francesca Cairoli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12815

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Certified Guidance for Planning with Deep Generative Models Francesco Giacomarra, Mehran Hosseini, Nicola Paoletti, Francesca Cairoli Abstract . Deep generative models, such as generative adversarial networks (GANs) and score-based diffusion models, have recently emerged as powerful tools for planning tasks and behavior synthesis in autonomous systems. Various guidance strategies have been introduced to steer the generative process toward outputs that are more likely to satisfy the planning objectives. These strategies avoid the need for model retraining but do not provide any guarantee that the generated outputs will satisfy the desired planning objectives. To address this limitation, we introduce certified guidance , an approach that modifies a generative model – without retraining it – into a new model guaranteed to satisfy a given specification with probability 1 1 . We focus on Signal Temporal Logic (STL) specifications, which are rich enough to describe non-trivial planning tasks. Our approach leverages neural network verification techniques to systematically explore the generative models’ latent spaces, identifying latent regions that are certifiably correct w.r.t. the STL property of interest. We evaluate the effectiveness of our method on four planning benchmarks using GANs and diffusion models. Our results confirm that certified guidance produces generative models that are always correct, unlike existing (non-certified) guidance methods. A. El Fallah Seghrouchni, Y. Vorobeychik, S. Das, A. Nowe (eds.) Conference: Proc. of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025); May 19 – 23, 2025; Detroit, Michigan, USA <<968>> 1. INTRODUCTION Deep generative models (DMG) have become increasingly powerful and popular for tasks like data augmentation, planning, and behaviour synthesis. These models operate by transforming a standard distribution over a latent space into a more complex distribution over the target space, allowing for efficient sampling of high-dimensional data. Notable examples of state-of-the-art DGMs include Generative Adversarial Networks (GANs), Variational Autoencoders, and Score-based Diffusion Models. A key advantage of DGMs is their ability to generate samples that meet desired criteria, e.g., a planning task specification, without explicitly encoding these constraints or retraining the model. This is achieved by so-called guidance strategies , which use a differentiable reward function to express the desired conditions and guide the generative process by optimizing the gradient of this reward. This technique parallels guided sampling, reinforcement learning, and planning algorithms, offering scalability, task composability, and effective non-greedy planning solutions ( Janner et al., 2022a ) . Despite these advantages, guidance strategies are inherently limited by their inability to guarantee that the generated outputs will satisfy the desired constraints. When a requirement is unfeasible, the model may be pushed outside the data manifold, resulting in random or unreliable outputs that only coincidentally meet the specified conditions. This lack of robustness presents a significant challenge when using DGMs in safety-critical planning tasks. To address these limitations, we introduce certified guidance , a method that constrains the latent space of a DGM to ensure that generated samples always satisfy a given specification while preserving the relative likelihood of the original latent inputs. Certified guidance modifies the generative model, without retraining it, into a new model guaranteed to satisfy the specification with probability 1 . To do so, our method leverages neural network verification techniques to identify regions in the latent space of the DGM that are guaranteed to satisfy the specification. In particular, we consider specifications expressed in Signal Temporal Logic (STL) ( Maler and Nickovic, 2004 ) , which provides a powerful formalism for defining complex temporal requirements, including planning tasks. In particular, our method uses STL both as a certification mechanism and as a differentiable reward function for guiding the generative process. To our knowledge, certified guidance is the first method to combine neural network verification with deep generative models to certify temporal logic properties. We demonstrate the effectiveness of certified guidance on four planning tasks, showing that our approach can certify both GAN and diffusion models and provide stronger correctness guarantees than existing (gradient-based) guidance methods, while providing samples representative of the original DGM distribution. Related Work Generative Models for Planning. Generative models, particularly those based on diffusion models, have gained popularity recently. For instance, Janner et al. (2022b) introduced diffuser for flexible behaviour synthesis using a denoising diffusion probabilistic model, whereby diffusers plan by iteratively refining randomly sampled noise. Decision diffusers ( Ajay et al., 2023 ) are another popular approach where guidance is implemented by conditioning instead of latent space search. Dong et al. (2024) put forward DiffuserLite, which employs a planning refinement process to generate fine-grained trajectories by reducing the modelling of redundant information and increasing the decision-making frequency. Verification of Probabilistic Models. Closely related is the literature on single-step verification of probabilistic models. For instance, ( Wicker et al., 2020 ; Batten et al., 2024 ) on verification of Bayesian neural network. Specifically, we will use the pure and gradient-guided iterative expansion approach from ( Batten et al., 2024 ) to search the latent space of the generative model. Safety of Planners. Most of the literature in this line of research focuses on the verification of sequential decision-making, where the decisions are usually made iteratively ( Orthey et al., 2024 ) using feedforward ( Akintunde et al., 2022 ) , recurrent ( Hosseini and Lomuscio, 2023 ) , or Bayesian neural networks ( Wicker et al., 2024 ) . However, the safety verification of planners, especially those based on generative models, is an emerging line of research. Notably Xiao et al. (2023) introduced SafeDiffuser, which ensures diffusion probabilistic models satisfy specifications using a class of control barrier functions. Other work similar work include ( Sun et al., 2023 ; Cairoli et al., 2023 ; Kuipers et al., 2024 ; Lindemann et al., 2023 ) , which use conformal prediction for uncertainty-aware planning. Nonetheless, to the best of our knowledge, the work presented here is the first to specifically study the safety verification of generative models for planning. closest to this work is ( Katz et al., 2022 ) , which considers the verification of image-based neural network-based controllers, and to achieve this, it uses generative models for reducing the input dimension of such controllers. Nonetheless, this work does not consider the problem of verifying generative planners itself. 2. BACKGROUND This section presents the key concepts needed to better understand the method detailed in Sections 3 and 4 . 2.1. Signal Temporal Logic (STL) Signal temporal logic (STL) ( Maler and Nickovic, 2004 ) is a formal language for specifying and monitoring the behaviour of physical systems, including temporal constraints between events. STL allows reasoning about dense-time, real-valued signals \vec{\mathbf{s}}:\mathbb{T}\rightarrow S , where \mathbb{T} is the (continuous) time domain and S\subseteq\mathbb{R}^{n} is the signal’s space. It does so by mapping \vec{\mathbf{s}} into a Boolean signal using atomic predicates of the form \mu_{g}\equiv(g(\vec{\mathbf{s}}(t))>0) where g:S\rightarrow\mathbb{R} . STL properties are defined by the following syntax: (1) \varphi:=\mathit{true}\ |\ \mu_{g}\ |\ \neg\varphi\ |\ \varphi\land\varphi\ |\ \varphi\ \mathcal{U}_{[a,b]}\varphi, where [a,b]\subseteq\mathbb{T} is a bounded temporal interval. The until operator \varphi_{1}\ \mathcal{U}_{[a,b]}\varphi_{2} asserts that \varphi_{1} must hold continuously until \varphi_{2} becomes true at some point in the future. From this essential syntax, we can define as usual other operators as follows: false:=\neg true , \varphi\lor\psi:=\neg(\neg\varphi\land\neg\psi) , \Diamond_{[a,b]}\varphi:=true\ \mathcal{U}_{[a,b]}\varphi and \square_{[a,b]}\varphi:=\neg\Diamond_{[a,b]}\neg\varphi , where \Diamond_{[a,b]}\varphi and \square_{[a,b]}\varphi denote

Read the complete text