STL-SVPIO: Signal Temporal Logic guided Stein Variational Path Integral Optimization
Hongrui Zheng, Zirui Zang, Ahmad Amine, Cristian Ioan Vasile, Rahul Mangharam · 2026
Read STL-SVPIO: Signal Temporal Logic guided Stein Variational Path Integral Optimization by Hongrui Zheng, Zirui Zang, Ahmad Amine, Cristian Ioan Vasile, Rahul Mangharam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13333.txt.
Introduction
Hongrui Zheng and co-authors introduce STL-SVPIO for robot task planning under formal rules. Signal Temporal Logic states complex spatiotemporal constraints, but turning them into long control paths is hard. Solver methods scale poorly, and sampling methods face sparse, long-horizon costs. STL-SVPIO treats STL as a differentiable reward-shaping signal that guides the whole search. Stein Variational Gradient Descent moves a swarm of control particles toward high robustness zones. The method beat rivals on classic tasks and solved multi-agent coordination jobs that broke baselines.
Catalog record
| CREATOR | Hongrui Zheng, Zirui Zang, Ahmad Amine, Cristian Ioan Vasile, Rahul Mangharam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39498 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13333
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STL-SVPIO: Signal Temporal Logic guided Stein Variational Path Integral Optimization Hongrui Zheng, Zirui Zang, Ahmad Amine, Cristian Ioan Vasile, Rahul Mangharam Abstract Signal Temporal Logic (STL) enables formal specification of complex spatiotemporal constraints for robotic task planning. However, synthesizing long-horizon continuous control trajectories from complex STL specifications is fundamentally challenging due to the nested structure of STL robustness objectives. Existing solver-based methods, such as Mixed-Integer Linear Programming (MILP), suffer from exponential scaling, whereas sampling methods, such as Model-Predictive Path Integral control (MPPI), struggle with sparse, long-horizon costs. We introduce Signal Temporal Logic guided Stein Variational Path Integral Optimization (STL-SVPIO), which reframes STL as a globally informative, differentiable reward-shaping mechanism. By leveraging Stein Variational Gradient Descent and differentiable physics engines, STL-SVPIO transports a mutually repulsive swarm of control particles toward high robustness regions. Our method transforms sparse logical satisfaction into tractable variational inference, mitigating the severe local minima traps of standard gradient-based methods. We demonstrate that STL-SVPIO significantly outperforms existing methods in both robustness and efficiency for traditional STL tasks. Moreover, it solves complex long-horizon tasks, including multi-agent coordination with synchronization and queuing while baselines either fail to discover feasible solutions, or become computationally intractable. Finally, we use STL-SVPIO in agile robotic motion planning tasks with nonlinear dynamics, such as 7-DoF manipulation and half cheetah back flips to show the generalizability of our algorithm. I Introduction Modern robotic and autonomous systems, including multi-agent teams, high-dimensional manipulators, and humanoids, are increasingly required to execute temporally extended and complex behaviors. In reinforcement learning, these objectives are typically encoded through meticulously designed reward functions [ 29 ] . However, for tasks with rich temporal structures, rewards are often challenging to engineer, resulting in sparse and delayed feedback that exacerbates temporal credit assignment and yields brittle solutions [ 29 , 1 ] . Although recent advances in reward design via LLMs [ 19 ] show impressive results in dexterous manipulation and locomotion tasks, their applicability to long-horizon planning problems with explicit temporal-logic constraints is currently unclear. On the other hand, Signal Temporal Logic (STL) provides a mathematically rigorous and expressive specification language for complex spatiotemporal task requirements in continuous systems [ 9 , 8 ] . In contrast to reward-based formulations, positive STL robustness directly certifies task satisfaction. Despite its expressiveness, synthesizing continuous high-dimensional control trajectories that satisfy STL specifications remains a notoriously difficult open problem. As the planning horizon increases, the feasible solution set induced by conjunction-heavy, deadline-constrained STL often shrinks drastically, resulting in severe optimization difficulties [ 8 , 26 ] . Even when the problem is feasible, the size of the optimization problem in traditional STL solvers (e.g. MILP) grows exponentially with specification complexity in the worst case, often rendering them computationally intractable for realistic robotic systems [ 26 , 15 ] . The overarching goal of this paper is to enable tractable, continuous control for highly complex spatiotemporal tasks by synergizing SVGD and STL: leveraging STL for expressive, differentiable reward shaping, while utilizing SVGD to navigate the multi-modal optimization landscapes. Our contributions in this paper are threefold: 1. We introduce STL-SVPIO, a variational inference framework for long-horizon task and motion planning. We provide a principled derivation of the resulting inference formulation. 2. We show that STL specifications can be effectively used as a differentiable shaping signal for motion planning, extending their applicability to agile robotic behaviors without relying on handcrafted rewards. 3. We analyze how particle-based variational inference mitigates the non-convexity and multi-modality in cost induced by STL constraints, and demonstrate our method in task satisfaction. We showcase STL-SVPIO across a diverse set of tasks, including long-horizon navigation, multi-agent coordination with synchronization and ordering constraints, agile locomotion, and torque-controlled manipulation. The paper is organized as follows: in Section III , we introduce our variational inference problem; in Section IV , we introduce our proposed framework and how it modifies the original inference problem; and in Section V , we present simulation results on various benchmarks. II Related Work STL provides a quantitative robustness evaluation that indicates how strongly the specification is satisfied or violated [ 9 , 8 ] . Robot task and motion planning under STL specifications remains challenging. The existing literature on control synthesis under STL specifications can be broadly organized into three categories: Mixed Integer Linear Programming (MILP) yields exact solutions to STL specifications under chosen discretization and relaxations [ 2 , 26 ] , and has been widely applied to Model Predictive Control (MPC) [ 27 ] and multi-agent motion planning [ 28 , 4 ] . Although MILP solvers provide clean solutions to simple problems, they scale poorly with specification complexity. While improved encodings [ 15 ] and partial-satisfaction frameworks [ 6 ] mitigate this issue, MILP becomes intractable for highly non-linear systems and complicated collaborative tasks [ 2 ] . Gradient-based Optimization methods have been proposed to alleviate the computational burden associated with MILP-based solvers. Smooth approximations are proposed to enable gradient descent for control synthesis [ 25 , 22 ] . This concept was extended by STLCG [ 17 , 13 ] , which parses STL formulae into computation graphs and obtains the gradients via backpropagation. This facilitated the use of neural networks in STL planning [ 24 ] . However, they are susceptible to being trapped in local optima due to the non-convex landscape of STL robustness, severely limiting their practicality. Sampling-based Methods provide a probabilistic alternative for handling the non-convexity of STL specifications. Rapidly-Exploring Random Trees (RRT) are used to search for feasible trajectories under STL specifications [ 31 , 32 , 21 ] . These approaches either use STL fragments or impose strict constraints on the admissible sampling domain. Although effective in simple task requirements, these methods are not directly comparable to our proposed approach. Building on path integral control theory [ 14 , 33 ] , deterministic path integral optimization is used to directly minimize STL costs [ 11 ] . However, these sampling-based methods are fundamentally bottlenecked by the curse of dimensionality. As the planning horizon and task complexity increase, the probability of randomly sampling a valid sequence decays exponentially, making convergence increasingly unlikely in practice. Our work leverages Stein Variational Gradient Descent (SVGD) [ 18 ] . Unlike standard gradient descent, which can collapse to a single mode, SVGD maintains a diverse set of particles that approximate the target distribution. This method has been utilized in Stein Variational Model Predictive Control (SVMPC) [ 16 ] , which offers improved exploration capabilities compared to Model Predictive Path Integral (MPPI) control [ 33 ] . To the best of our knowledge, STL-SVPIO is the first framework to explicitly bridge differentiable STL with Stein Variational inference, using the logic’s gradient as a global guiding potential to solve the long-horizon sparse problem that poses significant challenges for existing approaches. III Problem Formulation III-A Preliminary: Signal Temporal Logic (STL) Syntax and Grammar: STL expresses spatiotemporal requirements over real-valued trajectories s [ 20 ] . In this work, we use STL formulae to describe the tasks assigned to agents. The syntax of STL is defined as \phi:=\top\mid\mu^{g}\mid\neg\phi\mid\phi_{1}\wedge\phi_{2}\mid\phi_{1}\,\mathbf{U}_{[t_{1},t_{2}]}\,\phi_{2}, (1) where \top is the truth value, \mu^{g}:=g(s(t))\geq 0 is an atomic predicate whose truth value is determined by the value of g:\mathbb{R}^{n}\rightarrow\mathbb{R} . Symbols \wedge and