The Trajectory Bundle Method: Unifying Sequential-Convex Programming and Sampling-Based Trajectory Optimization

Kevin Tracy, John Z. Zhang, Jon Arrizabalaga, Stefan Schaal, Yuval Tassa, Tom Erez, Zachary Manchester · 2025

Read The Trajectory Bundle Method: Unifying Sequential-Convex Programming and Sampling-Based Trajectory Optimization by Kevin Tracy, John Z. Zhang, Jon Arrizabalaga, Stefan Schaal, Yuval Tassa, Tom Erez, Zachary Manchester (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26575.txt.

Introduction

Kevin Tracy and co-authors present the Trajectory Bundle Method, a derivative-free way to plan motion that unifies two established families of solvers, in a 2025 paper. Classic sequential convex programming needs derivatives, which can be costly or unavailable. Sampling-based methods skip derivatives but give up features like multiple shooting and general constraints.

Their framework builds each convex approximation from samples of the dynamics, cost, and constraint functions, letting the solver interpolate between them. A popular sampling controller falls out as a special case. The authors argue the result is simple, flexible, and suited to a wide range of practical planning and control problems.

Catalog record

CREATORKevin Tracy, John Z. Zhang, Jon Arrizabalaga, Stefan Schaal, Yuval Tassa, Tom Erez, Zachary Manchester
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-26575

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Trajectory Bundle Method: Unifying Sequential-Convex Programming and Sampling-Based Trajectory Optimization Kevin Tracy, John Z. Zhang, Jon Arrizabalaga, Stefan Schaal, Yuval Tassa, Tom Erez, Zachary Manchester Abstract We present a unified framework for solving trajectory optimization problems in a derivative-free manner through the use of sequential convex programming. Traditionally, nonconvex optimization problems are solved by forming and solving a sequence of convex optimization problems, where the cost and constraint functions are approximated locally through Taylor series expansions. This presents a challenge for functions where differentiation is expensive or unavailable. In this work, we present a derivative-free approach to form these convex approximations by computing samples of the dynamics, cost, and constraint functions and letting the solver interpolate between them. Our framework includes sample-based trajectory optimization techniques like model-predictive path integral (MPPI) control as a special case and generalizes them to enable features like multiple shooting and general equality and inequality constraints that are traditionally associated with derivative-based sequential convex programming methods. The resulting framework is simple, flexible, and capable of solving a wide variety of practical motion planning and control problems. I Introduction Linear dynamical systems of the form x_{+}=Ax+Bu underpin many of the foundational methods in modern optimal control. Ideas such as the Linear-Quadratic Regulator (LQR) and convex trajectory optimization can reason about dynamical systems of this form in a way that is globally optimal [ 25 , 10 , 11 ] . As a result, these techniques are often applied to nonlinear systems where the dynamics are locally approximated as linear around a linearization point [ 41 ] . In many cases, this approximation is appropriate given the function is not being evaluated too far from where the approximation was formed. When used appropriately, this method of linearizing nonlinear systems can be extremely effective in practice, even for highly nonlinear systems. The two caveats here are that the nonlinear system must be both smooth and differentiable. For many systems, such as robotic arms, quadrotors, and wheeled vehicles, this assumption of smooth differentiability is reasonable. For rigid-body dynamics, there are specialized methods for computing derivatives of the continuous-time dynamics in a fast and efficient way [ 18 ] . However, for more complex dynamics models, there are scenarios where these derivatives are unavailable, prohibitively expensive to compute, or unreliable. If the dynamics model is learned from data, the approximation of the dynamics function may be good, while the approximation of the derivatives may be very poor. This scenario is often explored in the context of model-predictive path-integral (MPPI) control, where a learned simulator is only used to produce parallelized simulations [ 51 , 49 ] . Another scenario in which derivatives are unavailable or unusable is in the presence of systems that make or break contact. While there has been a lot of recent interest in making contact simulation differentiable [ 19 , 36 , 38 , 47 , 42 , 24 ] , there remains a strong need for optimal control methods that do not rely on these derivatives at all. Fig. 1 : The Trajectory Bundle Method (TBM) is a derivative-free framework capable of solving both single-shooting sampling-based MPC problems and general multiple-shooting trajectory optimization problems. TBM finds the optimal state and control sequences (bolded black trajectory) by computing samples (colored points) at each knot point ( t s) around the current solution and using convex optimization to linearly interpolate between the samples (dark gray regions). A recent trend in robotic simulation is the introduction of simulators that can be run on accelerators for massively parallel simulation. Popular simulators like Isaac Sim [ 32 , 35 ] , Brax [ 19 ] , and MuJoCo XLA (MJX) [ 46 ] , are all capable of running thousands of simulations in parallel. This paper leverages the innovations in parallel simulation to motivate a new derivative-free optimal control paradigm where simulation rollouts are used to fully describe the dynamics and cost landscapes present in the problem. We introduce the trajectory bundle method for solving nonconvex trajectory optimization problems, which uses interpolated trajectories instead of derivative-based linearizations to approximate the cost, dynamics, and constraint functions in the problem. The result is a simple and robust trajectory optimization framework that can fully utilize parallelized simulation without requiring any derivatives. Our specific contributions in this paper are the following: • A unified framework, which we refer to as the trajectory bundle method, for solving general trajectory optimization problems using derivative-free sequential-convex programming. • A method for approximating general nonlinear or non-convex cost and constraint functions through sampling and linear interpolation. • A set of numerical experiments demonstrating the effectiveness of the trajectory bundle method and its equivalence to its SCP and MPPI counterparts. The remainder of the paper is organized as follows: we first review related literature on derivative-free optimization, sequential-convex programming, and MPPI in Section II . Next, we introduce relevant background on affine function approximation and its application to constrained optimization in Section III . In Section IV , we describe the trajectory bundle method in a general multiple-shooting framework and a single-shooting special case that is equivalent to MPPI. Finally, we present an array of numerical experiments in Section V and point avenues of future research in VI . II Related Work In order to contextualize the trajectory bundle method, this section provides brief overviews of derivative-free optimization, trajectory optimization through sequential convex programming, and model predictive path integral control. II-A Derivative-Free Optimization Derivative-Free Optimization (DFO) is a well-studied technique for solving optimization problems where derivatives are unavailable. John Dennis describes the DFO problem in [ 40 ] as “finding the deepest point of a muddy lake, given a boat and a plumb line, when there is a price to be paid for each sounding.” With modern accelerators capable of massively parallel dynamics, cost, and constraint evaluation, there is still a price to take soundings, but we can now “buy in bulk.” In a seminal 1965 paper, the Nelder-Mead method for derivative-free function minimization was proposed, where a simplex of sample points is used to approximate the cost landscape instead of derivatives. Methods like Mesh Adaptive Direct Search (MADS) [ 5 ] and NOMAD [ 29 , 6 ] followed with improvements to the Nelder-Mead method. Although there has been much work on general DFO [ 14 , 27 , 15 ] , there are two notably similar approaches to the trajectory bundle method. The first is the Constrained Optimization by Linear Interpolation (COBYLA) solver, where the cost and constraint functions are approximated with linear interpolation [ 40 ] , and the second is the Gauss-Newton method of [ 12 ] , where samples are used for linear interpolation. The trajectory bundle method builds on these two methods and specializes to trajectory optimization problems where the decision variables at different time steps are only coupled via the dynamics constraints. By exploiting this problem-specific structure and massively parallel simulation, the trajectory bundle method is a simple and robust method for solving trajectory optimization problems to tight constraint and optimality tolerances. II-B Trajectory Optimization through Sequential-Convex Programming Trajectory optimization provides a rigorous and powerful mathematical framework for solving general optimal control problems as nonlinear programs. The cost and constraint functions can

Read the complete text