Quattro: T ransformer-Accelerated Iterative Linear Qua dratic R egulator Framework for Fast T rajectory O ptimization
Yue Wang, Haoyu Wang, Zhaoxing Li · 2025
Read Quattro: T ransformer-Accelerated Iterative Linear Qua dratic R egulator Framework for Fast T rajectory O ptimization by Yue Wang, Haoyu Wang, Zhaoxing Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01806.txt.
Introduction
Yue Wang, Haoyu Wang, and Zhaoxing Li present Quattro, a faster control framework for robots, in a paper from 2025. Robots must plan smooth paths in real time, even when their motion is complex. A classic method, called iLQR, works step by step in order, which makes it slow.
Past parallel versions needed extra rounds of math and strong hardware for small gains. Quattro uses a transformer model to predict key matrices ahead of time. That lets the steps run in parallel on modest devices. The design pairs the algorithm with the hardware it runs on. Fast path planning could help small robots react in tight, changing settings.
Catalog record
| CREATOR | Yue Wang, Haoyu Wang, Zhaoxing Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01806
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quattro: T ransformer-Accelerated Iterative Linear Qua dratic R egulator Framework for Fast T rajectory O ptimization Yue Wang, Haoyu Wang, Zhaoxing Li Abstract Real-time optimal control remains a fundamental challenge in robotics, especially for nonlinear systems with stringent performance requirements. As one of the representative trajectory optimization algorithms, the iterative Linear Quadratic Regulator (iLQR) faces limitations due to their inherently sequential computational nature, which restricts the efficiency and applicability of real-time control for robotic systems. While existing parallel implementations aim to overcome the above limitations, they typically demand additional computational iterations and high-performance hardware, leading to only modest practical improvements. In this paper, we introduce Quattro, a transformer-accelerated iLQR framework employing an algorithm-hardware co-design strategy to predict intermediate feedback and feedforward matrices. It facilitates effective parallel computations on resource-constrained devices without sacrificing accuracy. Experiments on cart-pole and quadrotor systems show an algorithm-level acceleration of up to 5.3 × \times and 27 × \times per iteration, respectively. When integrated into a Model Predictive Control (MPC) framework, Quattro achieves overall speedups of 2.8 × \times for the cart-pole and 17.8 × \times for the quadrotor compared to the one that applies traditional iLQR. Transformer inference is deployed on FPGA to maximize performance, achieving further up to 20.8 × \times speedup over prevalent embedded CPUs with over 11 × \times power reduction than GPU and low hardware resource overhead. I INTRODUCTION Model Predictive Control (MPC) is widely used in robotics for trajectory optimization and computes optimal control inputs over future time steps [ 1 , 2 , 3 , 4 ] . However, real-time performance in nonlinear settings often demands heavy computational resources [ 5 ] . Differential Dynamic Programming (DDP) was reinvented in [ 6 , 7 ] , along with its iterative linear quadratic regulator (iLQR) variant, and is now widely used in robot control [ 8 , 9 , 10 , 11 ] . Despite its strengths, iLQR still relies on a sequential pipeline that heavily demands processor clock frequency [ 12 ] . Meanwhile, deep learning (DL) offers massive parallelism [ 13 ] and high-performance inference [ 14 ] , which makes it well suited to address iLQR’s bottleneck. Yet, few works have combined DL with iLQR. This gap highlights an exciting path for faster, more efficient optimal control. Although iLQR applies a Gauss-Newton approximation to linearize system dynamics, making it a more efficient but less accurate variant of DDP, it remains inherently sequential and cannot leverage multi-core computing. Multiple-shooting methods split the problem into segments [ 15 , 16 ] , using multi-core CPUs or GPUs [ 17 , 18 ] , but introduce extra terms to handle defects between segments [ 19 ] . This typically requires more iterations to converge, reducing overall efficiency [ 12 ] . Deep learning (DL) methods have emerged as a way to address these challenges. For example, [ 20 ] uses a neural network to approximate iLQR outputs and speed up computation, but the network does not capture key sequential dependencies and produces less reliable results. Transformers have also appeared in trajectory optimization, especially in MPC. Celestini et al. apply transformer-based models to generate near-optimal initial guesses, improving convergence and lowering computational cost [ 21 ] . Zinage et al. propose TransformerMPC, which predicts inactive constraints and refines initialization [ 22 ] . Although these works show promise in MPC, transformer architectures remain underexplored in iLQR. This gap presents an opportunity to better model sequential dependencies and accelerate iLQR-based control. Deep learning has advanced rapidly over the past two decades, yielding powerful architectures for sequential data. Recurrent Neural Networks (RNNs) [ 23 ] and Long Short-Term Memory (LSTM) networks [ 24 ] have proven effective in many temporal tasks, but often struggle with vanishing or exploding gradients when modeling long-range dependencies [ 25 ] . Transformers [ 26 , 27 , 28 ] avoid these issues by using self-attention, which captures extended context without the strictly sequential updates of RNNs or LSTMs [ 29 ] . This design aligns well with the iterative structure of iLQR. A prime example of Transformer’s potential in high-temporal tasks is Nvidia’s Deep Learning Super Sampling (DLSS), where a transformer-based approach reconstructs high-fidelity gaming frames at higher frame rates [ 30 ] . This success directly motivates our pursuit of Transformer-driven iLQR solutions. Moreover, recent advances in deep learning accelerators enable efficient parallelization of Transformer architectures [ 31 , 32 , 33 ] , paving the way for real-time, high-performance control applications. Fig. 1 : Comparison of standard (Vanilla) iLQR and transformer-accelerated iLQR Framework. The red-shaded area represents the standard iLQR computation process. The blue-shaded area illustrates the proposed Quattro. To address the sequential nature of iLQR computations and overcome inefficiencies in existing parallelization methods, we introduce Quattro 7 7 7 Our framework is open-sourced and available at: https://github.com/YueWang996/quattro-transformer-ilqr (Figure 1 ), an iLQR framework that uses a Transformer model to generate the feedback and feedforward terms. By producing these intermediate values in parallel, Quattro reduces computation time while preserving accuracy. We validate the approach on a cart-pole [ 34 ] and quadrotor [ 35 ] control problems, demonstrating the effectiveness of the framework. Furthermore, an FPGA-based implementation reveals substantial performance gains, underscoring Quattro’s potential for real-time applications. The contributions of this paper are as follows: 1. We introduce Quattro , a deep acceleration framework for iLQR, intrinsically accelerated by a customized Transformer model. It significantly enhances computational efficiency through parallel computation and immediate inference compensation. 2. We validate the performance of Quattro on cart-pole and quadrotor systems on a variety of computation platforms, achieving remarkable acceleration and comparative accuracy to traditional iLQR. 3. We use the latest accelerator design framework [ 36 ] to implement the customized Transformer kernel on FPGA, achieving an optimal balance between performance, power, and hardware overhead. To our knowledge, it is the first deployment of a Transformer model on FPGA specifically for iLQR optimization. The remainder of this paper is organized as follows: we first introduce the background of the problem in Section II , followed by the details of the proposed framework in Section III . Experiments and results are presented in Section IV , and the paper concludes with Section V . II PRELIMINARIES II-A System Dynamics A system dynamics, or system model, describes how the state of a system changes with a given system input. The model can be defined in a discrete-time differential equation x_{i+1}=f(x_{i},u_{i}), (1) where x_{i} and u_{i} represent the state and control input at time step i , respectively. A cost function can be defined to evaluate the performance of the state and input of the system over the next N steps: J(X,U)=\sum_{i=0}^{N-1}l(x_{i},u_{i})+l_{N}(x_{N}), (2) where l(x_{i},u_{i}) is the running cost and l_{N}(x_{N}) is the terminal cost. Here, X:=\{x_{0},x_{1},\cdots,x_{N}\} denotes the state trajectory and U:=\{u_{0},u_{1},\cdots,u_{N-1}\} denotes the input trajectory. We can define an optimal control problem for solving the optimal U and corresponding X such that J(X,U) is minimized: \displaystyle\min_{X,U} \displaystyle J(X,U) (3) \displaystyle\textrm{s.t.} \displaystyle x_{i+1}=f(x_{i},u_{i}),\quad\text{given }x_{0},U_{0}. II-B Iterative Linear Quadratic Regulator The iterative Linear Quadratic Regulator (iLQR) algorithm addresses nonlinear optimal control problems by repeatedly approximating the dynamics and cost around a nominal trajectory. At each iteration, the system dynamics are linearized, and