Learning-Based MPC for Fuel Efficient Control of Autonomous Vehicles with Discrete Gear Selection

Samuel Mallick, Gianpietro Battocletti, Qizhang Dong, Azita Dabiri, Bart De Schutter · 2025

Read Learning-Based MPC for Fuel Efficient Control of Autonomous Vehicles with Discrete Gear Selection by Samuel Mallick, Gianpietro Battocletti, Qizhang Dong, Azita Dabiri, Bart De Schutter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11359.txt.

Introduction

Mallick and four co-authors wrote a twenty twenty-five study on how self-driving cars can save fuel. The cars must pick both a speed and a gear as they drive. Doing both at once in a smart control plan can cost too much time to run live.

The team trains a learned rule to pick and lock the gears for the plan ahead. The main control task then solves a much simpler task based on speed alone. In tests run in a computer, the new plan cuts the work by a large amount. Its fuel use stays close to the full joint plan.

Catalog record

CREATORSamuel Mallick, Gianpietro Battocletti, Qizhang Dong, Azita Dabiri, Bart De Schutter
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11359

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning-Based MPC for Fuel Efficient Control of Autonomous Vehicles with Discrete Gear Selection Samuel Mallick, Gianpietro Battocletti, Qizhang Dong, Azita Dabiri, Bart De Schutter Abstract Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle’s continuous dynamics and discrete gear positions may be too computationally intensive for a real-time implementation. This work proposes a learning-based MPC scheme to address this issue. A policy is trained to select and fix the gear positions across the prediction horizon of the MPC controller, leaving a significantly simpler continuous optimization problem to be solved online. In simulation, the proposed approach is shown to have a significantly lower computation burden and a comparable performance, with respect to pure MPC-based co-optimization. I INTRODUCTION For optimal control of autonomous vehicles (AVs), model predictive control (MPC) is a powerful and prevalent method [ 9 , 15 ] . In this context, co-optimization of an AV’s speed and gear-shift schedule is a promising approach to achieve high-performing and fuel-efficient autonomous driving; however, considering the gear-shift schedule requires the online solution of a mixed-integer nonlinear program (MINLP) [ 1 ] , for which the computational burden can be intensive. To address this issue the MINLP can be made easier to solve by relaxing the problem or by finding heuristic numerical solutions [ 11 , 5 ] . However, the relaxed problem can still be difficult to solve, and approximate solutions can be suboptimal. Alternatively, a decoupled approach can be used. In this case, first the speed is optimized, and next a gear-shift schedule is selected for the given speed using, e.g., a learning-based gear controller [ 14 ] , or dynamic programming [ 12 ] . However, decoupling speed control and gear control is suboptimal compared to the joint optimal control of both together. Finally, the computational burden can be alleviated by using a learning-based controller that controls both speed and gear-shift schedule in place of an MPC controller [ 7 ] ; however, in contrast to an MPC controller, a learning-based controller is not able to guarantee constraint satisfaction. In light of the above issues, this work presents a novel learning-based MPC controller for the co-optimization of speed and gear-shift schedule for an AV. Taking inspiration from [ 4 ] , a learned policy selects and fixes the gear positions across the prediction horizon of the MPC controller, such that optimal control and constraint satisfaction are handled by a nonlinear program (NLP), rather than an MINLP. A neural network (NN)-based policy is proposed where, to address the exponential growth of the policy’s action space with the prediction horizon, a recurrent architecture is used. The policy learns to select gears that are optimal for the original optimization problem, rather than decoupling the gear-shift schedule from the speed control, such that, in contrast to [ 14 , 12 ] , the notion of co-optimization is retained. In this way, the MPC controller is able to consider the gear and powertrain dynamics without optimizing explicitly over discrete inputs, in contrast to [ 11 , 5 ] . Furthermore, unlike pure learning-based controllers [ 7 ] , the use of the MPC controller gives constraint satisfaction. To this end, we propose a backup gear-shift schedule that can guarantee feasibility of the MPC optimization problem. Finally, due to the recurrent architecture, the policy, once trained for a specific prediction horizon, generalizes over prediction horizons without the need for retraining. II PROBLEM SETTING Consider the vehicle and powertrain models [ 11 ] \displaystyle T(t)n(t) \displaystyle=g(t)+Cv^{2}(t)+ma(t)+F_{\text{b}}(t), (1) \displaystyle\omega(t) \displaystyle=(30/\pi)\cdot n(t)v(t), with t continuous time, a the acceleration, v the velocity, and m the mass of the vehicle. Furthermore, C is the wind drag coefficient, F_{\text{b}} is the brake force, T is the engine torque, and \omega is the engine speed. The friction function g(t)=\mu mg\cos\big(\alpha(t)\big)+mg\sin\big(\alpha(t)\big), (2) with \mu the rolling friction constant and g the gravitational acceleration, defines the road friction for road angle \alpha , which, for simplicity of presentation, is assumed to be constant, i.e., \alpha(t)=\alpha and g(t)=G . The lumped gear ratio n(t)=z\big(j(t)\big)z_{\text{f}}/r is determined by the final drive ratio z_{\text{f}} , the wheel radius r , and the transmission gear ratio z , a discrete variable selected by the gear position j\in\{1,\dots,6\} . To model engine dynamics the torque rate of change is constrained as |\dot{T}(t)|\leq\Delta T_{\text{max}}. Furthermore, consider the fuel model [ 11 ] \dot{m}_{\text{f}}(t)=c_{0}+c_{1}\omega(t)+c_{2}\omega(t)T(t), (3) with c_{0},c_{1}, and c_{2} constants. The variables F_{\text{b}},T, and \omega are physically bounded above and below, e.g., T_{\text{min}}\leq T\leq T_{\text{max}} . Note that the bounds on \omega implicitly bound v between v_{\text{min}}=\frac{\pi\cdot\omega_{\text{min}}r}{30\cdot z(1)z_{\text{f}}}\quad\text{and}\quad v_{\text{max}}=\frac{\pi\cdot\omega_{\text{max}}r}{30\cdot z(6)z_{\text{f}}}. (4) For convenience, in the following, we define a function that maps a speed and gear choice to the engine speed \omega(v,j)=\frac{30\cdot v\cdot z(j)z_{\text{f}}}{r\pi}. (5) We consider the control of an AV to track a reference trajectory in a fuel efficient manner. Denote the vehicle position, reference position, and reference velocity at time t as p(t) , p_{\text{ref}}(t) , and v_{\text{ref}}(t) , respectively. The performance metric is \displaystyle P \displaystyle=\sum_{k=0}^{K_{\text{sim}}}\beta L_{\text{t}}\Big(\big[p(k\Delta t),v(k\Delta t)\big]^{\top},\big[p_{\text{ref}}(k\Delta t),v_{\text{ref}}(k\Delta t)\big]^{\top}\Big) (6) \displaystyle+L_{\text{f}}\big(v(k\Delta t),T(k\Delta t),j(k\Delta t)\big), where \beta>0 expresses the importance of tracking against fuel efficiency, and k is a discrete-time counter for time steps of \Delta t seconds. The tracking cost L_{\text{t}}(x,y)=(x-y)^{\top}Q(x-y) (7) quadratically penalizes deviations from the reference trajectory, with Q\in\mathbb{R}^{2\times 2} a positive-definite weighting matrix. The fuel cost L_{\text{f}}(v,T,j)=\Delta t\big(c_{0}+c_{1}\omega(v,j)+c_{2}\omega(v,j)T\big) penalizes the fuel consumption over a time step. III LEARNING-BASED MPC In this section we introduce the proposed controller for the task. Defining the state, reference state, and control input as \displaystyle x(k) \displaystyle=[p(k\Delta t),v(k\Delta t)]^{\top}, (8) \displaystyle x_{\text{ref}}(k) \displaystyle=[p_{\text{ref}}(k\Delta t),v_{\text{ref}}(k\Delta t)]^{\top}, \displaystyle u(k) \displaystyle=[T(k\Delta t),F_{\text{b}}(k\Delta t),j(k\Delta t)]^{\top}, ( 1 ) can be approximated with the discrete-time dynamics x(k+1)=f\big(x(k),u(k)\big) , with f(x,u)=\begin{bmatrix}x_{1}+x_{2}\Delta t\\ x_{2}+\frac{\Delta t}{m}\Big(\frac{u_{1}z(u_{3})z_{\text{f}}}{r}-Cx_{2}^{2}-u_{2}-G\big)\Big)\end{bmatrix}, (9) where subscripts select an element of a vector, e.g., x_{i} is the i th element of the vector x . III-A Mixed-integer nonlinear MPC Consider an MPC scheme with prediction horizon N>1 defined by the following MINLP: \displaystyle J\big(x(k), \displaystyle\textbf{x}_{\text{ref}}(k)\big)=\min_{\textbf{x}(k),\textbf{u}(k)}\sum_{i=0}^{N}\beta L_{\text{t}}\big(x(i|k),x_{\text{ref}}(i+k)\big) \displaystyle\quad\quad+\sum_{i=0}^{N-1}L_{\text{f}}\big(x_{2}(i|k),u_{1}(i|k),u_{3}(i|k)\big) (10a) s.t. \displaystyle x(0|k)=x(k) (10b) \displaystyle\text{for}\quad i=0,\dots,N-1: \displaystyle\quad x(i+1|k)=f\big(x(i|k),u(i|k)\big) (10c) \displaystyle\quad|x_{2}(i+1|k)-x_{2}(i|k)|\leq a_{\text{max}}\Delta t (10d) \displaystyle\text{for}\quad i=0,\dots,N-2: \displaystyle\quad|u_{1}(i+1|k)-u_{1}(i|k)|\leq\Delta T_{\text{max}}\Delta t (10e) \displaystyle\quad|u_{3}(i+1|k)-u_{3}(i|k)|\leq 1 (10f) \displaystyle\big(\textbf{x}(k),\textbf{u}(k)\big)\in\mathcal{C} (10g) where x(i|k) and u(i|k) are the predicted states and inputs, respectively, i steps into the prediction horizon of the MPC controller at time step k . Furthermore, bold variables gather a variable over the prediction horizon, e.g., \displaystyle\textbf{x}(k) \displaystyle=\big[x^{\top}(0|k),\dots,x^{\top}(N|k)\big]^{\top}, (11) \displaystyle\textbf{x}_{\text{ref}}(k) \displaystyle=\big[x_{\text{ref}}^{\top}(k),\dots,x_{\text{ref}}^{\top}(k+N)\big]^{\top}. If no solution exists for ( 10 ) J\big(x(k),\textbf{x}_{\text{ref}}(k)\big)=\infty by convention. The constraint ( 10e ) enforces the engine torque dynamic behavior, ( 10f ) prevents skipping gears when shifting, and ( 10d ) limits acceleration to a_{\text{max}} . The bounds on engine torque, engine speed, and brake force are grouped in \displaystyle\mathcal{C}=\bigg\{(\textbf{x},\textbf{u})\Big| \displaystyle T_{\text{min}}\leq u_{1}(i|k)\leq T_{\text{max}}, (12) \displaystyle F_{\text{b, min}}\leq u_{2}(i|k)\leq F_{\text{b, max}}, \displaystyle w_{\text{min}}\leq\omega\big(x_{2}(i|k),u_{3}(i|k)\big)\leq w_{\text{max}}, \displaystyle w_{\text{min}}\leq\omega\big(x_{2}(i+1|k),u_{3}(i|k)\big)\leq w_{\text{max}}, \displaystyle i=0,\dots,N-1\bigg\}. The last condition in \mathcal{C} , relating x_{2}(i+1|k) to u_{3}(i|k) , ensures that the gear at time step k+i maintains the engine speed within its bounds for all t\in\big[(k+i)\Delta t,(k+i+1)\Delta t\big] . The MINLP ( 10 ) provides a state feedback controller via solving ( 10 ) at

Read the complete text