Multi-Step Deep Koopman Network (MDK-Net) for Vehicle Control in Frenet Frame

Mohammad Abtahi, Mahdis Rabbani, Armin Abdolmohammadi, Shima Nazari · 2025

Read Multi-Step Deep Koopman Network (MDK-Net) for Vehicle Control in Frenet Frame by Mohammad Abtahi, Mahdis Rabbani, Armin Abdolmohammadi, Shima Nazari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03002.txt.

Introduction

Mohammad Abtahi and co-authors model car dynamics with deep learning in a 2025 paper. Vehicle motion bends in complex ways, which makes optimal control and planning hard to run in real time. Koopman theory offers a fix: it restates a bent system in a linear form that control tools handle well. Their network learns that restatement from pedal and steering inputs up to body states, framed along the road's curve.

Against standard fitted linear models, the Koopman model tracked a double lane change with better accuracy. A predictive controller built on the model also steered with clear gains over the baseline. Framing the motion along the road's own curve helps the model stay true through turns. The approach may ease the load on self driving stacks that must plan fast and stay smooth.

Catalog record

CREATORMohammad Abtahi, Mahdis Rabbani, Armin Abdolmohammadi, Shima Nazari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03002

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Step Deep Koopman Network (MDK-Net) for Vehicle Control in Frenet Frame Mohammad Abtahi, Mahdis Rabbani, Armin Abdolmohammadi, Shima Nazari Abstract The highly nonlinear dynamics of vehicles present a major challenge for the practical implementation of optimal and Model Predictive Control (MPC) approaches in path planning and following. Koopman operator theory offers a global linear representation of nonlinear dynamical systems, making it a promising framework for optimization-based vehicle control. This paper introduces a novel deep learning-based Koopman modeling approach that employs deep neural networks to capture the full vehicle dynamics—from pedal and steering inputs to chassis states—within a curvilinear Frenet frame. The superior accuracy of the Koopman model compared to identified linear models is shown for a double lane change maneuver. Furthermore, it is shown that an MPC controller deploying the Koopman model provides significantly improved performance while maintaining computational efficiency comparable to a linear MPC. I INTRODUCTION Autonomous vehicles (AVs) represent a transformative technology, aiming to redefine modern transportation by enhancing safety, efficiency, and accessibility [ 1 ] . Using advanced control strategies that govern their motion, decision making and interaction with dynamic environments, various control approaches have been developed to meet these demands, ranging from classical methods such as PID [ 2 , 3 ] and LQR [ 4 ] to more advanced techniques such as Model Predictive Control (MPC) [ 5 , 6 ] and Reinforcement Learning (RL) [ 7 , 8 ] . However, designing such controllers is inherently challenging, as they need to be real-time efficient, robust to uncertainties, and highly accurate. At the core of addressing these challenges lies the importance of modeling the vehicle dynamics. These dynamics are highly nonlinear, governed by complex interactions among lateral and longitudinal motion, tire forces, and powertrain dynamics. This has motivated extensive research into nonlinear control techniques. Approaches such as Nonlinear Model Predictive Control (NMPC) [ 9 ] , Iterative Linear Quadratic Regulator (iLQR) [ 10 ] , and nonlinear cascade control [ 11 ] have been developed to directly address these nonlinearities. While these methods can achieve high accuracy, their computational complexity often makes them impractical for real-time applications. Emerging AI-based methods [ 12 ] offer an alternative by learning system dynamics directly from data. These approaches have gained increasing attention for their ability to model complex nonlinear behaviors without requiring explicit system identification. However, designing such controllers remains inherently challenging due to the need for real-time efficiency, robustness to uncertainties, and high accuracy in diverse operating conditions [ 13 ] . These limitations and challenges motivate the need for efficient and interpretable modeling frameworks that balance accuracy and computational feasibility. At the core of addressing these challenges lies the importance of linearizing the vehicle dynamic model, which serves as a foundational framework for state estimation, motion planning, and control synthesis. One widely used approach is traditional model linearization using Taylor series expansion. This approach provides computational efficiency and fast processing speed, making it appealing for real-time control applications. However, it produces linear models that are valid only locally and fails to capture the intricate vehicle dynamics for a wide range of operating points. An alternative approach is the Koopman Operator, which offers a globally linear representation of a nonlinear system dynamics [ 14 ] . In simple words, by lifting the original states of the system to a higher dimensional space using observable functions, Koopman operator captures the nonlinearities through a linear mapping on the observables [ 15 ] . Fig. 1: Vehicle states representation in Frenet curvilinear frame. The Koopman operator has received enhanced attention over the past few years, mostly due to the advances in data-driven methods and has been applied across various engineering domains, including vehicle control [ 16 ] . It has been utilized in several applications, such as trajectory tracking using Koopman-based MPC [ 17 ] , lane-keeping using Koopman-based LQR [ 18 ] , and Koopman model identification in Adaptive Cruise Control (ACC) [ 19 ] . Despite the promising landscape, identifying a Koopman operator for a dynamical system is challenging. The existence of a Koopman operator is only guaranteed in infinite dimension and for autonomous systems; therefore, a finite dimensional approximation for systems with control inputs might not be achievable [ 20 ] . Various data-driven methods have been proposed to produce an accurate approximation. Among them, Extended Dynamic Mode Decomposition (EDMD) with control [ 21 ] is the most widely used approach. EDMD relies on defining a rich library of manually-selected observable functions, which act on states. The Koopman operator is then determined by solving a Mean Square Error (MSE) optimization problem [ 15 ] . Nonetheless, selecting these observables can be challenging in practice; there are infinitely many possible choices, and determining the subset that most accurately captures the system dynamics often requires extensive trial and error. This challenge is universal to all EDMD-based methods and motivates using deep learning to automatically learn the set of observables rather than using a predefined set of functions. Deep learning techniques provide an end-to-end predictive model, constructed directly from data; and therefore can provide improved performance and increase the efficiency of identifying a Koopman invariant subspace [ 22 , 23 ] . This motivates us to adopt a deep learning technique for our Koopman-based modeling. Recent work by Lusch et al. [ 24 ] has demonstrated that deep learning frameworks can be effectively employed to discover Koopman eigenfunctions. In our work, with the focus on vehicle dynamic modeling for control, we build upon several core components of the deep Koopman embedding approach. We further extend this framework by incorporating additional loss terms that enforce model stability through manipulation of the Koopman operator. We also adopt a similar approach as in [ 22 ] , jointly learning Koopman observables and the operator. In contrast, their method employs an auxiliary control network to map control inputs from the lifted space back into the original state space, whereas our approach eliminates the need for this auxiliary decoder. On a different note, most deep Koopman-based MPC approaches for vehicle control (see [ 25 , 26 ] ) model vehicle dynamics in a Cartesian coordinate system. In our work, we adopt a Frenet-frame coordinate system, which introduces road curvature as an exogenous input into Koopman identification. To the best of our knowledge, our work is the first application of Koopman-based modeling in vehicle dynamics that explicitly incorporates an exogenous input. In summary, our main contributions are as follows: • To the best of our knowledge, this is the first work that applies the deep learning-based Koopman operator to vehicle dynamics in Frenet-frame coordinates, explicitly incorporating road curvature as an exogenous input, • Our model utilizes low-level control inputs, i.e. steering, brake pressure and throttle, resulting in capturing powertrain and driveline dynamics, whereas previous studies have typically relied on simplified representations of powertrain and tire dynamics, • We developed a novel end-to-end learning architecture that jointly learns observable functions and the Koopman operator without the need of an auxiliary decoder, • Additionally, we introduce a stability loss term that penalizes any eigenvalue of the learned Koopman operator exceeding unity, thus ensuring bounded multi-step predictions for vehicle dynamics. Fig. 2 illustrates the main pipeline of our work,

Read the complete text