MIAT: Maneuver-Intention-Aware Transformer for Spatio-Temporal Trajectory Prediction

Chandra Raskoti, Iftekharul Islam, Xuan Wang, Weizi Li · 2025

Read MIAT: Maneuver-Intention-Aware Transformer for Spatio-Temporal Trajectory Prediction by Chandra Raskoti, Iftekharul Islam, Xuan Wang, Weizi Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05059.txt.

Introduction

Raskoti, Islam, Wang, and Li built MIAT, a transformer model that predicts where nearby vehicles will move next. Such forecasts are a key input for safe self-driving. The hard part is that drivers constantly speed up, slow down, and change lanes. Those choices change the path a car will take. MIAT adds a control for maneuver intention. The model can weigh how much a driver's likely next move should shape the forecast. It also models how vehicles interact over space and time.

Tested on a real-world highway data set, MIAT beat transformer and recurrent models. It improved short-range forecasts by up to 4.7 percent over other intention-aware methods. Long-range forecasts improved by 1.6 percent. Tuning the intention control boosted long-range accuracy by 11.1 percent, with a small cost at short range. Code and data are public.

Catalog record

CREATORChandra Raskoti, Iftekharul Islam, Xuan Wang, Weizi Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05059

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MIAT: Maneuver-Intention-Aware Transformer for Spatio-Temporal Trajectory Prediction Chandra Raskoti, Iftekharul Islam, Xuan Wang, Weizi Li Abstract Accurate vehicle trajectory prediction is critical for safe and efficient autonomous driving, especially in mixed traffic environments when both human-driven and autonomous vehicles co-exist. However, uncertainties introduced by inherent driving behaviors—such as acceleration, deceleration, and left and right maneuvers—pose significant challenges for reliable trajectory prediction. We introduce a Maneuver-Intention-Aware Transformer (MIAT) architecture, which integrates a maneuver intention awareness control mechanism with spatiotemporal interaction modeling to enhance long-horizon trajectory predictions. We systematically investigate the impact of varying awareness of maneuver intention on both short- and long-horizon trajectory predictions. Evaluated on the real-world NGSIM dataset and benchmarked against various transformer- and LSTM-based methods, our approach achieves an improvement of up to 4.7% in short-horizon predictions and a 1.6% in long-horizon predictions compared to other intention-aware benchmark methods. Moreover, by leveraging intention awareness control mechanism, MIAT realizes an 11.1% performance boost in long-horizon predictions, with a modest drop in short-horizon performance. The source code and datasets are available at https://github.com/cpraskoti/MIAT. I Introduction The increasing integration of autonomous vehicles into everyday traffic is creating complex, mixed environments where human-driven and automated vehicles coexist [ 1 , 2 , 3 , 4 ] . The ability to accurately predict the future trajectories of surrounding vehicles is a fundamental requirement for safe and efficient autonomous navigation [ 5 ] . The core challenge lies in modeling the inherent uncertainties of human driving, which is characterized by a wide range of behaviors and intricate interactions among multiple agents. As illustrated in Fig. 1 , a single vehicle may have several plausible future paths corresponding to different high-level maneuvers, such as maintaining its lane or initiating a lane change. An effective prediction model must therefore account for this multi-modal nature of driving behavior. Fig. 1 : Illustration of trajectory prediction challenge. The blue vehicle (center) has multiple plausible future trajectories depending on different maneuver intentions: lane keeping (middle), changing to the left lane (top), or changing to the right lane (bottom). Neighboring vehicles (black) and their historical trajectories (orange dotted lines) influence the blue vehicle’s decision-making process. Early deep-learning-based approaches for trajectory prediction often combine Long Short-Term Memory (LSTM) to capture the temporal evolution of vehicle states and social pooling or convolutional layers to model spatial interactions among neighboring agents [ 6 , 7 , 8 ] . Despite their effectiveness in modeling local interactions, these methods are fundamentally limited by their recurrent backbone. The sequential processing nature of LSTMs makes it difficult to capture long-range dependencies efficiently, leading to error accumulation in long-horizon forecasts [ 9 ] . Over time, Transformer [ 10 ] based architectures prove to be a compelling alternative to these prior models, using self-attention mechanisms to model complex spatio-temporal interactions across all agents and time steps simultaneously [ 11 , 12 ] . While these models have significantly improved prediction accuracy, they typically learn high-level driving intentions implicitly. This lack of explicit maneuver reasoning can limit their performance and interpretability, especially in scenarios requiring consistent long-term forecasts where a driver’s underlying intention is the primary factor guiding their path. To address this limitation, other researchers have focused on explicitly incorporating maneuver awareness into prediction models via a two-stage pipeline: first classifying a driver’s discrete maneuver such as lane keeping, left-right lane change and then generating a trajectory conditioned on that classification [ 13 , 14 ] . Other methods predict a sparse set of target goals corresponding to different maneuvers and generate trajectories toward them [ 15 ] . While effective, these methods often treat maneuver classification and trajectory generation as decoupled tasks. This separation can be suboptimal, as the balance between optimizing for short-term positional accuracy and long-term maneuver consistency is typically fixed and cannot be dynamically adjusted to prioritize long-horizon performance. We introduce the Maneuver-Intention-Aware Transformer (MIAT), a unified architecture that bridges this gap by tightly coupling maneuver recognition and trajectory regression within a single end-to-end framework. Rather than employing a decoupled, two-stage process, MIATintegrates maneuver awareness directly into the learning objective of a Transformer-based model. Our central innovation is a tunable intention awareness control mechanism, which allows to explicitly control the trade-off between minimizing trajectory prediction error and correctly classifying the underlying maneuver. By adjusting the weight of the maneuver classification loss, our model can be configured to prioritize long-term strategic consistency, a key factor for reliable long-horizon forecasting. Our contributions are as follows. • We propose MIAT, a unified Transformer-based architecture that integrates a novel maneuver intention awareness and control mechanism. Our design jointly optimizes for trajectory accuracy and maneuver classification within a single framework to improve long-horizon prediction. • Our tunable loss control mechanism explicitly controls the model’s focus on long-term maneuver consistency versus short-term positional accuracy, which yields significant improvements in long-horizon performance (5-second horizon), achieving an 11.1% improvement. • Our extensive experiments on the real-world NGSIM dataset demonstrate that MIAT outperforms several benchmarks by up to 4.7% for short-horizon and 1.6% for long-horizon prediction. II Related Work II-A Spatio-Temporal Models The prediction of vehicle trajectories requires capturing both the temporal evolution of a vehicle’s state and its complex interactions with surrounding agents. Early studies often rely on classical probabilistic and physics-kinematic principles. Physics-based models leverage acceleration, yaw rate, and road friction to predict short-horizon trajectories but ignore driver intent and interactions with neighboring vehicles [ 16 ] . To address this challenge, maneuver-based models integrate driver actions, such as lane-changing under kinematic constraints. For instance, maneuver recognition is combined with motion models [ 5 ] , while Bayesian frameworks are used to assess prediction reliability [ 17 ] . However, physics-based models are fundamentally limited by their reliance on rigid physical rules, which usually fail to capture the complex and unpredictable nature of driver behavior, thus restricting their accuracy to short-term predictions [ 18 ] . Early adoption of deep learning to trajectory prediction, particularly through the combination of LSTMs and Convolutional Networks, enabled the explicit modeling of complex spatio-temporal interactions. The seminal work on Social-LSTM [ 6 ] introduced a “social pooling” layer to aggregate hidden states from neighboring agents, allowing the model to learn socially-aware behaviors. This concept was advanced by models such as CS-LSTM [ 7 ] , which employs a convolutional grid to capture spatial proximity more effectively, and STA-LSTM [ 8 ] , which uses spatio-temporal attention to weigh the importance of different neighbors over time. To address the inherent multi-modality of future trajectories, generative models are introduced. Social-GAN [ 19 ] leverages a Generative Adversarial Network (GAN) to produce a diverse set of realistic and socially plausible paths, while others such as DESIRE [ 20 ] uses Variational Autoencoders (VAEs) to model a probabilistic distribution over multiple futures. Despite their success, RNN-based architectures struggle to model complex, long-range spatio-temporal interactions due to their sequential nature. This development leads to the adoption of Transformer architectures [ 10 ] , whose self-attention mechanisms can capture global correlations across time and agents simultaneously. Seminal work including VectorNet [ 11 ] and AgentFormer [ 12 ] demonstrate the power of attention-based models. VectorNet encodes the scene as a graph of vectors, using self-attention to learn rich context-aware representations,

Read the complete text