Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction
Yu Liu, Zhijie Liu, Xiao Ren, You-Fu Li, He Kong · 2025
Read Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction by Yu Liu, Zhijie Liu, Xiao Ren, You-Fu Li, He Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04229.txt.
Introduction
Yu Liu and four co-authors add intent reading to a diffusion model that forecasts where walkers will go, in a 2025 arXiv paper. Self-driving cars need those forecasts, but human motion fans out into many plausible paths. Diffusion models capture that spread well, yet few state what each walker means to do. The team splits intent into sideways and forward parts.
A built-in module reads each walker's intent and feeds it into the forecast. A guidance step then keeps the drawn paths readable as real choices. On two standard crowd data sets, the method matched the best rivals. The authors value the clearer why behind each path as much as the scores, since planners must act on the forecast.
Catalog record
| CREATOR | Yu Liu, Zhijie Liu, Xiao Ren, You-Fu Li, He Kong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04229
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction Yu Liu, Zhijie Liu, Xiao Ren, You-Fu Li, He Kong Abstract Predicting pedestrian motion trajectories is critical for path planning and motion control of autonomous vehicles. However, accurately forecasting crowd trajectories remains a challenging task due to the inherently multimodal and uncertain nature of human motion. Recent diffusion-based models have shown promising results in capturing the stochasticity of pedestrian behavior for trajectory prediction. However, few diffusion-based approaches explicitly incorporate the underlying motion intentions of pedestrians, which can limit the interpretability and precision of prediction models. In this work, we propose a diffusion-based multimodal trajectory prediction model that incorporates pedestrians’ motion intentions into the prediction framework. The motion intentions are decomposed into lateral and longitudinal components, and a pedestrian intention recognition module is introduced to enable the model to effectively capture these intentions. Furthermore, we adopt an efficient guidance mechanism that facilitates the generation of interpretable trajectories. The proposed framework is evaluated on two widely used human trajectory prediction benchmarks, ETH and UCY, on which it is compared against state-of-the-art methods. The experimental results demonstrate that our method achieves competitive performance. I Introduction Pedestrian motion prediction is a critical capability for autonomous vehicles [ 1 ] . Given the observed trajectories of pedestrians, accurate forecasting of their future paths is essential for ensuring safe and efficient operation. A key challenge in trajectory prediction lies in the inherently stochastic and non-deterministic nature of human motion, which is influenced by many factors such as social interactions and the surrounding environment. Within this context, multimodal trajectory prediction methods seek to generate interpretable probability distributions over plausible future paths, allowing the model to capture inherent uncertainty. Recent generative approaches have shown the ability to produce a diverse set of plausible path predictions. Among these, diffusion models [ 2 , 3 ] have emerged as a prominent tool for pedestrian trajectory forecasting. However, a limitation of existing diffusion-based approaches is that they do not incorporate prior knowledge, such as pedestrian motion intention, which reduces explainability and undermines the prediction performance. Motivated by the above observation, we propose an Intention-enhanced Diffusion model (IntDiff) for multi-modal pedestrian trajectory prediction in this paper. Our approach incorporates pedestrians’ motion intentions as a prior in the diffusion model, thereby rendering the prediction pipeline both more interpretable and more efficient. The main contributions of this work are as follows: (1) We propose a novel diffusion-based framework, IntDiff, for multimodal pedestrian trajectory prediction, which explicitly incorporates pedestrian motion intentions into the generative process, thereby enhancing the interpretability of the learned representations. (2) A motion intention recognition module is introduced to estimate pedestrian intention along lateral and longitudinal axes, and is integrated with a classifier-free guidance strategy to condition the diffusion model, effectively steering the generation process toward intention-aware predictions. (3) Comprehensive experiments are conducted on benchmark datasets, demonstrating that the proposed approach can achieve competitive performance compared to state-of-the-art methods in pedestrian trajectory forecasting. II Related Work II-A Pedestrian Trajectory Prediction Early works on trajectory prediction proposed models based on physical motion constraints [ 4 ] . However, these approaches often struggle to capture the complexity and variability of human motion in dynamic environments, prompting a shift toward data-driven learning-based methods. Recent deep learning approaches have framed trajectory forecasting as a sequential estimation task. For example, Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) have been employed to capture temporal dependencies in pedestrian motion [ 5 , 6 ] . Given the critical role of social interactions in influencing pedestrians’ potential future trajectories, several approaches have adopted graph-based structures to explicitly model interactions between pedestrians [ 7 , 8 ] . Additionally, environmental features such as visual maps and LiDAR point clouds are considered and integrated into the prediction pipeline [ 9 ] . Due to the inherent indeterminacy and multimodal nature of pedestrian motion, various methods have been developed to capture these characteristics in trajectory prediction. Generative Adversarial Networks (GANs) [ 10 , 11 ] and Conditional Variational Autoencoders (CVAEs) [ 12 , 13 ] introduce latent variables sampled from probability distributions to model the stochastic behavior of predicted trajectories. However, existing methods face inherent limitations, such as the generation of unrealistic trajectories, highlighting the need for more robust models. II-B Multimodal Trajectory Prediction To enable interpretable trajectory predictions, some approaches incorporate anchor points as prior information to guide the generation of multimodal trajectories. For example, TNT [ 14 ] estimate agents’ endpoints as prior conditions for predicting multimodal trajectories and ADAPT [ 15 ] jointly predicts the trajectories of all agents in the scene with dynamic weight learning. Alternatively, some strategies [ 16 , 17 ] select candidate prototype trajectories as anchor sets, where each prototype defines a motion pattern that waypoints should follow, subject to necessary refinement. [ 18 ] proposes an LSTM-based model for interaction-aware, multi-modal motion prediction driven by maneuver recognition. GIMTP [ 19 ] introduces a driving intention-specific feature fusion mechanism, enabling the adaptive integration of historical and future embeddings to improve intention recognition and trajectory prediction. Close in spirit to these models, we integrate pedestrian motion intentions in this work to better capture pedestrian motion uncertainty. II-C Denoising Diffusion Model Diffusion models [ 2 , 3 , 20 ] , as a class of generative models, employ a parameterized Markov chain to model the gradual transition from a noise distribution to the target data distribution. These models have emerged as a prominent research focus, demonstrating their success across various domains, including image synthesis [ 21 ] , video generation [ 22 ] , and natural language processing (NLP) [ 23 ] . In the context of motion prediction, MID [ 24 ] approaches pedestrian trajectory prediction as a reverse process of motion indeterminacy diffusion. TRACE [ 25 ] introduces a guided diffusion model that enables users to constrain trajectories by specifying target waypoints, speed, and social groups, while also incorporating the surrounding environmental context. SingularTrajectory [ 26 ] introduces a diffusion-based universal trajectory prediction framework designed to reduce performance disparities across five distinct tasks by unifying diverse human dynamics representations. DICE [ 27 ] presents a novel framework featuring an efficient sampling mechanism coupled with a scoring module to select the most plausible trajectories. Inspired by these developments, in this work, we explicitly categorize pedestrian motion intentions and incorporate them into the diffusion-based trajectory prediction framework. III METHOD III-A Problem Definition The trajectory prediction task entails estimating pedestrians’ future positions within a scene based on their observed past movements. The model receives as input the 2D spatial coordinates of pedestrians over the observed time steps t\in\{1,2,\dots,t_{\mathrm{obs}}\} , denoted by X=\{X^{i}_{1},X^{i}_{2},\dots,X^{i}_{t_{\mathrm{obs}}}\} , where X^{i}_{t}=(x^{i}_{t},y^{i}_{t}) represents the position of the i th pedestrian at time t . Similarly, the ground truth trajectory over the future time period t\in\{t_{\mathrm{obs}}+1,t_{\mathrm{obs}}+2,\dots,t_{\mathrm{pred}}\} is denoted as Y=\{Y^{i}_{t_{\mathrm{obs}}+1},Y^{i}_{t_{\mathrm{obs}}+2},\dots,Y^{i}_{t_{\mathrm{pred}}}\} , and Y_{t}^{i}=(x_{t}^{i},y_{t}^{i}) represents the ground truth position of the i th pedestrian at time t in the future. The objective of this work is to predict the future trajectory \hat{Y}^{i} of the i th pedestrian and to estimate its future positions \hat{Y}^{i}_{t}=(\hat{x}^{i}_{t},\hat{y}^{i}_{t}) at each time t . Fig. 1: The structure of the proposed IntDiff. During the training stage, pedestrian motion intentions are discriminated and