Temporally Decoupled Diffusion Planning for Autonomous Driving

Xiang Li, Bikun Wang, John Zhang, Jianjun Wang · 2026

Read Temporally Decoupled Diffusion Planning for Autonomous Driving by Xiang Li, Bikun Wang, John Zhang, Jianjun Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25462.txt.

Introduction

Li and co-authors split driving plans by time horizon inside a diffusion planner. Near-term motion obeys instant physics, while far-term motion serves the route goal. Treating the whole path as one block blurs that split. Their model gives each path segment its own noise level. Heavy noise marks a gap to fill, light noise a cue to trust. The net rebuilds blurred near parts from clearer far parts. Weak far-term guidance then steers live choices. On nuPlan tests it matches or beats top baselines.

Catalog record

CREATORXiang Li, Bikun Wang, John Zhang, Jianjun Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40708
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25462

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Temporally Decoupled Diffusion Planning for Autonomous Driving Xiang Li, Bikun Wang, John Zhang, Jianjun Wang Abstract Motion planning in dynamic urban environments requires balancing immediate safety with long-term goals. While diffusion models effectively capture multi-modal decision-making, existing approaches treat trajectories as monolithic entities, overlooking heterogeneous temporal dependencies where near-term plans are constrained by instantaneous dynamics and far-term plans by navigational goals. To address this, we propose Temporally Decoupled Diffusion Model (TDDM), which reformulates trajectory generation via a noise-as-mask paradigm. By partitioning trajectories into segments with independent noise levels, we implicitly treat high noise as information voids and weak noise as contextual cues. This compels the model to reconstruct corrupted near-term states by leveraging internal correlations with better-preserved temporal contexts. Architecturally, we introduce a Temporally Decoupled Adaptive Layer Normalization (TD-AdaLN) to inject segment-specific timesteps. During inference, our Asymmetric Temporal Classifier-Free Guidance utilizes weakly noised far-term priors to guide immediate path generation. Evaluations on the nuPlan benchmark show TDDM approaches or exceeds state-of-the-art baselines, particularly excelling in the challenging Test14-hard subset. Code — https://github.com/wodlx/TDDM Introduction Motion planning is one of the core technical challenges in autonomous driving ( 5 ; 1 ) , with the objective of generating safe, comfortable, and human-like trajectories in dynamically changing and uncertain environments ( 6 ) . Traditional planning methods, such as search-based ( 26 ) or optimization-based approaches ( 13 ) , rely on precise environmental models and complex heuristic rules ( 27 ; 11 ) . Although they can be highly efficient and perform well in scenarios covered by these rules, they often struggle to cope with the highly dynamic and interactive nature of complex urban scenarios ( 19 ) . Figure 1: The comparison of our temporal decoupled diffusion model and full sequence diffusion model. (a) full sequence diffusion model. (b) temporal decoupled diffusion model (Ours). It can be seen that the biggest difference between our model and the full sequence model is the support for independent diffusion processes on temporal segments, where t denotes the diffusion timestep. In recent years, learning-based planning has emerged as the mainstream paradigm. By learning driving policies from large-scale data, these methods can better generalize to complex and variable real-world scenarios, reducing the reliance on hand-crafted rules. Among learning-based approaches, imitation learning (IL) ( 22 ; 2 ) , especially end-to-end (E2E) methods ( 15 ; 8 ) , has achieved significant success. By directly learning the mapping from perception to control, it greatly simplifies the complexity of the traditional planning framework. However, classic imitation learning methods face two core challenges. The first is distribution shift ( 9 ) , where the state distribution encountered during testing differs from the training data, leading to compounding errors. The second is the difficulty in capturing the inherent multi-modal decision-making ( 10 ; 7 ) characteristic of real-world driving scenarios. Faced with the same situation, a human driver might make several equally valid and safe decisions, whereas a single regression target often yields overly conservative or averaged-out policies. To resolve this, recent literature shifts from deterministic regression to generative sequence modeling. To align with the broader automated planning community, it is crucial to distinguish these paradigms: classical planning searches for an optimal action sequence based on explicit logical constraints, whereas trajectory generation reframes the task as conditional probability modeling. Instead of explicit logical search, generative models learn to sample diverse, contextually plausible future trajectories from a learned data distribution. Driven by this generative formulation, diffusion models ( 14 ; 25 ) have been introduced into the field of trajectory planning, owing to their powerful ability to model complex data distributions and their flexibility in being guided by different conditions to achieve various goals. By redefining the planning task as a conditional trajectory generation problem, diffusion models can start from random noise and, through a denoising process guided by scene context and kinematic constraints, generate a diverse set of plausible trajectories that are consistent with the scene. The success of applying diffusion models to trajectory generation has been demonstrated in several works ( 18 ; 20 ; 31 ) . However, existing diffusion-based planning methods often treat the entire trajectory as a monolithic, indivisible entity ( 31 ) . This ignores the varying dependencies of different temporal segments of the trajectory in the scene context. For instance, the initial segment of a trajectory (near-term plan) is more dependent on the vehicle’s precise current state and the instantaneous dynamics of the surrounding environment, whereas the final segment (far-term plan) is more focused on achieving long-term navigational goals. Inspired by recent advances in sequential modeling from the video generation domain, we draw an analogy between trajectory generation and the generation of video frame sequences. Cutting-edge methods in video generation, such as Diffusion Forcing ( 4 ) , achieve higher quality and longer-term video extrapolation by applying independent noise to different frames and modeling their temporal relationships. Similarly, works like CausVid ( 30 ) have further explored efficient causal structures to improve generation speed and interactivity. These works collectively highlight the importance of decoupling sequential units and meticulously modeling their internal correlations in sequence generation tasks. To this end, we propose a novel method named the Temporally Decoupled Diffusion Model (TDDM) , which aims to model the internal temporal dependencies within a trajectory more finely, thereby generating plans that are more consistent and forward-looking. Our main contributions can be summarized as follows: • We introduce a novel temporally-decoupled training paradigm. We partition the trajectory into multiple temporal segments and apply different levels of noise independently to each segment during training. This randomized temporal masking mechanism significantly enhances the model’s ability to capture complex temporal correlations. • We design an asymmetric temporal guidance strategy for inference. By extending Classifier-Free Guidance ( 12 ) to the temporal dimension, our strategy uses weakly noised far-term priors as a condition to guide the generation of a near-term plan. This effectively frames the inference process as a goal-directed trajectory completion task, enhancing the long-term consistency of the plan. • We develop an efficient model architecture that supports temporal decoupling. Our architecture, based on the diffusion transformer ( 21 ) framework, incorporates a Temporally Decoupled Adaptive Layer Normalization (TD-AdaLN) module. This allows for the independent injection of diffusion timestep information for each temporal segment, providing architectural support for our proposed training and inference procedures. • Comprehensive evaluations on the large-scale nuPlan ( 3 ) benchmark robustly demonstrate the superiority of our proposed model. The results show that TDDM achieves performance that approaches or exceeds that of state-of-the-art learning-based methods, particularly in the most challenging long-tail scenarios, where it exhibits exceptional robustness and planning consistency. Figure 2: Overview of the temporally decoupled diffusion model. We adopt the diffusion transformer (DiT) architecture as the decoder, with the encoder responsible for encoding environmental context information (including static obstacles, agents, and roads). The decoder can accept independent timesteps from temporal segments through temporally decoupled adaLN. Related Work Imitation-based Planning. Imitation learning, which learns a policy by mimicking expert demonstrations, is a cornerstone of autonomous driving research. Behavioral Cloning (BC) has been particularly prevalent in end-to-end architectures that map sensor inputs directly to control actions. The architectural evolution of these systems is well-documented: early approaches

Read the complete text