AnchDrive: Bootstrapping Diffusion Policies with Hybrid Trajectory Anchors for End-to-End Driving

Jinhao Chai, Anqing Jiang, Hao Jiang, Shiyi Mu 1, Zichong Gu 1, Hao Sun, Shugong Xu 4* · 2025

Read AnchDrive: Bootstrapping Diffusion Policies with Hybrid Trajectory Anchors for End-to-End Driving by Jinhao Chai, Anqing Jiang, Hao Jiang, Shiyi Mu 1, Zichong Gu 1, Hao Sun, Shugong Xu 4* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20253.txt.

Introduction

Jinhao Chai and six co-authors wrote this 2025 arXiv paper on self-driving planning. Diffusion models can draft varied driving trajectories, but generating them from pure noise is costly. Their framework, AnchDrive, starts the planner from ready-made trajectory anchors instead. Good starting points let the model spend its effort on refinement.

The anchors mix two sources. One is a fixed vocabulary of general driving patterns. The other is dynamic: a Transformer reads live perception features and decodes context-aware trajectories on the spot. The diffusion model then predicts small offsets that adjust these anchors. That design produces diverse, high-quality trajectories efficiently. On the NAVSIM benchmark, AnchDrive set a new state-of-the-art result. It also generalized strongly to scenes beyond its training focus.

Catalog record

CREATORJinhao Chai, Anqing Jiang, Hao Jiang, Shiyi Mu 1, Zichong Gu 1, Hao Sun, Shugong Xu 4*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-20253

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AnchDrive: Bootstrapping Diffusion Policies with Hybrid Trajectory Anchors for End-to-End Driving Jinhao Chai, Anqing Jiang, Hao Jiang, Shiyi Mu 1, Zichong Gu 1, Hao Sun, Shugong Xu 4* Abstract End-to-end multi-modal planning has become a transformative paradigm in autonomous driving, effectively addressing behavioral multi-modality and the generalization challenge in long-tail scenarios. We propose AnchDrive, a framework for end-to-end driving that effectively bootstraps a diffusion policy to mitigate the high computational cost of traditional generative models. Rather than denoising from pure noise, AnchDrive initializes its planner with a rich set of hybrid trajectory anchors. These anchors are derived from two complementary sources: a static vocabulary of general driving priors and a set of dynamic, context-aware trajectories. The dynamic trajectories are decoded in real-time by a Transformer that processes dense and sparse perceptual features. The diffusion model then learns to refine these anchors by predicting a distribution of trajectory offsets, enabling fine-grained refinement. This anchor-based bootstrapping design allows for efficient generation of diverse, high-quality trajectories. Experiments on the NAVSIM benchmark confirm that AnchDrive sets a new state-of-the-art and shows strong generalizability. 1 INTRODUCTION End-to-end autonomous driving algorithms have gained substantial attention in recent years owing to their superior scalability and adaptability over traditional rule-based motion planning approaches. By learning control signals directly from raw sensor data—such as camera images or LiDAR point clouds—these methods bypass the complexity of modular design pipelines, mitigate the accumulation of perception errors, and enhance overall system consistency and robustness. Earlier end-to-end planners, including UniAD [ 1 ] , VAD [ 2 ] , and Transfuser [ 3 ] , relied on ego queries to regress single-modal trajectories, while more recent approaches such as SparseDrive [ 4 ] explored sparse perception modules in combination with parallel motion planners. Nevertheless, in complex traffic conditions—such as intersections or high-speed lane changes—potential vehicle behaviors can be highly ambiguous and diverse. Ignoring the inherent uncertainty in driving behavior and the multi-modal decision-making requirements imposed by environmental perception often leads to overconfident or outright failed predictions when relying on a single predicted trajectory. Recent research has therefore begun to incorporate multi-modal modeling strategies, producing multiple trajectory proposals consistent with current scene constraints to improve decision coverage. Methods such as VADv2 [ 5 ] and Hydra-MDP [ 6 ] achieve this by using predefined discrete trajectory sets. While this increases coverage to some extent, the reliance on fixed trajectory sets inherently discretizes what is fundamentally a continuous control process, thus constraining expressiveness and flexibility. Diffusion models have emerged as a promising alternative, offering generative and adaptive capabilities well suited for multi-modal trajectory planning. They enable direct sampling from the high-dimensional joint distribution of the ego vehicle and surrounding agents’ trajectories, and have demonstrated strong modeling capacity in high-dimensional continuous control spaces—evidenced by successes in domains such as image synthesis and robotic motion planning. Their ability to naturally model conditional distributions makes it straightforward to integrate key contextual inputs, including trajectory history, map semantics, and ego objectives, thereby improving both consistency and contextual relevance in policy generation. Moreover, their controllable test-time sampling allows for incorporating additional constraints without retraining, unlike many Transformer-based architectures. Despite improvements such as DDIM [ 7 ] for accelerating sampling, conventional diffusion models require numerous iterative denoising steps, resulting in high computational and latency costs at inference. To address this, prior work has shown that initializing the generation process from non-standard noise distributions can shorten the sampling path by leveraging prior information. Building on this idea, DiffusionDrive [ 8 ] proposed a truncated diffusion strategy that anchors the process to a fixed set of trajectory anchors, enabling sampling to begin from intermediate states and thus reducing the number of required iterations. However, such fixed anchor sets lack the flexibility to adapt to scenarios demanding dynamically generated anchors. We address this limitation with AnchDrive, a novel end-to-end multi-modal autonomous driving framework. AnchDrive employs a multi-head trajectory decoder to dynamically generate a set of dynamic trajectory anchors informed by scene perception, capturing behavioral diversity under local environmental conditions. Simultaneously, we construct a broad-coverage static anchor set from large-scale human driving data, providing cross-domain behavioral priors. These dynamic anchors provide context-aware guidance tailored to the immediate scene, while the static anchor set mitigates overfitting to training distributions and improves generalization to unseen environments. By leveraging this hybrid anchor set, our diffusion-based planner can produce high-quality and diverse predictions within a reduced number of denoising steps. We evaluate AnchDrive in closed-loop settings on the Navsim-v2 [ 9 ] simulation platform, which features reactive background traffic agents and high-fidelity synthetic multi-view imagery. Experiments on a navtest set show that AnchDrive achieves 85.5 EPDMS, indicating robust and contextually appropriate behavior generation in complex driving scenarios. Our key contributions are as follows: • We propose AnchDrive, an end-to-end autonomous driving framework that employs a truncated diffusion process initialized from a hybrid set of trajectory anchors. This approach, which integrates both dynamic and static anchors, significantly improves initial trajectory quality and enables robust planning. We validate its effectiveness on the challenging Navsim-v2 [ 9 ] benchmark. • We design a hybrid perception model with dense and sparse branches. The dense branch builds a bird’s-eye-view (BEV) representation for the planner’s primary input, while the sparse branch extracts instance-level cues—such as detected obstacles, lane boundaries, centerlines, and stop lines—to enhance the planner’s understanding of obstacles and road geometry. 2 Related Work 2.1 End-to-End Autonomous Driving Recent advances in end-to-end autonomous driving have shifted the field from traditional modular pipelines—where perception, prediction, and planning are handled independently—towards unified architectures that jointly optimize the full decision-making process. UniAD [ 1 ] demonstrated the potential of this paradigm by integrating multiple perception tasks into a shared representation space, effectively reducing error propagation and enhancing planning performance. Building upon this, VAD [ 2 ] introduced compact vectorized scene representations to improve computational efficiency while preserving semantic fidelity. Several subsequent works, including InterFuser [ 10 ] and LAV [ 11 ] , adopted a single-trajectory planning paradigm under imitation learning, where the model directly regresses a driving trajectory from raw sensor inputs. While effective in structured environments, these methods often fail to capture the inherent uncertainty and multi-modality present in complex, real-world driving scenarios. To address this, VADv2 [ 5 ] proposed a shift to multi-modal planning by constructing a fixed vocabulary of anchor trajectories and scoring them to generate diverse outputs. Hydra-MDP [ 6 ] further advanced this idea by incorporating multiple rule-based teacher policies to supervise the scoring mechanism, generating diverse candidate trajectories optimized for safety, comfort, and efficiency. This framework achieved top performance in the NAVSIM [ 12 ] challenge, highlighting the value of integrating expert-driven evaluation into learning-based planning. Complementary to these, Sparse methods [ 4 ] [ 13 ] explored a BEV-free architecture, showing that end-to-end planning can be achieved directly from raw sensor inputs without explicit 3D reconstructions, simplifying the pipeline while maintaining competitive performance. Recently, diffusion-based generative models have emerged as a compelling addition to end-to-end autonomous driving frameworks. Unlike regression methods that produce a single deterministic output, diffusion models generate diverse trajectories by learning to denoise from structured noise distributions. However, standard diffusion models suffer from high inference latency. To overcome this, frameworks such as DiffusionDrive [ 8

Read the complete text