LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation

Zijie Wang, Weiming Zhang, Wei Zhang, Xiao Tan, Hongxing Liu, Yaowei Wang, Guanbin Li, [1ex] Sun Yat-sen University, Shenzhen Loop Area Institute, Baidu Inc · 2025

Read LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation by Zijie Wang, Weiming Zhang, Wei Zhang, Xiao Tan, Hongxing Liu, Yaowei Wang, Guanbin Li, [1ex] Sun Yat-sen University, Shenzhen Loop Area Institute, Baidu Inc (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06272.txt.

Introduction

Zijie Wang and colleagues apply generative diffusion models to lane centerline learning for self-driving cars. Centerline graphs guide path planning, but deterministic methods reason poorly about space and fail where lane markings are hidden. LaneDiffusion instead generates lane priors inside bird's-eye view data rather than drawing centerlines directly.

Two modules run the process: one injects lane priors into the features and one manages the diffusion that creates them. Centerlines in vector form and their links are then decoded from the enriched data. On the nuScenes and Argoverse2 datasets, LaneDiffusion beat existing methods across point-level and segment-level measures, setting new best results for centerline graph learning.

Catalog record

CREATORZijie Wang, Weiming Zhang, Wei Zhang, Xiao Tan, Hongxing Liu, Yaowei Wang, Guanbin Li, [1ex] Sun Yat-sen University, Shenzhen Loop Area Institute, Baidu Inc
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06272

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation Zijie Wang, Weiming Zhang, Wei Zhang, Xiao Tan, Hongxing Liu, Yaowei Wang, Guanbin Li, [1ex] Sun Yat-sen University, Shenzhen Loop Area Institute, Baidu Inc Abstract Centerline graphs, crucial for path planning in autonomous driving, are traditionally learned using deterministic methods. However, these methods often lack spatial reasoning and struggle with occluded or invisible centerlines. Generative approaches, despite their potential, remain underexplored in this domain. We introduce LaneDiffusion, a novel generative paradigm for centerline graph learning. LaneDiffusion innovatively employs diffusion models to generate lane centerline priors at the Bird’s Eye View (BEV) feature level, instead of directly predicting vectorized centerlines. Our method integrates a Lane Prior Injection Module (LPIM) and a Lane Prior Diffusion Module (LPDM) to effectively construct diffusion targets and manage the diffusion process. Furthermore, vectorized centerlines and topologies are then decoded from these prior-injected BEV features. Extensive evaluations on the nuScenes and Argoverse2 datasets demonstrate that LaneDiffusion significantly outperforms existing methods, achieving improvements of 4.2 % 4.2\% , 4.6 % 4.6\% , 4.7 % 4.7\% , 6.4 % 6.4\% and 1.8 % 1.8\% on fine-grained point-level metrics (GEO F1, TOPO F1, JTOPO F1, APLS and SDA) and 2.3 % 2.3\% , 6.4 % 6.4\% , 6.8 % 6.8\% and 2.1 % 2.1\% on segment-level metrics (IoU, mAP cf , DET l and TOP ll ). These results establish state-of-the-art performance in centerline graph learning, offering new insights into generative models for this task. Figure 1 : The Motivation. This illustration presents two challenging cases where the state-of-the-art deterministic approach, CGNet, encounters difficulties in handling occlusions or ambiguous visual cues. Our generative framework LaneDiffusion offers a supplementary solution that specifically mitigates these challenges through probabilistic modeling. 1 Introduction The topology of drivable lanes, typically represented as centerline graphs, is critical for autonomous driving, as it provides precise path information essential for safe and efficient planning and control of self-driving vehicles in complex driving scenarios [ 27 , 50 ] . However, the learning of centerline graphs remains challenging, as it requires highly accurate detection of invisible, logical lane centerlines and robust reasoning about their topological connections. Most previous centerline graph learning methods are deterministic [ 39 , 36 , 38 ] , whereas generative approaches have received little attention. Despite significant progress, deterministic methods still exhibit inherent limitations. For instance, the state-of-the-art deterministic approach CGNet [ 14 ] employs three effective modules to improve lane continuity from different perspectives. However, as illustrated in Fig. 1 , it struggles to capture the full complexity and dynamics of real-world driving in some complex scenarios involving occlusions or ambiguous visual cues. In contrast, the probabilistic modeling capability of generative approaches offers an intuitive supplementary solution to better handle this visual ambiguity. Despite their potential, employing generative approaches for centerline graph learning presents a non-trivial task. While PolyDiffuse [ 8 ] represents a pioneering step in employing generative models for road marker detection—identifying lane dividers, road boundaries, and pedestrian crossings—it falls short of learning logical lane centerlines and inferring lane topology. Furthermore, PolyDiffuse’s direct generation of vectorized final results via a diffusion module introduces significant complexities. Specifically, it still struggles to predetermine the number of vectorized outputs and relies heavily on a pre-trained external model as initial prior knowledge. These limitations underscore the need for a more effective generative paradigm for robust centerline graph learning. To this end, we introduce LaneDiffusion , a novel generative framework for lane centerline learning. Instead of directly generating vectorized outputs, LaneDiffusion takes a different approach: it generates Bird’s Eye View (BEV) features infused with centerline priors. These prior-injected BEV features are then processed by a lane decoder to produce high-quality vectorized centerlines. By operating at the BEV feature level, LaneDiffusion simplifies the learning process, effectively framing it as an image restoration task, and enhances flexibility for subsequent refinement. The LaneDiffusion pipeline unfolds in two key stages: (i) lane prior injection into the BEV feature to construct the diffusion target, and (ii) diffusion module training to generate the prior-injected BEV feature conditioned on the original input feature. This modular design renders LaneDiffusion a versatile and easily integrated add-on for BEV feature-based architectures. Accordingly, we introduce a Lane Prior Injection Module (LPIM) to embed lane ground truth (GT) information into the BEV feature, creating the diffusion target. Subsequently, a Lane Prior Diffusion Module (LPDM) learns to model this prior-injected BEV feature. To enhance inference efficiency, we employ a Markov chain that transitions from the prior-injected BEV feature back to the original BEV feature, rather than to Gaussian white noise, significantly reducing the required sampling steps. The generated lane prior undergoes refinement before being fed into lane decoders, which extract high-quality outputs, including vectorized centerline segments and their connectivity relationships, forming the centerline graph. The core contributions of this work are summarized as follows: • We introduce an end-to-end generative framework LaneDiffusion for centerline graph learning, which pioneers the use of diffusion models to generate lane centerline priors at the BEV feature level, instead of directly predicting vectorized centerlines. • We propose the Lane Prior Injection Module (LPIM) for injecting lane priors into BEV features as the diffusion target, and the Lane Prior Diffusion Module (LPDM) to model the prior-injected BEV feature. • Extensive experiments on the nuScenes [ 4 ] and Argoverse2 [ 52 ] datasets validate the effectiveness of LaneDiffusion and its components. The significant improvement of performance on both the fine-grained point-level metrics and the segment-level metrics establishes state-of-the-art performance in centerline graph learning and underscores the potential of generative models for handling the centerline graph learning task. 2 Related Works 2.1 Lane Graph Learning Early lane graph extraction works focused on extracting lane graphs from aerial and satellite imagery [ 2 , 34 , 18 , 17 ] . However, the low resolution and frequent occlusions of these images limited these methods to capturing only coarse road structures, rendering them unsuitable for high-precision autonomous driving. Later, methods such as STSU [ 5 ] introduced online lane graph construction using centerline segments from a single onboard camera [ 6 , 19 , 7 , 53 , 54 ] , but these were constrained by their limited field of view. More recently, TopoNet [ 32 ] utilized a graph-based architecture to predict connectivity among centerline segments using a surround-view camera system. LaneGAP [ 35 ] proposed a strategy to link centerline segments into complete paths by integrating path detection and vertex merging to preserve continuity. CGNet [ 14 ] addressed spatial discontinuities by segmenting lanes into non-overlapping parts and introducing dedicated modules for continuity enhancement. Other recent approaches, such as RNTR [ 42 ] , LaneGraph2Seq [ 45 ] and Topo2Seq [ 55 ] , leverage auto-regressive sequence-to-sequence modeling to advance lane topology learning. In contrast, our method, LaneDiffusion, is the first to use diffusion models for generating lane centerline priors directly at the BEV feature level, offering a seamless and novel approach to enhance lane graph learning in BEV-based frameworks. Figure 2 : The overall framework of LaneDiffusion. LaneDiffusion comprises two key components: (i) a Lane Prior Injection Module (LPIM), which injects lane priors into BEV features to construct the diffusion target, and (ii) a Lane

Read the complete text