BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird’s-Eye View with Deformable Attention and Sparse Goal Proposals
Minsang Kong, Myeongjun Kim, Sang Gu Kang, Sang Hun Lee · 2025
Read BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird’s-Eye View with Deformable Attention and Sparse Goal Proposals by Minsang Kong, Myeongjun Kim, Sang Gu Kang, Sang Hun Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-10080.txt.
Introduction
Minsang Kong and 5 co-authors predict where traffic will move next without leaning on a prebuilt map in a 2025 self-driving paper. High-definition maps give forecasting models a tidy scaffold, but they cost heavily to maintain, cover only mapped ground, and age badly where roads change. Working from a bird's-eye view built directly out of sensor data promises freedom, at the price of dense, unstructured features that are slow to reason over.
Their BEVTraj system uses deformable attention to sip context only from useful spots in that dense view. A goal proposal module then names a short list of believable destinations, letting forecasts stay multimodal with no hand-written cleanup afterwards. Scores matched leading map-based systems while keeping the flexibility to drive unmapped streets.
Catalog record
| CREATOR | Minsang Kong, Myeongjun Kim, Sang Gu Kang, Sang Hun Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-10080
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird’s-Eye View with Deformable Attention and Sparse Goal Proposals Minsang Kong, Myeongjun Kim, Sang Gu Kang, Sang Hun Lee Abstract In autonomous driving, trajectory prediction is essential for ensuring safe and efficient navigation. To improve prediction accuracy, recent approaches often rely on pre-built high-definition (HD) maps or real-time local map construction modules to incorporate static environmental information. However, pre-built HD maps are limited to specific regions and cannot adapt to transient changes. In addition, local map construction modules, which recognize only predefined elements, may fail to capture critical scene details or introduce errors that degrade prediction performance. To overcome these limitations, we propose Bird’s-Eye View Trajectory Prediction (BEVTraj) , a novel trajectory prediction framework that operates directly in the bird’s-eye view (BEV) space utilizing real-time sensor data without relying on any pre-built maps. The BEVTraj leverages deformable attention to efficiently extract relevant context from dense BEV features. Furthermore, we introduce a Sparse Goal Candidate Proposal (SGCP) module, which enables full end-to-end prediction without requiring any post-processing steps. Extensive experiments demonstrate that the BEVTraj achieves performance comparable to state-of-the-art HD map-based models while offering greater flexibility by eliminating the dependency on pre-built maps. The source code is available at https://github.com/Kongminsang/bevtraj . I Introduction Trajectory prediction plays a pivotal role in autonomous driving, enabling vehicles to anticipate the future movements of surrounding agents and make safer, more informed decisions. However, this task remains inherently difficult due to the multimodal nature of agent behaviors and the complex interactions between agents and their environments. Accurately modeling these interactions demands a deep understanding of the environment’s structural constraints, such as road topology, which provide a critical context for forecasting dynamic behaviors. Standard-definition (SD) maps provide static information for the vast majority of roads worldwide but lack the precision and semantic richness required for advanced tasks such as autonomous driving. Recent studies have explored methods to extract static context from high-definition (HD) maps for trajectory prediction, leveraging autonomous driving datasets that include pre-built HD maps. However, reliance on pre-built HD maps presents critical limitations: their high construction costs and labor-intensive maintenance restrict coverage to limited regions and preclude real-time updates. As a result, trajectory prediction methods that depend on these maps are constrained to mapped areas and struggle to adapt to sudden changes in road conditions, such as construction zones or accidents For these reasons, methods for constructing local HD maps in real time have been proposed, enabling autonomous vehicles to operate in unmapped areas and rapidly adapt to dynamic road conditions [ 1 , 2 , 3 ] . These real-time HD maps are typically aligned with the ego vehicle’s coordinate frame, helping to mitigate failures caused by localization errors. However, if the prediction module relies solely on the outputs from the map construction process, it becomes highly susceptible to misclassification, missing elements, and positional inaccuracies. Moreover, most map construction methods detect only a limited set of predefined classes ( e.g. , dividers, boundaries, pedestrian crossings)from raw sensor data, which contains a broad range of environmental information. Without incorporating this additional scene context, an autonomous driving system may overlook critical cues that significantly affect trajectory prediction accuracy. To better leverage available information, it is important to actively utilize raw sensor data for trajectory prediction, as it contains rich semantic and geometric information that is not fully captured by HD maps. However, sensor data is significantly denser and more redundant than vectorized HD maps, necessitating a mechanism to extract only the most relevant information for trajectory prediction. To address this issue, we propose a novel framework, Bird’s-Eye View Trajectory prediction (BEVTraj) . Rather than relying on pre-built HD maps, BEVTraj constructs Bird’s-Eye View (BEV) representations from raw sensor data and directly employs them for trajectory prediction, leveraging deformable attention to extract essential cues from dense BEV features, as illustrated in Fig. 1 . Fig. 1: Two possible approaches for trajectory prediction in the absence of a pre-defined HD map. The first approach (top) constructs an HD map in real time and applies conventional HD map-based prediction methods. The second approach (bottom), proposed in this study as BEVTraj, directly predicts trajectories by leveraging BEV features extracted from raw sensor data. The BEVTraj framework offers several advantages over existing methods. Compared to approaches that rely on HD maps—which provide a high-level abstraction of the driving environment—directly leveraging low-level BEV representations significantly reduces information loss. Additionally, BEVTraj can be seamlessly integrated into modern autonomous driving systems that adopt the BEV paradigm [ 4 , 5 , 6 ] . By incorporating deformable attention, BEVTraj selectively aggregates only the most relevant features for accurate trajectory prediction. Furthermore, we introduce the Sparse Goal Candidate Proposal (SGCP) module to address the issue that the density of goal candidates strongly influences the performance of existing goal-based methods. With this module, BEVTraj supports fully end-to-end trajectory prediction without the need for post-processing steps such as non-maximum suppression (NMS). Our contributions are summarized as follows. • We propose Bird’s-Eye View Trajectory Prediction (BEVTraj), a novel goal-driven trajectory prediction framework that directly leverages BEV representations constructed from raw sensor data, thereby eliminating the reliance on pre-built HD maps. • BEVTraj utilizes low-level BEV feature representations that effectively capture essential scene context while substantially reducing information loss compared to high-level HD maps. • BEVTraj actively leverages deformable attention across multiple stages to selectively aggregate only the information critical for trajectory prediction, enhancing efficiency and prediction accuracy in dense and redundant BEV representations. • We introduce the Sparse Goal Candidate Proposal (SGCP) module, which alleviates the sensitivity of goal-based methods to goal candidate density and enables fully end-to-end trajectory prediction without the need for post-processing steps such as non-maximum suppression (NMS). • Our framework is fully compatible with modern autonomous driving systems adopting the BEV paradigm, facilitating seamless integration into existing pipelines. II Related Work Many studies have proposed trajectory prediction methods that leverage static information from pre-built HD maps. Early methods employed convolutional neural networks (CNNs) to process rasterized map images, capturing spatial features but suffering from information loss and suboptimal spatial encoding. These limitations rendered CNN-based approaches less effective for trajectory prediction compared to vectorized or graph-based representations, which provide more structured encodings of road layouts and traffic constraints [ 7 , 8 , 9 , 10 , 11 , 12 ] . With this shift, Transformer-based models have emerged, utilizing self-attention mechanisms [ 13 ] to model complex spatial relationships and improve map feature representations [ 14 , 15 , 16 , 17 , 18 , 19 ] . In particular, HiVT [ 18 ] adopts an agent-centric representation, where scene elements are normalized with respect to each agent’s coordinate frame to enhance prediction accuracy. In contrast, QCNet [ 19 ] adopts a query-centric design, avoiding per-agent normalization and enabling more efficient multi-agent trajectory prediction. Some approaches adopt goal-based methods, where multiple goal candidates are generated to predict multimodal future trajectories, as seen in DenseTNT [ 20 ] and MTR(Motion Transformer) [ 15 ] .]. Among them, MTR—most relevant to our work—draws inspiration from Conditional DETR [ 21 ] and DAB-DETR [ 22 ] , assigning initial position embeddings to queries to accelerate training convergence. It also introduces a