GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoning
Danny Abraham, Nikhil Kamalkumar Advani, Arun Das, Nikil Dutt · 2026
Read GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoning by Danny Abraham, Nikhil Kamalkumar Advani, Arun Das, Nikil Dutt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26018.txt.
Introduction
Abraham and co-authors present GeoReFormer, a transformer for finding lane segments and their links. Online maps for self-driving need accurate 3D lanes plus correct topology. Lane segments are long polylines in directed graphs, unlike compact objects. Standard decoders ignore that structure. GeoReFormer builds geometric priors into its queries. It refines points inside bounded steps for stable shapes. A per-query gate controls how much relational context flows in. On OpenLane-V2, it reaches 34.5 percent mAP, the authors report. Topology consistency also beats strong baselines.
Catalog record
| CREATOR | Danny Abraham, Nikhil Kamalkumar Advani, Arun Das, Nikil Dutt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36009 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26018
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoning Danny Abraham, Nikhil Kamalkumar Advani, Arun Das, Nikil Dutt Abstract Accurate 3D lane segment detection and topology reasoning are critical for structured online map construction in autonomous driving. Recent transformer-based approaches formulate this task as query-based set prediction, yet largely inherit decoder designs originally developed for compact object detection. However, lane segments are continuous polylines embedded in directed graphs, and generic query initialization and unconstrained refinement do not explicitly encode this geometric and relational structure. We propose GeoReFormer (Geometry-aware Refinement Transformer), a unified query-based architecture that embeds geometry- and topology-aware inductive biases directly within the transformer decoder. GeoReFormer introduces data-driven geometric priors for structured query initialization, bounded coordinate-space refinement for stable polyline deformation, and per-query gated topology propagation to selectively integrate relational context. On the OpenLane-V2 benchmark, GeoReFormer achieves state-of-the-art performance with 34.5% mAP while improving topology consistency over strong transformer baselines, demonstrating the utility of explicit geometric and relational structure encoding. I INTRODUCTION Autonomous driving systems require structured and reliable perception of road geometry to enable downstream tasks such as motion planning, trajectory optimization, and safety-critical decision making. Beyond detecting individual lane markings, modern online mapping systems must recover directed lane centerlines, boundary types, and connectivity relationships that define the navigable road graph. Modern benchmarks such as OpenLane-V2 [ 19 ] formalize this problem as unified 3D lane detection and topology reasoning, providing large-scale multi-view datasets with metrics that jointly evaluate geometric fidelity and relational consistency. Transformer-based architectures inspired by the Detection Transformer (DETR) paradigm [ 2 ] have become the dominant framework for query-based lane mapping. These models represent lanes as sets of learnable queries that interact with bird’s-eye-view (BEV) features through cross-attention, with geometric predictions progressively updated across decoder layers. While these formulation offers strong global context modeling and flexible set prediction, most existing approaches inherit decoder designs originally developed for compact object detection, with limited adaptation to the structural properties of lane geometry. Unlike bounding boxes, lane segments are elongated polylines with strong geometric continuity and explicit connectivity relationships. However, most query-based lane mapping approaches inherit decoder designs originally developed for compact object detection. As a result, query initialization and geometric refinement are typically unconstrained, providing little inductive bias toward the spatial continuity and relational structure that characterize road layouts. This mismatch can limit the decoder’s ability to produce geometrically consistent lane representations and coherent topology predictions. In many architectures, topology reasoning is further separated into a parallel prediction head rather than integrated into the feature refinement process itself. Consequently, geometric estimation and relational reasoning are only weakly coupled during decoding. Finally, because the learned queries are initialized without explicit geometric structure, individual queries often lack consistent semantic roles. This makes it difficult to interpret which geometric patterns a given query is responsible for detecting, reducing transparency in how the model constructs the predicted lane graph. Fig. 1: Overview of GeoReFormer , a geometry-aware query-based transformer for joint 3D lane segment detection and topology estimation from multi-view cameras In this work, we introduce GeoReFormer ( Geo metry-aware Re finement Trans former ), a unified query-based architecture for joint 3D lane segment detection and topology estimation. GeoReFormer is built upon three complementary design principles that explicitly align the transformer decoder with the structure of lane geometry and connectivity. Fig. 1 shows GeoReFormer’s three-stage design flow. First, we incorporate data-driven geometric priors by clustering normalized lane polylines and using the resulting prototypes to initialize decoder reference points with structured spatial bias. Second, we reformulate iterative reference updates to operate directly in normalized coordinate space with bounded residual corrections, ensuring geometrically interpretable and controlled polyline refinement across decoder layers. Third, we integrate topology-aware feature propagation within the decoder by replacing the standard feed-forward network with a topology-gated graph convolution module that enables relational information flow among connected lane queries during feature transformation. Together, these components embed geometric and relational inductive biases directly into the decoding process. This design not only improves detection accuracy but also encourages queries to specialize toward consistent geometric roles, enabling interpretable query behavior. In summary, our contributions are: • GeoReFormer: A geometry-aware query-based transformer architecture for joint 3D lane detection and topology reasoning. • Data-Driven Geometric Prior Initialization: A clustering-based mechanism that embeds structured spatial bias into decoder reference points. • Bounded Coordinate-Space Refinement: A geometrically interpretable residual update rule that constrains iterative polyline deformation in normalized coordinate space. • Topology-Gated Feature Propagation: A decoder-level graph convolution mechanism that integrates relational reasoning directly into feature refinement. II RELATED WORK Online HD map construction aims to recover structured, vectorized road geometry and connectivity directly from onboard sensors. Early approaches predicted rasterized BEV semantics followed by post-processing to extract vector maps [ 7 ] . Recent benchmarks such as OpenLane-V2 [ 19 ] formalize unified 3D lane detection and topology reasoning, requiring joint prediction of polylines and directed connectivity, extending prior 3D lane perception works [ 3 ] with relational evaluation. Transformer-based set prediction inspired by DETR [ 2 ] has become the dominant paradigm for online mapping. In this formulation, a fixed set of learnable queries interacts with BEV features to predict vectorized lane elements end-to-end [ 14 , 12 , 9 , 21 ] . Subsequent works enhance topology reasoning using relational propagation or scene-graph modules [ 5 , 8 , 4 , 16 ] . Despite architectural variations, most methods inherit generic DETR-style query initialization and logit-space residual updates originally designed for compact object detection, where reference points are learned without explicit geometric structure and geometric refinement and topology reasoning remain loosely coupled. To improve robustness, several approaches extend query-based decoding to streaming or multi-frame settings by propagating queries and features across time [ 24 , 22 , 20 ] . Others incorporate structural priors from standard-definition maps or satellite imagery to guide geometry and connectivity prediction [ 25 , 17 , 15 , 23 , 18 ] . While effective, these strategies introduce additional supervision, memory overhead, or reliance on external infrastructure rather than strengthening the decoder’s internal geometric reasoning. In contrast, relatively limited attention has been given to the refinement mechanism within the transformer decoder itself. Existing approaches typically adopt unconstrained logit-space updates and treat topology reasoning as a separate head or post-hoc association module. GeoReFormer addresses this gap by embedding data-driven geometric priors for structured query initialization, bounded coordinate-space polyline refinement that preserves locality, and per-query gated topology propagation directly within the decoder. III GeoReFormer Fig. 2: Architecture of GeoReFormer . Multi-view images are lifted to BEV features and decoded from fixed geometric prios obtained via Spatially-Stratified K-Medoids. The decoder integrates bounded polyline refinement and per-query gated topology aggregation (TopoFFN). Prediction heads produce lane geometry and relational topology. We present GeoReFormer ( Geo metry-aware Re finement Trans former ), a query-based detector for joint 3D lane segment prediction and topology estimation from multi-view cameras. GeoReFormer builds upon the query-based detection paradigm of [ 9 ] and follows a three-stage pipeline: (1) multi-view image features are extracted and lifted into a unified BEV representation, (2) a set of \mathbf{Q} object queries, each representing a candidate lane segment, are iteratively refined through a transformer decoder that attends to the BEV features, and (3)