AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection
Loveneet Saini, Mirko Meuter, Hasan Tercan, Tobias Meisen · 2025
Read AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection by Loveneet Saini, Mirko Meuter, Hasan Tercan, Tobias Meisen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00559.txt.
Introduction
Loveneet Saini and co-authors detect objects from car radar over time in this 2025 paper. Bird's-eye view detection guides advanced driver systems. Radar is cheap and weather-proof, but its data are sparse and erratic, so single snapshots underperform.
Their method, AttentiveGRU, carries a memory of past frames. Attention picks out the structures that persist across time for each object. Fusing present and memory enriches both still and moving targets. The design leans on the steadiness of an object's hidden code over time. Radar-only perception could get cheaper and safer if such temporal tricks close the gap with cameras.
Catalog record
| CREATOR | Loveneet Saini, Mirko Meuter, Hasan Tercan, Tobias Meisen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00559
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection Loveneet Saini, Mirko Meuter, Hasan Tercan, Tobias Meisen Abstract Bird’s-eye view (BEV) object detection has become important for advanced automotive 3D radar-based perception systems. However, the inherently sparse and non-deterministic nature of radar data limits the effectiveness of traditional single-frame BEV paradigms. In this paper, we addresses this limitation by introducing AttentiveGRU, a novel attention-based recurrent approach tailored for radar constraints, which extracts individualized spatio-temporal context for objects by dynamically identifying and fusing temporally correlated structures across present and memory states. By leveraging the consistency of object’s latent representation over time, our approach exploits temporal relations to enrich feature representations for both stationary and moving objects, thereby enhancing detection performance and eliminating the need for externally providing or estimating any information about ego vehicle motion. Our experimental results on the public nuScenes dataset show a significant increase in mAP for the car category by 21% over the best radar-only submission. Further evaluations on an additional dataset demonstrate notable improvements in object detection capabilities, underscoring the applicability and effectiveness of our method. August 24, 2026 K eywords Radar Perception \cdot Temporal Fusion \cdot Attention 1 Introduction Perception systems in today’s vehicles support a wide range of applications, such as automatic emergency braking (AEB) and automatic valet parking (AVP). Thereby, the standard industry approach is to use a multi-sensor suite of radar, lidar, and cameras to facilitate these complex applications. Radar, known for its superior long-range capabilities and effectiveness in adverse weather conditions, as well as its Doppler measurement feature, has become an integral part of these perception systems. The automotive 3D radar system processes reflections from targets through a signal processing chain that estimates parameters such as time-of-flight and arrival angle, and produces range-azimuth-Doppler (RAD) feature maps of the scene within the radar’s field of view. Despite its lower resolution and sparser data compared to lidar and cameras, radar’s ability to capture point reflections from objects provides unique object detection capabilities through distinct target signatures in the radar measurement space. Recent deep learning approaches to radar data have explored a variety of input formats. The state of the art includes models that process a single radar frame either in a point cloud format, emphasizing specific local features [ 1 ] , or in a Bird’s Eye View (BEV) grid format, facilitating the natural extraction of local patterns [ 2 , 3 ] . Notably, due to emerging trend of fusing different sensors like camera and radar in common BEV space, the research in radar exclusive BEV based detection has become of significant importance as it helps in establishing stronger backbones in such multi-modal architectures. Radar, as a low-resolution sensor, is inherently affected by sparsity issues [ 4 , 5 ] . To mitigate this, some single-frame approaches have employed the concatenation of multiple radar frames to generate a denser input [ 6 ] . However, this method of aggregation is computationally demanding and fails to leverage the advantages of exploiting temporal relationships. Hence, in this work, we propose a model that harnesses the temporal relationship patterns in BEV radar data using recurrent methods. For denser input modalities like lidar, recent research underscores the advantages of incorporating temporal relationships. These multi-frame approaches [ 7 , 8 ] generally begin by aligning pixel-wise BEV features from historical data with current inputs to compensate for ego-vehicle motion, utilizing either a learned or externally provided ego-pose matrix, and subsequently integrate them using ConvGRU [ 9 ] or attention mechanisms [ 10 ] . A similar and more up-to-date approach is utilized for camera images, where historic information is pre-aligned using ego-vehicle information [ 11 , 12 ] . Specifically in [ 11 ] , Li et al. have noted that the availability of an ego pose matrix allows the alignment of only stationary objects due to the varying dynamics of moving objects in the scene. Following such pre-alignment with external ego information, Li et al. have proposed using deformable attention to model temporal relations by concatenating features from past and present 2D BEV queries. However, these lidar and camera specialized methods are less robust to the constraints posed by commercial radar data (demonstrated below) unless high-resolution radar imaging techniques are employed, which comes with increased pre-processing, data requirements, and costs. Figure 1: Radar reflections for two consecutive scans from a truck approaching towards ego vehicle in the direction of arrow In the radar measurement space, objects are detected by capturing point reflections of radar signal from objects (see Figure 1 ) . Due to longer wavelengths of the radar sensor [ 4 , 5 ] the representations of objects in this space can be highly sparse with high dynamic noise. Specifically, the highly sparse reflections from the same object across consecutive scanned frames may vary in terms of the part of the object they originate from (front of truck in Figure 1 ) , rendering them non-deterministic. Furthermore, unlike camera and lidar, the radar receiver antenna exhibits the highest sensitivity at the center of its beam (boresight), with sensitivity diminishing at greater angles. This attribute leads to progressively weaker observability of objects as they move away from the boresight. Consequently, depending on the dynamics of the object, its representation may appear smeared and significantly noisy when observed across consecutive frames. The above mentioned challenges associated with the radar feature maps makes the direct use of temporal fusion methods from lidar and camera non-trivial. However, radar’s ability to provide depth (range) and velocity (Doppler) of targets provides a unique opportunity to correlate objects over time. In typical driving scenarios, where objects do not abruptly change their motion, the range-azimuth features facilitate object matching across spatial depths, while the velocity feature aids in tracking moving objects across adjacent scans. In this paper, we present a novel plug and play temporal fusion layer for improving existing radar based object detectors for the widely used Range-Azimuth-Doppler (RAD) radar input format. Our proposed layer has linear computational complexity and is designed to improve object detection performance without the need for providing or estimating ego motion based transformations. Specifically, our model incorporates a module inspired by the Perceiver [ 13 ] , which exploits the consistency of an object’s latent encodings (query) across time frames to identify and fuse correlated object structures in a recurrent manner. We benchmark our proposed model using the public nuScenes dataset [ 14 ] and additionally use a larger and more complex proprietary radar dataset from [ 15 ] for rigorous evaluation and detailed ablation studies. In summary, the contributions of this paper are as follows: • We propose a temporal fusion layer tailored for radar data, to enhance detection performance by integrating individualized spatio-temporal contexts for each object recurrently over input time frames. This layer significantly reduces the computational effort by having linear complexity in both space and time and brings advantages of temporal fusion to highly sparse and challenging inputs. • We address a gap in the existing radar literature by combining the recurrence of GRUs with the attention mechanism to introduce a novel "attention gating" approach. This enhancement improves the ability of the GRU to selectively focus on temporally correlated locations for both