No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids

Mohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad · 2026

Read No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids by Mohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21638.txt.

Introduction

Sadoun and co-authors build a drone detector for event cameras that never turns sparse data into dense grids. Event cameras suit small, fast drones, but standard detectors densify the stream and waste the advantage. Their SparseVoxelDet runs its backbone, pyramid, and detection head directly on coordinate-indexed features. They name a failure mode, support inflation, where nearly empty inputs grow near-dense by the head. A fusion step that provably adds no new sites fixes it. The detector beat dense controls on the FRED benchmark.

Catalog record

CREATORMohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66332
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21638

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids Mohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad Abstract Event cameras produce asynchronous, high-dynamic-range streams well suited for detecting small, fast-moving drones, yet most event-based detectors convert the sparse event stream into dense tensors, discarding the representational efficiency of neuromorphic sensing. We propose SparseVoxelDet, to our knowledge the first fully sparse object detector for event cameras, in which backbone feature extraction, feature pyramid fusion, and the detection head all operate exclusively on occupied voxel positions through 3D sparse convolutions; no dense feature tensor is instantiated at any stage of the pipeline. On the FRED benchmark (629,832 annotated frames), SparseVoxelDet achieves 83.38% mAP@50 while processing only ∼ {\sim} 14,900 active voxels per frame (0.23% of the T × {\times} H × {\times} W grid), compared to 409,600 pixels for the dense YOLOv11 baseline (87.68% mAP@50). Relaxing the IoU threshold from 0.50 to 0.40 recovers mAP to 89.26%, indicating that the remaining accuracy gap is dominated by box regression precision rather than detection capability. The sparse representation yields 858 × \times GPU memory compression and 3,670 × \times storage reduction relative to the equivalent dense 3D voxel tensor, with data-structure size that scales with scene dynamics rather than sensor resolution. Error forensics across 119,459 test frames confirms that 71% of failures are localization near-misses rather than missed targets. These results demonstrate that native sparse processing is a viable paradigm for event-camera object detection, exploiting the structural sparsity of neuromorphic sensor data without requiring neuromorphic computing hardware, and providing a framework whose representation cost is governed by scene activity rather than pixel count, a property that becomes increasingly valuable as event cameras scale to higher resolutions. keywords Event camera; Sparse 3D convolution; Drone detection; Object detection; Event-based vision; Sparse voxel representation 1 Introduction Detecting small unmanned aerial vehicles (drones) in real time is critical for airspace security, yet conventional RGB-based detectors struggle under low-light, high-dynamic-range, and cluttered-sky conditions ( 21 ) . Event cameras, neuromorphic sensors that asynchronously report per-pixel brightness changes with microsecond latency and > 120 dB dynamic range ( 15 ) , are increasingly used for this task ( 7 ) . Recent benchmarks such as FRED ( 21 ) demonstrate that dense detectors applied to event-frame representations already achieve strong accuracy (87.68% mAP@50 with YOLOv11), validating the information content of the event stream for drone detection. However, converting asynchronous events into dense frame-like tensors fundamentally discards the sensor’s most distinctive property: extreme sparsity . On the FRED benchmark, typical event frames occupy less than 1% of the input voxel grid, yet dense detectors must process all 409,600 pixel positions after resizing to 640 \times 640. This dense conversion imposes a computational cost disproportionate to the actual information content, undermining the efficiency promise of neuromorphic sensing (Figure 1 ). This mismatch creates a central opportunity for neuromorphic perception: if computation is tied to event activity rather than image resolution, event-camera systems can scale to higher resolutions and longer deployments without inheriting the full cost profile of dense vision pipelines. In the LiDAR domain, sparse 3D convolution backbones such as SECOND ( 35 ) and detection frameworks including PointPillars ( 14 ) and CenterPoint ( 36 ) have progressively reduced the reliance on dense representations. Most recently, VoxelNeXt ( 1 ) demonstrated that point-cloud object detection can be performed entirely through sparse 3D convolutions without constructing any dense bird’s-eye-view maps. We observe that event-camera voxel grids share a similar sparse structure: both are 3D tensors (temporal bins \times height \times width for events; depth \times height \times width for LiDAR) with low occupancy rates. This structural analogy motivates our central hypothesis: can an object detector process event data natively in the sparse domain, end-to-end, without any dense tensor conversion? We present SparseVoxelDet, to our knowledge the first fully sparse object detector for event cameras. Existing event detectors either convert events to dense frames before applying conventional architectures ( 24 ; 9 ; 19 ) or employ sparse representations only partially, reverting to dense feature maps at intermediate stages ( 23 ; 5 ) . SparseVoxelDet maintains sparse 3D tensor representations end-to-end, reframing event-camera detection as a native sparse-computation problem rather than a dense-image adaptation. The architecture chains three purely sparse stages: (1) a SparseSEResNet backbone that processes event voxel grids through 3D sparse convolutions with element-wise residual connections and squeeze-and-excitation attention, producing multi-scale features at strides 4, 8, and 16; (2) a Sparse Feature Pyramid Network that fuses these scales top-down through sparse lateral connections and sparse transpose convolutions, producing a unified feature map at stride 4; and (3) a SparseDetHead that applies an MLP to each active voxel position to predict classification, box regression (LTRB), and centerness, following the anchor-free FCOS formulation ( 34 ) . After temporal max-pooling to collapse the time dimension, non-maximum suppression yields final detections. No dense feature map is allocated at any point. On the FRED canonical drone detection benchmark ( 21 ) , SparseVoxelDet achieves 83.38% mAP@50 with 6.2M parameters, narrowing the gap to the YOLOv11 baseline (87.68%) to 4.3 percentage points. To understand the nature of this gap, we conduct an error forensics analysis across all 119,459 test frames. The analysis reveals: (i) 71% of false negatives are localization near-misses (IoU >0 but <0.5 ), indicating the model detects the drone but regresses imprecise boxes; (ii) confidence separation is strong ( \mu_{\text{TP}}=0.46 vs. \mu_{\text{FP}}=0.11 ); and (iii) recall reaches 95.4% at IoU \geq 0.40 , confirming that the gap is predominantly a box-tightness penalty rather than a detection failure. Our contributions are twofold: 1. Fully sparse architecture. We introduce SparseVoxelDet, an event-camera object detector that performs all computation in the sparse voxel domain. The model processes {\sim} 14,900 active voxels per frame (28 \times fewer than dense baselines) and achieves 83.38% mAP@50 (within 4.3 points of the dense baseline), with 858 \times GPU memory compression and 3,670 \times storage reduction relative to the equivalent dense 3D voxel tensor. While dense detector cost grows as O(H\times W) with sensor resolution, SparseVoxelDet’s cost is proportional to scene activity: the active voxel count increases by only 9% when moving from 640^{2} to native 1280\times 720 , despite a 2.25\times increase in pixel count. The architecture uses a 6-channel temporal surface feature representation incorporating recency and temporal variation that enables operation at any sensor resolution without architectural modification. 2. Error forensics and empirical analysis. Through a systematic analysis pipeline applied across the FRED drone detection benchmark, we decompose detection failures into actionable categories (localization error, confidence ranking, object size, event density) and identify box regression precision, an inherent challenge of sparse representations that lack dense neighborhood context, as the primary performance bottleneck. This provides a sparse-native evaluation on FRED and a reusable forensics methodology applicable to any single-class detector. Dense Processing drone 409,600 pixels processed > 95% empty \Longrightarrow Sparse Processing \mathbf{C}\in\mathbb{Z}^{M\times 3} , \mathbf{F}\in\mathbb{R}^{M\times 6} Only active voxels ( < 1% of grid) \sim 28 \times fewer positions than YOLO Figure 1: Dense vs. sparse processing. Left: dense detectors process all pixel positions in the input grid, including the {>} 95% containing no events (gray). Right: SparseVoxelDet processes only the active voxel positions (blue

Read the complete text