Ghosts in the Point Clouds: De-glaring LiDAR in the Transient Domain

Avery Gump*, Connor Henley*, Sungjin Cheong, Akarsh Prabhakara, Mohit Gupta · 2026

Read Ghosts in the Point Clouds: De-glaring LiDAR in the Transient Domain by Avery Gump*, Connor Henley*, Sungjin Cheong, Akarsh Prabhakara, Mohit Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24753.txt.

Introduction

Avery Gump and others attack internal glare in compact LiDAR, where light from bright surfaces scatters inside the sensor. The artifacts create phantom objects, hide real ones, and threaten safety. The authors model glare as a linear, scene-independent operator on transient measurements, called TGSF. They develop a training-free method on low-level detections before point-cloud formation, weighing each detection for glare. The approach fits existing pipelines and unmodified commercial sensors. Real single-photon hardware tests suppress severe glare while preserving true scene structure.

Catalog record

CREATORAvery Gump*, Connor Henley*, Sungjin Cheong, Akarsh Prabhakara, Mohit Gupta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67212
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24753

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ghosts in the Point Clouds: De-glaring LiDAR in the Transient Domain Avery Gump*, Connor Henley*, Sungjin Cheong, Akarsh Prabhakara, Mohit Gupta Abstract Modern LiDARs are rapidly transitioning from bulky, mechanically scanned systems to ultra-compact, low-cost, solid-state arrays. This miniaturization—while enabling scalability, affordability, and camera-like data structures—introduces a new and severe failure mode: internal-multipath glare. When light from a bright or retroreflective surface reflects and scatters within the LiDAR, light that should reach a single pixel spreads across the pixel array. The resulting artifacts create phantom objects, obscure real ones, and produce safety-critical ‘‘ghosts in the point clouds.’’ This paper introduces a physically grounded sensing model and algorithmic techniques for addressing this effect. We show that internal glare can be represented as a linear, scene-independent operator—the Transient Glare Spread Function (TGSF)—acting on the transient measurements. Building on this model, we develop a training-free approach that operates on low-level LiDAR detections (or echoes) prior to point-cloud formation, leveraging knowledge of the glare spread function to reason about the likelihood of each detection arising from glare. The resulting approach is compatible with existing LiDAR signal-processing pipelines, and deployable on unmodified commercial sensors. Using experiments with real single-photon LiDAR hardware, we demonstrate substantial suppression of severe glare artifacts while preserving true scene structure. 1 1 footnotetext: Equal contribution 2 2 footnotetext: This research was supported by NSF CAREER Award 1943149, NSF grant CNS-2107060, NRT Award Number 2152163, and ONR grant N000142412155. We thank Sacha Jungerman for helpful discussions. wisionlab.com/project/deglaring-LiDAR 1 A Changing LiDAR Landscape LiDAR technology is undergoing a rapid and fundamental transformation. The field is moving away from legacy scanning-based systems—bulky, expensive, and mechanically complex—toward compact, solid-state architectures that are low-cost and scalable. This transition, driven in large part by the emergence of high-resolution Single-Photon Avalanche Diode (SPAD) arrays Charbon et al. 2013 , promises to transform LiDAR from a “necessary evil” into a reliable and inexpensive modality, much like “just another, but more informative, camera.” Furthermore, dense pixel arrays in future LiDARs will make their data resemble camera imagery in structure and scale, potentially merging camera and LiDAR processing pipelines. Figure 1 : (a) For an ideal LiDAR sensor, there is a one-to-one correspondence between scene point and sensor pixel. (b) “Camera-fication” of LiDAR leads to glare from internal optical scattering, multiple internal reflections, and electrical crosstalk. Figure 2 : Overview of our glare mitigation method. First, raw histograms are processed to extract intensity, mean time-of-flight (ToF), and ToF variance of several echoes per pixel. Second, a pileup correction method corrects the intensity and ToF of the brightest returns, which induce glare. Third, a glare model predicts the glare contribution to each echo. Finally, a confidence metric quantifies the likelihood that each echo contains signal in excess of the predicted glare. We choose the highest confidence echo at each pixel to form a depth map. This camera-fication of modern LiDARs comes with a cost. As in conventional cameras, modern LiDAR arrays view the world through shared optical elements. When a bright return enters the system, light that should ideally be focused onto a single pixel can undergo multiple internal reflections between the lens and sensor, and can scatter within the optical assembly itself, redistributing itself across a wider neighborhood of pixels. The result is an increasingly critical phenomenon we refer to as internal-multipath glare (also called blooming in the LiDAR community). 1 1 1 Unlike glare in passive imaging Talvala et al. 2007 ; Van Bastelaer et al. 2023 —typically driven by strong external sources such as sun or headlights in autonomous driving or bright stars in astronomy—LiDAR glare is self-induced by intense returns. The redistribution creates false or “phantom” structures while suppressing true returns from real surfaces. This results in LiDARs seeing what is not there (e.g., a phantom wall materializing on a freeway due to overhead signs that cause an autonomous vehicle to brake ), and simultaneously missing what is there (e.g., a child standing beneath a retroreflective stop sign could be obscured). Such ‘ghosts in the point clouds’ are safety-critical failure modes. One of the most common culprits are retroreflectors (road signs, license plates, lane markers, safety vests, and construction cones). These objects are deliberate and ubiquitous components of modern infrastructure; constructing a realistic scenario without glare sources may indeed be harder than constructing one with them. Why has this failure mode remained largely invisible to the research community? Historically, legacy LiDARs avoided severe optical crosstalk by design. Commercial scanning systems such as the Velodyne HDL-64e grouped detectors behind separate optical paths and—critically—fired only one detector per group at any given time. 2 2 2 For example, in the Velodyne HDL-64e, two groups of 32 detectors each share separate optics, and only one detector in each group is active at a time Velodyne LIDAR 2012 . This design choice was motivated explicitly by the need to prevent blooming when encountering retroreflectors. This combination of dedicated optics and scanning mechanisms effectively suppressed internal reflections, but at significant cost: large form factors, spinning mechanisms with higher cost/complexity, sparse point clouds, motion-induced artifacts, and limited resolution. Indeed, the severity of blooming was such that prior LiDAR generations adopted fundamentally sub-optimal hardware architectures to avoid it. Consequently, widely used datasets and benchmarks Geiger et al. 2013 ; Caesar et al. 2020 ; way 2019 , captured using such systems, exhibit minimal glare. The landscape is now changing. Modern solid-state LiDARs unlock high sensitivity, fine temporal resolution, and high-resolution arrays at low costs. However, these architectures alter internal light transport and acquisition, making internal glare not a corner case but a frequent and severe artifact. Internal glare breaks a foundational assumption underlying LiDAR processing: the one-to-one correspondence between a pixel and a single scene point ( Fig. 1 ). Once light from a bright return spreads across pixels, downstream steps (peak-finding, denoising, and point-cloud processing) operate on corrupted data. Waiting to address glare until after point cloud formation is often too late: the artifacts, becoming entangled with geometry, are difficult to separate from true scene elements, and retroreflector‐driven ghosts can appear more confident than the real objects. We argue that internal glare should be addressed early in the sensing pipeline, before point-cloud formation. Modern single-photon (SP) LiDARs Charbon et al. 2013 ; Lee et al. 2023 ; Lindell et al. 2018 capture rich temporal information in the form of transient histograms. In this measurement space, the physics of internal glare can be modeled as a linear, scene-independent operator acting on an ideal, glare-free transient histogram. We refer to this operator as the Transient Glare Spread Function (TGSF) , which describes how photons from a single pixel are redistributed across other pixels and neighboring time bins through internal reflections and scattering. 3 3 3 In practice, the temporal extent of this spreading is typically small, and the effect can be treated as predominantly spatial; thus, we refer to the operator as the Glare Spread Function (GSF) in the rest of the paper. Building on this observation, we develop LiDAR deglare algorithms that operate directly on low-level temporal peak detections (or echoes ) derived from transient histograms, prior to point-cloud formation ( Fig. 2 ). We leverage knowledge of the GSF as a forward model to

Read the complete text