High Dynamic Range Modulo Imaging for Robust Object Detection in Autonomous Driving
Kebin Contreras, Brayan Monroy, Jorge Bacca · 2025
Read High Dynamic Range Modulo Imaging for Robust Object Detection in Autonomous Driving by Kebin Contreras, Brayan Monroy, Jorge Bacca (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11472.txt.
Introduction
Kebin Contreras and co-authors bring modulo sensors to object detection for self driving in a 2025 paper. Bright scenes saturate normal cameras and wipe key details. High dynamic range shots need many captures, too slow for live driving.
Modulo pixels wrap round when full, storing light in coded form. Unwrapping math then rebuilds the full bright range image. One capture thus spans glare and shade at once. Tests ran a YOLO detector on the rebuilt views. Detection held up under extreme light swings in their trials. Extra rebuild time is the cost of the wider range.
Catalog record
| CREATOR | Kebin Contreras, Brayan Monroy, Jorge Bacca |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11472
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
High Dynamic Range Modulo Imaging for Robust Object Detection in Autonomous Driving Kebin Contreras, Brayan Monroy, Jorge Bacca Abstract Object detection precision is crucial for ensuring the safety and efficacy of autonomous driving systems. The quality of acquired images directly influences the ability of autonomous driving systems to correctly recognize and respond to other vehicles, pedestrians, and obstacles in real-time. However, real environments present extreme variations in lighting, causing saturation problems and resulting in the loss of crucial details for detection. Traditionally, High Dynamic Range (HDR) images have been preferred for their ability to capture a broad spectrum of light intensities, but the need for multiple captures to construct HDR images is inefficient for real-time applications in autonomous vehicles. To address these issues, this work introduces the use of modulo sensors for robust object detection. The modulo sensor allows pixels to ‘reset/wrap’ upon reaching saturation level by acquiring an irradiance encoding image which can then be recovered using unwrapping algorithms. The applied reconstruction techniques enable HDR recovery of color intensity and image details, ensuring better visual quality even under extreme lighting conditions at the cost of extra time. Experiments with the YOLOv10 model demonstrate that images processed using modulo images achieve performance comparable to HDR images and significantly surpass saturated images in terms of object detection accuracy. Moreover, the proposed modulo imaging step combined with HDR image reconstruction is shorter than the time required for conventional HDR image acquisition. 1 Introduction Object detection is a critical component of autonomous driving. The ability to accurately identify and respond appropriately to other vehicles, pedestrians, and obstacles depends largely on the quality of the acquired images. High-quality imaging is vital for enabling precise object detection, which is essential for the safe operation of autonomous vehicles in both urban and highway environments [ 1 ] . One of the acquisition problems is saturation, which can be identified as areas where pixels have reached maximum intensity, losing important information about the scene [ 2 ] . Addressing light saturation issues is crucial for the accuracy of object detection systems. Figure 1 illustrates common challenges such as overexposure due to direct sunlight (a), reflections of artificial nightlights (b) and loss of road details due to solar saturation (c), encountered in autonomous driving environments. An alternative is the well-known High Dynamic Range (HDR) imaging technique, which combines multiple exposure images to capture a broader spectrum of light intensities [ 3 ] . This approach effectively addresses the issues of underexposure and overexposure. However, the time required to process these images makes them impractical for real-time applications in autonomous driving [ 4 ] . A solution to address these challenges is the introduction of modulo sensor technology, which employs an irradiance encoding scheme. This technology allows pixels to ‘reset/wrap’ upon reaching saturation, thereby enabling continuous data recording. Although modulo images do not directly maintain the integrity of color at the moment of capture, they preserve sufficient details to enhance object detection. Furthermore, due to similarities with phase unwrapping problems, certain unwrapping algorithms can be employed to obtain HDR images during post-processing, which is crucial for achieving high visual quality under variable lighting conditions [ 5 , 6 ] . This technology is especially valuable in dynamic environments where lighting conditions can change rapidly and dramatically, providing a solution to preserve image information in cluttered areas. To the best of our knowledge, this is the first work to introduce the modulo sensor as an alternative for obtaining HDR images to enhance robust object detection in autonomous driving. We specifically evaluate the performance of object detection using YOLOv10 [ 7 ] models in various saturation scenarios and demonstrate that modulo measurements outperform commercial images under extreme conditions without the need for retraining. Furthermore, we propose to adapt the Simultaneous Phase Unwrapping and Denoising (SPUD) algorithm for direct HDR estimation from modulo images [ 8 ] . This approach significantly improves object detection results without significantly increasing processing time, making the modulo sensor a promising solution for autonomous driving systems. (a) (b) (c) Figure 1 : Challenges of sensor saturation in autonomous driving environments from various databases: (a) BDD100K shows problems of overexposure due to direct sunlight [ 9 ] ; (b) Nighttime Driving depicts reflections from artificial night lights [ 10 ] ; and (c) KITTI demonstrates the loss of road details due to solar saturation [ 11 ] . 2 Background Modulo Imaging. The image formation process in a modulo sensor involves the use of a modulo operator to reset the intensity values upon reaching a specific threshold of 2^{b} . This imaging process can be mathematically modeled as follows y=Q_{b}(\text{mod}(x,2^{b}))=W_{b}(x), (1) where y represents the acquired modulo image, Q_{b}(\cdot) represents the quantization process to b bits, x denotes the desired HDR image and \text{mod}(\cdot) refers to the modulo operator. The implementation of this particular imaging process has been explored with self-reset Analog-to-Digital Converter (ADC) [ 12 ] and with programmable sensors [ 5 ] . More recently, with the advancements of the Unlimited Sampling Framework, it is now possible to implement it using modulo-ADCs in continuous time, i.e., prior sampling [ 13 ] . Once the modulo image y is captured, a recovery process is needed to get an estimation of the HDR image x . However, this recovery process is an optional step since the object detection network can be employed directly to raw modulo image. Modulo Recovery. Given that the modulo operator is a non-linear transformation, it is impractical to directly employ numerical optimization techniques to reconstruct from the modulo image y . However, similar to the unwrapping problem, the spatial differences in the HDR image, \Delta x , matches with the wrapped spatial differences of the modulo image, expressed as \Delta x=M_{b}(\Delta y) , where M_{b}(\Delta y)=W_{b}(\Delta y+2^{b-1})-2^{b-1} is a centered modulo operator to align negative values [ 15 , 14 ] . This assumption holds if the natural image discontinuities do not exceed the threshold 2^{b-1} , namely, \|\Delta x\|_{\infty}<2^{b-1} , also referred to as Itoh’s condition [ 15 ] . Consequently, the HDR image recovery can be mathematically formulated as the following optimization problem \hat{x}\in\arg\min_{x}\left\|\Delta x-M_{b}(\Delta y)\right\|^{2}_{2}+\tau R(x), (2) where the regularization operator R(\cdot) is introduced to exploit additional knowledge about the structure of the HDR image x or to handle challenging recovery scenarios due to the presence of noise [ 18 , 16 , 17 ] . In the subsequent section, we introduce SPUD [ 8 ] , a non-interactive method to solve Equation 2 under sparsity assumption. 3 Methodology In this section, we detail our proposed methodology consisting of a two-step pipeline to process traffic images using modulo sensors: (A) Acquisition and Recovery with modulo sensors and (B) Object Detection on modulo images or over HDR recovered images. Algorithm 1 Object Detection with Modulo Images (ODMI) 1: Input: HDR image x , boolean p , color depth b , optimization parameter \tau 2: y\leftarrow W_{b}(x) \triangleright Simulation of modulo sensor Equation ( 1 ) 3: \hat{x}\leftarrow\texttt{SPUD}(y,b,\tau) \triangleright HDR image reconstruction Equation ( 3 ) 4: \mathcal{C}\leftarrow\texttt{YOLO}(\hat{x},y,p) \triangleright Calculation of boundary boxes Equation ( 4 ) 5: Return: \mathcal{C} \triangleright Set of boundary boxes Step A. Acquisition and Recovery with Modulo Sensors: