Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light
Valeria Pais, Malena Mendilaharzu, Daniele Faccio, Luis Oala, Christoph Clausen, Bruno Sanguinetti · 2026
Read Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light by Valeria Pais, Malena Mendilaharzu, Daniele Faccio, Luis Oala, Christoph Clausen, Bruno Sanguinetti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22455.txt.
Introduction
Pais and colleagues use synthetic RAW image augmentation to probe pedestrian detection in low light. Real datasets are sparse and uneven, with long tails that hinder generalisation, and few samples in low-density regions. Synthetic samples fill gaps and sample the input space more continuously, improving benchmark coverage. For the safety-critical case of pedestrian detection in the dark, they generate low-light samples matching the camera sensor's noise model. Performance on real and synthetic low-light data is similar, suggesting the model struggles to tell them apart.
Catalog record
| CREATOR | Valeria Pais, Malena Mendilaharzu, Daniele Faccio, Luis Oala, Christoph Clausen, Bruno Sanguinetti |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30935 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22455
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light Valeria Pais, Malena Mendilaharzu, Daniele Faccio, Luis Oala, Christoph Clausen, Bruno Sanguinetti Abstract Real-world deployment of AI vision models is both fueled and limited by the data available for training and testing. Real datasets are sparse and uneven: long-tailed or unbalanced distributions hinder generalization, and the low number of samples in low density regions makes it hard to run evaluations. Synthetic data can fill these gaps, providing us with a way to sample the input space more continuously and improve data coverage for benchmarks. Focusing on the autonomous driving safety-critical case of pedestrian detection in the dark, we show how synthetic low-light samples can be used to better characterize the performance of a state-of-the-art object detection model as a function of the scene illumination. We use a synthetic RAW image augmentation technique to generate low-light samples that match the noise model of the camera sensor. Performance metrics on real and synthetic low-light data are similar, indicating that the AI model finds it hard to distinguish between them. Figure 1 : (a) AODRaw sliced test dataset distribution of person instances as a function of bounding box mean electrons and area. (b) Real normal-light sample from AODRaw and a synthetic example generated from it with a lower light level, but same area and noise model. (c) Guided by a complementary number of counts, we could sample target light levels from the resulting intensity PDF, synthesizing the data-points needed to create a more uniform overall distribution in the low light range, enabling a fairer evaluation. 1 Introduction Modern AI vision models have such a high performance that they can now act as the foundations of exciting autonomous agents such as self-driving cars. However, vision AI models are both empowered and limited by the real data used to train them. Long-tail, unbalanced datasets and out-of-distribution (OOD) cases can become dangerous hazards while interacting with humans, such as failure to detect a pedestrian leading to accidents. We believe synthetic data can help evaluate and mitigate such hazards. Images express light measurements as a function of a 2D location, so vision models are bound to be affected by two main characteristics of objects: mean illumination and size. Low light levels can cause detection models to fail because of the small dynamic range inside the bounding box and the overall scene. It is also difficult to detect small objects, not only because objects further away are less illuminated, but also because their small size may converge to the spatial resolution itself. Having a low number of samples with low intensity and area (Fig 1 a) makes these data points a minority, and sometimes even OOD, further complicating their detection and evaluation. Real data is discrete and limited, shaped by a data collection process that is expensive and naturally restricted by the scenes we can capture from the real world. In contrast, synthetic data allows a significantly higher degree of control. Owning the data generation pipeline, we can actively select samples to match target volumes and values on any continuous variable. For object detection models, we could in principle sample as many low-light scenes (Fig 1 b) as needed to balance the dataset (Fig. 1 c), allowing for broader data coverage when the model is trained and tested. We apply this idea to better characterize the performance of a state-of-the-art object detection model. We first use real data to evaluate person detection metrics as a function of the scene illumination, while averaging over size to diminish its influence as a confounding factor. We then use real RAW images to generate synthetic low-light samples in a controlled environment where we repeat the performance analysis, gaining further insight that is now completely isolated from any size variation effects. We finally compare the performance of the model on real and synthetic data, discussing the validity of this approach. 2 Related work Long-tailed distribution issues are severe in real-life applications such as autonomous driving because critical scenarios occur rarely and are dangerous to replicate 6 . Synthetic generation through computer graphic simulations 14 ; 31 ; 34 or generative AI 19 ; 1 ; 26 raises questions on realism and fidelity because most of these methods do not fully consider the noise sources of CMOS sensors 27 . Cameras possess an image signal processor (ISP) to generate sRGB images 3 ; 12 ; 8 . Unprocessed RAW images have a larger dynamic range and preserve more information along with the sensor’s linearity and pixel noise independence. Training, pre-training or fine-tuning on RAW enables better object detection 21 , instance 7 and semantic segmentation 10 in low-light scenes. However, labeled RAW datasets are fewer and smaller than sRGB datasets (e.g. PASCAL RAW 28 and LOD 18 have thousands of images, whereas ImageNet 13 has a million). To compensate for the lack of RAW data, many inverse ISP models aim at recovering RAW images from sRGB 3 ; 20 ; 2 . Some methods are designed to simultaneously tackle the domain gap between RAW and sRGB, adapting models trained on sRGB into RAW input domain 33 ; 30 ; 10 . An alternative solution is to carefully design data augmentation methods for RAW images that respect their noise and color filter array structure. RAW augmentations have been designed for cropping and clipping 23 and color jitter and blur 32 . We propose using Cui et al’s 11 intensity reduction algorithm directly on RAW images as a light level RAW augmentation. Other Physics-based light level augmentations had been done before 16 , but only on sRGB, and without a full Poisson-Gaussian noise model. 3 Methods 3.1 AODRaw dataset & object detection models We use AODRaw 21 as a study case: a state-of-the-art object detecion algorithm and dataset. Li et al report the best performance when first training on an ImageNet dataset 13 unprocessed into RAW images 3 and then finetuning on a collection of real RAW images made available inside the AODRaw dataset. The AODRaw test subset contains 2260 4024\times 6048 landscape images captured with a Sony A7M4 sensor. There are 4690 unique persons in these images, many of which are shown on traffic-related scenes and challenging conditions such as rain, fog and a low light setting. Li et al 21 preprocess RAW images with two different strategies: downsampling and slicing. Although they obtain the best overall metrics training on downsampled images, the sliced pre-processing enables better detection of small objects in challenging conditions. Moreover, the downsampling operation heavily warps the noise properties of RAW images. We therefore limit ourselves to the 9650 person instances in sliced images. For our experiments we build on the AODRaw repository and its MMDetetection interface 5 , along with its best-performing AODRaw model fine-tuned on sliced RAW: a Cascade RCNN model 4 with ConvNext 25 backbone. We calculate cumulative precision and recall to compute Average Precision (AP) 22 . We keep a constant score thresholds of 0.50 and we repeat the AP calculation for IOU thresholds between 0.50 and 0.95 with step 0.05. We then calculate Mean Average Precision (mAP) 22 . 3.2 RAW electron maps and light level reduction RAW images