Noise2Ghost: Self-supervised deep convolutional reconstruction for ghost imaging
Mathieu Manni, 1,2 Dmitry Karpov, 3 Kees Joost Batenburg, 4 Sharon Shwartz, 2 and Nicola Viganò 3,* · 2025
Read Noise2Ghost: Self-supervised deep convolutional reconstruction for ghost imaging by Mathieu Manni, 1,2 Dmitry Karpov, 3 Kees Joost Batenburg, 4 Sharon Shwartz, 2 and Nicola Viganò 3,* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10288.txt.
Introduction
Mathieu Manni and four co-authors sharpen ghost imaging without ever seeing a clean reference image. Their paper appeared in two thousand twenty-five. Ghost imaging builds pictures from light that never touched the object directly. It suits low-light and delicate samples. Noise is its chronic weakness. Supervised deep learning needs clean targets, which are often unobtainable.
Their Noise2Ghost method learns from the noisy data alone. A deep convolutional network reconstructs the image in a self-supervised way. Among unsupervised rivals, its quality stands out in their tests. Math backing and real-data cases support the claims. X-ray fluorescence imaging of dose-sensitive samples is a target use. Live studies of cells and batteries could benefit.
Catalog record
| CREATOR | Mathieu Manni, 1,2 Dmitry Karpov, 3 Kees Joost Batenburg, 4 Sharon Shwartz, 2 and Nicola Viganò 3,* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-10288
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Noise2Ghost: Self-supervised deep convolutional reconstruction for ghost imaging Mathieu Manni, 1,2 Dmitry Karpov, 3 Kees Joost Batenburg, 4 Sharon Shwartz, 2 and Nicola Viganò 3,* Abstract We present a new self-supervised deep-learning-based Ghost Imaging (GI) reconstruction method, which provides unparalleled reconstruction quality for noisy acquisitions among unsupervised methods. We present the supporting mathematical framework and results from theoretical and real data use cases. Self-supervision removes the need for clean reference data while offering strong noise reduction. This provides the necessary tools for addressing signal-to-noise ratio concerns for GI acquisitions in emerging and cutting-edge low-light GI scenarios. Notable examples include micro- and nano-scale x-ray emission imaging, e.g., x-ray fluorescence imaging of dose-sensitive samples. Their applications include in-vivo and in-operando case studies for biological samples and batteries. Journal: opticajournal Publication type: Research Article 1 Introduction Ghost imaging (GI) is a paradigm-changing technique that is mostly known and anticipated for its promise to cut radiation doses. However, these possible radiation dose advantages rely on a much more fundamental concept: The ability to choose the trade-off between spatial resolution, field-of-view (FoV), and acquisition time somewhat independently of the incident beam size. Traditionally, to spatially resolve diffused signals like x-ray fluorescence (XRF), one had to raster scan the object of interest with focused illumination (pencil-beam, PB, Fig. 1a ). The PB focal spot size determines the spatial resolution. Classical GI achieves that by probing extended regions of a sample at once with structured illumination ( Fig. 1b ). This provides spatially resolved information, whose resolution is independent of the beam size and detector pixel size, but depends instead on the size of the beam structures. Hereafter, we will refer to classical GI simply as GI, which, unlike quantum GI [ 1 ] , does not require pairs of quantum entangled photons. A detector that does not observe the illumination beam collects the signals of interest. The acquired GI realizations, composed of the detected signals with each associated illumination beam structure, are then combined and computationally reconstructed into a two-dimensional projection image of the probed object (in the given contrast). This means that the acquired data mathematically resides in a different space from the reconstructed image space, and the reconstruction problem is a so-called inverse problem . The algorithm used to perform this inversion, known as the reconstruction method , significantly influences the quality and accuracy of the reconstructed image, particularly under noisy conditions. GI is independent of the contrast and probe type used, and it has been demonstrated with radiation across the whole electromagnetic spectrum [ 2 , 3 ] , neutrons [ 4 ] , electrons [ 5 ] , and atoms [ 6 ] . Thus, it can be used for the same applications where PB raster scanning is used. The advantages of GI compared to PB acquisitions stem from the inherent small- and large-scale correlations found in natural images, which make them compressible under suitable representations [ 7 ] , while non-structured noise is not. Thanks to the structured illumination, which can capture unique large- and small-scale information for each measurement, GI grants image reconstruction with fewer data points than reconstructed pixels. Thus, GI unlocks potential gains in acquisition speed or deposited dose, compared to raster scanning, by simply reducing the number of acquired data points [ 8 ] . a Pencil Beam b Classical Ghost Imaging Figure 1 : Schematic representation of diffused emission signal acquisitions (e.g., x-ray fluorescence imaging) using pencil raster beam scanning ( 1a ) and ghost imaging ( 1b ). The former uses a point beam to scan every pixel to form an image, while the latter illuminates the sample with a series of structured beams. GI offers a specific advantage over PB scanning for dose-sensitive samples. High-flux focused PBs create significant excess charges in small localized regions at each exposure from radiation-induced local ionization of the samples. This is one of the main contributors to damage in biological samples and the skewing of functioning parameters in batteries during acquisitions. On the contrary, GI creates this same charge on a much larger area (i.e., the whole illumination field-of-view). The latter can recombine and/or disperse faster than the former, leading to lower degradation over time. For instance, in cryogenic electron microscopy (also known as cryo-EM), reduced dose rates have been observed to produce less damage compared to higher dose rates at the same total dose [ 9 ] . Thanks to all these advantages, GI has the potential to spark many breakthroughs in applications in various fields ranging from biomedical imaging to remote sensing. However, GI has only seen limited applicability so far, especially in the above-mentioned nano-scale imaging applications. In these cases, the observed signals are affected by overwhelmingly high Poisson noise levels due to their very small photon fluxes. This noise type does not enjoy the intrinsic noise reduction of GI, known as Felgett’s advantage, thus reducing GI’s advantage over PB [ 8 ] . Both traditional methods, based on regularized variational reconstructions (e.g., Total Variation minimization - TV-min [ 10 ] ), and modern machine learning (ML) techniques (both supervised [ 11 ] and unsupervised [ 12 ] ) are not specifically designed for this scenario. Here, we propose a GI reconstruction method particularly suited for working with acquisitions affected by high noise levels, regardless of whether the noise type is Gaussian or Poisson. Our method leverages the latest developments in unsupervised ML techniques, so it does not require high-quality reference data. This work is a step towards practical applications of GI, particularly for photon-limited scenarios like nano-scale x-ray emission imaging [ 13 ] . 2 Method In this section, we present the proposed method, Noise2Ghost (N2G). First, we introduce related methods. Then, we describe the signal formation (forward) model and present our proposed reconstruction method. Finally, we show how this method addresses random acquisition noise. The code of the algorithms presented in this section is available at [ 14 ] . 2.1 Existing methods GI’s ability to obtain images with more pixels than the acquired realizations results in an undersampled reconstruction problem. These reconstructions require some prior knowledge (regularization) to recover accurate images: Unregularized least-squares (LS) reconstructions present specific high-frequency large-scale artifacts that resemble high noise levels. Methods employing convolutional neural networks (CNNs) are currently the best-performing tools for image processing applications. They can capture small- and large-scale correlations and learn the most suitable representations to capture the features of the treated signals (acting like regularizers) [ 15 ] . Thus, they are also better suited for GI reconstructions than traditional variational methods, e.g., TV-min, which use strong but also rather simple a priori assumptions on the types of features present in the reconstructed images. Table 1 : Comparison of GI Reconstruction Methods Method Description Advantages Limitations Unregularized Least-Squares (LS) Direct reconstruction without regularization Simple, no prior assumptions High-frequency artifacts; high noise levels; no compression Regularized Variational (e.g., TV) Uses strong a priori assumptions (e.g., sparsity, smoothness) Robust; cheap; reference in literature Oversimplified assumptions; limited feature capture Supervised denoising (e.g., DeepGhost) Uses pairs of LS and high-quality reconstructions Effective for known image types Dependent on large, similar training data; sensitive to parameter variations Self-Supervised denoising (e.g., N2V, N2N) No pre-training; denoising in image space