Improving Richardson–Lucy Deconvolution with Diffusion Priors for Fluorescence Microscopy
Hao Chen, Scott S. Howard · 2026
Read Improving Richardson–Lucy Deconvolution with Diffusion Priors for Fluorescence Microscopy by Hao Chen, Scott S. Howard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25924.txt.
Introduction
Hao Chen and Scott Howard work on sharpening fluorescence microscopy images, pictures of glowing tagged molecules inside cells. The standard Richardson-Lucy method undoes some blur from diffraction, but the task is fundamentally ill-posed: many sharp images could produce the same noisy measurement. At low photon counts the method amplifies noise, while common smoothing fixes erase fine detail.
Guidance comes instead from a learned diffusion prior, a generative model that knows what plausible cell structures look like. Chen and Howard insert that prior into the Richardson-Lucy iterations while keeping the method's Poisson data consistency intact. Across varied biological samples, noise amplification drops and weak thread-like and dot-like structures survive better under dim imaging. The gains hold for structures that smoothing regularizers such as total variation tend to wash away.
Catalog record
| CREATOR | Hao Chen, Scott S. Howard |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25924
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Richardson–Lucy Deconvolution with Diffusion Priors for Fluorescence Microscopy Hao Chen, Scott S. Howard Abstract Richardson–Lucy (RL) deconvolution improves fluorescence microscopy images by recovering details lost to diffraction. It estimates the original fluorescence signal that most likely produced the measured photon counts under a Poisson imaging model. Although RL incorporates a physical model of fluorescence image formation and can improve contrast, deconvolution remains fundamentally ill-posed, and the measurements alone provide limited evidence for reliably reconstructing fine biological structure. Without additional structural guidance, RL can amplify noise and exhibit unstable convergence in low-photon regimes. Regularizers such as total variation (TV) reduce this instability but often introduce oversmoothing. Here, we investigate learned generative priors as a form of structural guidance for RL by integrating a score-based diffusion prior into a decoupled inverse-problem framework for fluorescence microscopy deconvolution. The diffusion prior is used during the RL optimization iterations, while RL retains Poisson data consistency. We validate the framework across diverse biological samples and cellular morphologies. The results show reduced RL noise amplification with improved preservation of weak filamentous and punctate structures under low photon counts. 1 Introduction Fluorescence microscopy is widely applied in biology and the life sciences, enabling visualization of labeled molecules, such as proteins, in living cells, tissues, and whole organisms [ 28 , 24 , 22 ] . Modern modalities, including widefield, confocal, and two-photon microscopy, offer different trade-offs in field of view, optical sectioning, imaging depth, acquisition speed, and spatial resolution [ 12 , 54 , 41 , 14 , 11 , 17 ] . Despite these differences, their image formation can be described under the same physical forward model. The point-spread function (PSF) is the diffraction-governed intensity impulse response of the optical system. Photons emitted from the fluorescent specimen are distributed according to the PSF, with detection limited by Poisson photon shot noise [ 16 , 48 , 6 , 1 ] . Deconvolution techniques aim to recover sample structure and density from this image-formation model [ 35 , 3 , 31 , 34 , 55 , 32 ] . From a Bayesian perspective, classical Richardson–Lucy (RL) deconvolution uses expectation–maximization updates to maintain consistency with the physical measurement model under Poisson statistics [ 33 , 26 ] . It has been widely applied in astronomy, optical microscopy, and 3D fluorescence microscopy [ 13 , 4 , 40 , 50 ] . However, continued RL iterations can amplify small perturbations from photon noise and produce high-frequency artifacts in low-photon regimes [ 19 , 5 , 25 ] . Fine structures may also be weakly supported after optical degradation and low-photon acquisition. As a result, reconstruction depends not only on the measurement model but also on the prior used to stabilize and guide the solution. Structure-based regularizers, such as total-variation-regularized RL (TV-RL), add a spatial smoothness prior to reduce unstable oscillations and noise amplification [ 13 , 46 ] . Such priors can improve stability, but the imposed smoothness may suppress fine, weak subcellular structures and can introduce prior-dependent artifacts. They also require careful hyperparameter tuning across imaging conditions. Alternatively, modern deep generative frameworks, including deep image priors [ 43 ] , generative adversarial networks [ 30 , 53 ] , and score-based diffusion models [ 37 , 39 , 38 , 20 , 18 ] , offer another way to build such a prior. Score-based diffusion models are especially relevant because their distribution-fitting ability can produce diverse samples. Instead of relying on a predefined analytic form, these data-driven approaches learn the statistics of complex targets and can guide inverse-problem solutions with a learned manifold [ 9 , 52 ] . Recent decoupled reconstruction strategies allow this prior to be used separately from data-consistency optimization [ 47 , 7 ] . In fluorescence microscopy, the learned prior represents recurring cellular morphology, while the data-consistency step aligns each iteration with the Poisson measurement process. Yet, most existing diffusion methods assume Gaussian noise as the generic degradation, leaving the compatibility of these methods with Poisson photon statistics underexplored in biological imaging. To evaluate how a diffusion-based prior can be incorporated into the same physics-based framework and improve RL, we introduce a decoupled diffusion-prior Richardson–Lucy (Diffusion-RL) framework for photon-limited deconvolution. We train an unconditional Elucidating Diffusion Models (EDM) architecture on diverse microscopy modalities and samples with varying cellular fields of view to capture recurring biological structures [ 20 ] . During sampling, the diffusion model proposes a structural estimate from the learned distribution. At each iteration, RL refines this estimate using the assumed PSF and Poisson measurement model. This combination provides structural guidance from the learned prior, reduces noise amplification, and preserves biologically meaningful details across varying photon levels and imaging conditions. 2 Method We first introduce the general forward model for convolution degradation under Poisson shot noise, together with the iterative RL update and its TV-regularized form. We then describe a decoupled diffusion-based inverse-problem solver and apply it to the RL update as Diffusion-RL. To use a unified learned biological prior across different microscope settings, we separate prior learning from measurement consistency. Following a decoupled inference strategy [ 7 ] , the diffusion model provides an unconditional prior over structural morphology, while the RL step enforces optical and statistical consistency with the measured photon counts. The proposed framework reconstructs a clean fluorescence image \mathbf{x} from a degraded, photon-limited measurement \mathbf{y} by alternating between these two components. This separation keeps the learned prior independent of the microscope-specific forward model and photon regime used during inference. Figure 1: Overview of the Diffusion-RL framework. (A) Classical Richardson–Lucy (RL) deconvolution iteratively restores an image using a known point-spread function (PSF). (B) The Diffusion-RL framework uses the diffusion model output as a warm initialization for RL, enabling repeated refinement through iterative deconvolution updates. 2.1 Richardson–Lucy as a Poisson data-consistency step For photon-limited fluorescence imaging, the measured photon counts are modeled as a Poisson process governed by PSF convolution and a photon scaling factor \alpha : \mathbf{y}\sim\mathrm{Poisson}\!\left(\alpha\,\mathbf{H}\mathbf{x}\right), (1) where \mathbf{H} represents the microscope PSF. Maximizing the corresponding Poisson log-likelihood under a physical nonnegativity constraint leads to the classical RL multiplicative update as shown in Fig. 1 (A): \mathbf{x}^{(k+1)}=\mathbf{x}^{(k)}\odot\left[\mathbf{H}^{\ast}\frac{\mathbf{y}}{\alpha\,\mathbf{H}\mathbf{x}^{(k)}+\epsilon}\right], (2) where \mathbf{H}^{\ast} is the adjoint convolution operator, \odot denotes element-wise multiplication, and \epsilon>0 prevents division by zero. We do not modify the Poisson likelihood model of RL; instead, RL is used as a modular data-consistency operator inside the diffusion-prior sampling loop. TV-RL optimizes the penalized negative log-likelihood objective -\log p(\mathbf{y}\mid\mathbf{x})+\lambda_{\mathrm{TV}}\|\nabla\mathbf{x}\|_{1} , in which total variation (TV) regularization encourages spatial smoothness and forms the following modified update: \mathbf{x}^{(k+1)}=\mathbf{x}^{(k)}\odot\frac{\mathbf{H}^{\ast}\left(\dfrac{\mathbf{y}}{\alpha\,\mathbf{H}\mathbf{x}^{(k)}+\epsilon}\right)}{1-\dfrac{\lambda_{\mathrm{TV}}}{\alpha}\nabla\cdot\left(\frac{\nabla\mathbf{x}^{(k)}}{\sqrt{|\nabla\mathbf{x}^{(k)}|^{2}+\epsilon_{\mathrm{TV}}^{2}}}\right)}, (3) where \lambda_{\mathrm{TV}} dictates the spatial smoothness weight and \nabla\cdot(\cdot) represents the discrete divergence. While this denominator effectively penalizes high-frequency noise amplification, it introduces the distinct downside of smoothing fine, weak subcellular details. 2.2 Score-based diffusion prior for fluorescence morphology Rather than enforcing rigid geometric assumptions such as smoothness, our framework leverages a score-based diffusion model trained under the Elucidating Diffusion Models (EDM) formulation [ 20 , 37 ] . In the forward perturbation process, independent and identically distributed (i.i.d.) isotropic Gaussian noise is added across a broad range of noise scales \sigma_{t} , producing noisy images \mathbf{x}_{t}=\mathbf{x}_{0}+\sigma_{t}\boldsymbol{\epsilon} . A neural network s_{\theta}(\mathbf{x}_{t},\sigma_{t}) is trained to estimate the score function \nabla_{\mathbf{x}_{t}}\log p_{t}(\mathbf{x}_{t};\sigma_{t})