ResMatching: Noise-Resilient Computational Super-Resolution via Guided Conditional Flow Matching
Anirban Ray, Vera Galinova, Florian Jug · 2025
Read ResMatching: Noise-Resilient Computational Super-Resolution via Guided Conditional Flow Matching by Anirban Ray, Vera Galinova, Florian Jug (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26601.txt.
Introduction
Anirban Ray, Vera Galinova, and Florian Jug sharpen blurry microscope images with a new learning method. Computational super-resolution tries to recover fine detail that a microscope never recorded, which is only possible with a good prior, a learned sense of what real samples look like. Noise in fluorescence images makes that prior hard to learn.
Ray and his two co-authors present ResMatching, built on guided conditional flow matching, a technique that learns to turn noise into data step by step. On four kinds of biological structures from the BioSR data set, it beat or matched seven rival methods. It gave the best balance between fidelity to the data and realistic looks, and it shone most on noisy images. It can also sample many plausible answers, and its per-pixel uncertainty scores were well calibrated.
Catalog record
| CREATOR | Anirban Ray, Vera Galinova, Florian Jug |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-26601
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ResMatching: Noise-Resilient Computational Super-Resolution via Guided Conditional Flow Matching Anirban Ray, Vera Galinova, Florian Jug Abstract Computational Super-Resolution (CSR) in fluorescence microscopy has, despite being an ill-posed problem, a long history [ 1 ] . At its very core, CSR is about finding a prior that can be used to extrapolate frequencies in a micrograph that have never been imaged by the image-generating microscope. It stands to reason that, with the advent of better data-driven machine learning techniques, stronger prior can be learned and hence CSR can lead to better results. Here, we present ResMatching , a novel CSR method that uses guided conditional flow matching to learn such improved data-priors. We evaluate ResMatching on 4 4 diverse biological structures from the BioSR dataset [ 2 ] and compare its results against 7 7 baselines. ResMatching consistently achieves competitive results, demonstrating in all cases the best trade-off between data fidelity and perceptual realism [ 3 ] . We observe that CSR using ResMatching is particularly effective in cases where a strong prior is hard to learn, e.g . when the given low-resolution images contain a lot of noise. Additionally, we show that ResMatching can be used to sample from an implicitly learned posterior distribution and that this distribution is calibrated [ 4 ] for all tested use-cases, enabling our method to deliver a pixel-wise data-uncertainty term that can guide future users to reject uncertain predictions [ 5 , 6 , 7 ] . † † address: 1 Human Technopole, Milan, Italy 2 Technische Universität Dresden, Germany {anirban.ray, vera.galinova, florian.jug}@fht.org 1 Introduction In the context of fluorescence microscopy, many approaches for computational super-resolution (CSR) have been proposed over the years [ 1 ] . Classical CSR algorithms can be understood as attempts to invert the low-pass filtering imposed by the microscope’s optical transfer function (OTF) and thereby to extrapolate high-frequency information lost during image formation. Because this inverse problem is ill-posed, priors are essential for constraining the space of feasible solutions [ 1 ] . Early methods introduced explicitly designed priors that capture simple image characteristics, such as smoothness or sparsity. Prominent examples include Tikhonov [ 8 ] and total-variation regularization [ 9 ] , which penalize high gradients to suppress noise while preserving edges, and iterative deconvolution schemes such as the Richardson–Lucy algorithm [ 10 ] , which exploit a Poisson noise model and an implicit positivity constraint to recover plausible high-frequency detail. Figure 1: ResMatching , using a conditional flow matching approach, leads to best-in-class computational super-resolution results even in severely noisy microscopy data. With the advent of deep learning, hand-crafted regularization terms have been replaced by learned, data-driven priors. Early convolutional architectures such as the U-Net [ 11 , 12 ] and RCAN [ 13 ] established strong baselines for microscopy restoration by learning hierarchical feature representations and attention-based refinement, respectively. However, their deterministic nature limits their ability to model the inherent uncertainty in fluorescence imaging, especially under high noise conditions. These models, trained directly on suitable microscopy datasets, capture the statistics of biological structures directly from the data and enable more powerful solutions to inverse problems such as denoising, deblurring, or super-resolution [ 14 ] . In particular, convolutional and adversarial networks [ 15 ] have demonstrated that structural priors learned from fluorescence micrographs can substantially improve resolution restoration, even under severe photon limitations. From this perspective, modern CSR can be viewed as the process of learning a structural prior that constrains the predictor toward biologically meaningful high-frequency content. To overcome these limitations, probabilistic frameworks such as hierarchical variational autoencoders ( HVAE [ 16 ] ) and implicit diffusion inference models [ 17 ] have introduced stochastic latent variables to capture spatial uncertainty and diverse, plausible reconstructions. Recent progress in generative modeling has further expanded this view. Models such as variational autoencoders [ 16 ] , diffusion processes ( InDI [ 18 ] ), and flow matching networks [ 19 , 20 ] provide a formal framework to approximate the distribution of high-resolution images conditioned on low-resolution measurements. Such generative approaches also offer a flexible way to sample from an explicit or implicit posterior over possible reconstructions, which, in theory, enables uncertainty quantification. In this work, we investigate whether conditional flow matching, a recent generative modeling paradigm, can yield improved priors for CSR in fluorescence microscopy. Rather than aiming for a general-purpose foundation model, we introduce ResMatching , which (i) learns a detailed, data-specific structural prior from fluorescence microscopy images, (ii) achieves a good trade-off between data fidelity and perceptual realism [ 3 ] , (iii) supports posterior sampling to visualize the diversity of plausible reconstructions, and (iv) provides well-calibrated uncertainty estimates [ 4 ] . Together, these features make ResMatching a conceptually novel and practically powerful method for uncertainty-aware computational super-resolution. 2 Method 2.1 Problem definition Computational super-resolution (CSR) in fluorescence microscopy seeks to recover high-resolution (HR) structures from low-resolution (LR) acquisitions corrupted by optical blur and imaging noise. We model the LR image as \mathbf{x}_{M_{0}}=H_{M_{0}}(s)+\eta(s) , where H_{M_{0}} represents the unknown degradation operator of microscope M_{0} , s is the underlying biological structure, and \eta(s) is the signal-dependent noise. The corresponding HR image from a higher resolution microscope M_{1} is given by \mathbf{x}_{M_{1}}=H_{M_{1}}(s)+\eta(s) . Given paired LR–HR observations (\mathbf{x}_{M_{0}},\mathbf{x}_{M_{1}}) of the same sample s_{i}\in\mathcal{S} , our goal is to learn a function \mathbf{\hat{x}}_{M_{1}}=S(\mathbf{x}_{M_{0}}) that reconstructs HR-like images \mathbf{\hat{x}}_{M_{1}} that are faithful to the unknown \mathbf{x}_{M_{1}} . 2.2 Conditional flow matching (CFM) Flow matching unifies diffusion processes and normalizing flows through continuous-time dynamics [ 19 , 20 ] . Instead of incrementally denoising a sample through discrete diffusion steps, flow-matching models learn a vector field that continuously transports samples from a simple base distribution to the target data distribution. In its conditional form, the model learns a velocity field v_{\theta}(t,\mathbf{x}_{t},\mathbf{x}_{M_{0}}) such that a clean HR image \mathbf{x}_{M_{1}} can be recovered from its degraded counterpart \mathbf{x}_{M_{0}} by integrating the associated ODE, \frac{d\mathbf{x}_{t}}{dt}=v_{\theta}(t,\mathbf{x}_{t},\mathbf{x}_{M_{0}}) , with \mathbf{x}_{0}=\mathbf{x}_{t=0}\sim\mathcal{N}(0,I) and \mathbf{\hat{x}}_{M_{1}}=\mathbf{x}_{t=1} corresponding to the reconstructed HR image. Figure 2: Quantitative results – data fidelity and realism. Each row corresponds to results obtained on each data-subset we trained on (see Section 3 ). We show PSNR vs. MicroMS-SSIM (left, note inverted axis for more consistent plots) and LPIPS vs. FID (center), capturing the trade-off between pixel-level fidelity and perceptual quality. ResMatching is highlighted with an additional red circle. Results tables (right) show the same data. In fluorescence microscopy, the degradation operator H_{M_{0}} is typically unknown and highly variable across microscopes, while the acquisition conditions and noise statistics \eta(s) depend on the true signal intensity. Standard conditional flow-matching methods [ 19 ] assume that H_{M_{0}} and the noise level are known, an unrealistic assumption in our setting. Recent work such as HazeMatching [ 20 ] addressed this limitation by introducing a guided variant of CFM that implicitly learns to invert complex degradations without access to H_{M_{0}} or explicit noise parameters. Algorithm 1 ResMatching Training Procedure 1: velocity model v_{\theta} ; learning rate \gamma ; steps T 2: repeat 3: s\sim\mathcal{S} ; t\sim\mathcal{U}([i/T]_{i=0}^{T}) ; \mathbf{x}_{0}\sim\mathcal{N}(0,I) ; 4: \mathbf{x}_{M_{0}}\sim p_{M_{0}}(\mathbf{x}|s) ; \mathbf{x}_{M_{1}}\sim p_{M_{1}}(\mathbf{x}|s) 5: \mathbf{x}_{t}=(1-t)\mathbf{x}_{0}+t\mathbf{x}_{M_{1}} 6: \mathcal{L}=||v_{\theta}(t,\mathbf{x}_{t},\mathbf{x}_{M_{0}})-(\mathbf{x}_{M_{1}}-\mathbf{x}_{0})||^{2} 7: \theta\leftarrow\theta-\gamma\nabla_{\theta}\mathcal{L} 8: until converged 9: return v_{\theta} Algorithm 2 ResMatching Inference Procedure 1: velocity model v_{\theta} ,