Multiscale Super Resolution without Image Priors
Daniel Fu, Gabby Litterio, Pedro Felzenszwalb, Rashid Zia · 2026
Read Multiscale Super Resolution without Image Priors by Daniel Fu, Gabby Litterio, Pedro Felzenszwalb, Rashid Zia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21810.txt.
Introduction
Fu and three colleagues show that combining low-resolution images at different scales can make super-resolution well posed, without image priors. Scale differences come from sensors with different pixel sizes or from zoom magnification. Images with pairwise coprime pixel sizes yield a stable inverse, and reconstructions proceed efficiently by Fourier methods or iterative least squares. One- and two-dimensional experiments with CCD binning validate the analysis and its noise-resolution trade-off.
Catalog record
| CREATOR | Daniel Fu, Gabby Litterio, Pedro Felzenszwalb, Rashid Zia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51457 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21810
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multiscale Super Resolution without Image Priors Daniel Fu, Gabby Litterio, Pedro Felzenszwalb, Rashid Zia Abstract We address the ambiguities in the super-resolution problem under translation. We demonstrate that combinations of low-resolution images at different scales can be used to make the super-resolution problem well posed. Such differences in scale can be achieved using sensors with different pixel sizes (as demonstrated here) or by varying the effective pixel size through changes in optical magnification (e.g., using a zoom lens). We show that images acquired with pairwise coprime pixel sizes lead to a system with a stable inverse, and furthermore, that super-resolution images can be reconstructed efficiently using Fourier domain techniques or iterative least squares methods. Our mathematical analysis provides an expression for the expected error of the least squares reconstruction for large signals assuming i.i.d. noise that elucidates the noise-resolution tradeoff. These results are validated through both one- and two-dimensional experiments that leverage charge-coupled device (CCD) hardware binning to explore reconstructions over a large range of effective pixel sizes. Finally, two-dimensional reconstructions for a series of targets are used to demonstrate the advantages of multiscale super-resolution, and implications of these results for common imaging systems are discussed. I Introduction The goal of super-resolution imaging is to reconstruct, or estimate, a high-resolution image from one or more low-resolution measurements. Previous work has discussed the ambiguities inherent in super resolution under translation [ 1 , 9 , 10 ] , which in turn have inspired the use of image priors to address missing information. For example, [ 1 ] showed the limitation of a quadratic smoothness prior and proposed a recognition-based approach where high-resolution features are hallucinated from low-resolution measurements by leveraging training data. Subsequent work explored the use of large training datasets [ 13 , 4 ] to estimate high-resolution detail from a single low-resolution image. While often effective, such methods rely on assumptions about the underlying image distribution, require large training datasets in specific domains, and can struggle to generalize in new settings. Recently, [ 10 ] showed that total variation (TV) can be used to reconstruct sparse images without the need for training data, but such priors will fail for sufficiently complex scenes. Other examples of image priors that can (and have) been used for super resolution include methods based on self-similarity [ 6 ] and implicit priors based on neural representations [ 15 ] . In this paper, rather than relying on image priors, we show that the ambiguities in super resolution under translation can be resolved using data collected at multiple scales or effective resolutions. Here, scale refers to the effective pixel size, which depends on both the physical size of the image sensor’s pixels as well as the magnification of the imaging system. In practice, scale variation can be achieved through several mechanisms, such as changing the optical magnification of a zoom lens, swapping intermediate lenses in the optical system of a microscope, using sensors with multiple pixel sizes, or using devices that have multiple independent cameras with different effective resolutions. Static Image 221 \mu m Pixels Static Image 234 \mu m Pixels Static Image 247 \mu m Pixels Interlaced Data 221 \mu m Pixels Interlaced Data 234 \mu m Pixels Interlaced Data 247 \mu m Pixels Multiscale Reconstruction Static Image 13 \mu m Pixels Fig. 1 : Multiscale super-resolution demo using 200+ \mu m pixels to reconstruct images comparable to 13 \mu m pixel. Our approach is motivated by the observation that data collected at different scales (effective pixel sizes) provide complementary information in the Fourier domain. While data collected with a single low-resolution sensor and magnification cannot resolve all of the frequency components of an image, combining measurements across appropriately chosen scales fills in the gaps and eliminates the ambiguity in the inverse problem. Figure 1 provides an illustrative example of how measurements acquired at three carefully chosen scales can enable super-resolution in two dimensions. For this demonstration, and to enable systematic study of super resolution under translation, we leverage charge-coupled device (CCD) hardware binning prior to data readout. The top row shows individual images captured via hardware binning with effective pixel sizes of 221, 234, and 247 \mu m respectively. These sizes were chosen as coprime integer multiples (17, 18, and 19) of 13 \mu m. The second row shows the result of interlacing multiple low-resolution images together. The last row shows a reconstruction computed without image priors, using the Fourier domain method presented below, next to a ”ground-truth” image captured using 13 \mu m pixels (without binning) for comparison. Despite using sensors with effective pixel sizes 17-19x larger, the multiscale reconstruction based on the 200+ \mu m pixel data recovers the fine structure of the 13 \mu m pixel image. Most generally, for a signal u in d -dimensions, our main theoretical result establishes that measurements with d+1 pairwise coprime integer pixel sizes are sufficient for stable reconstruction using imaging constraints (Theorem V.7 ). Furthermore, we provide an expression for the expected error of the least squares reconstruction for large signals assuming i.i.d. noise that elucidates the noise-resolution tradeoff (Theorem V.8 and Observation V.9 ). These results are validated through both one- and two-dimensional experiments that leverage CCD hardware binning to explore reconstructions over a large range of effective pixel sizes. We demonstrate the advantages of using multiple scales to reconstruct two-dimensional images by empirically comparing the reconstructions obtained with one, two, or three scales. Implications of these results for common imaging systems are discussed in the conclusion. II Imaging Model Let E:\mathbb{R}^{2}\rightarrow\mathbb{R} denote a continuous irradiance field on the imaging plane of a camera. An idealized high-resolution sensor H with square pixels of size \Delta records a discrete image I by spatially integrating E over each pixel, I[i,j]=\int_{0}^{\Delta}\int_{0}^{\Delta}E(x+i\Delta,y+j\Delta)\,\mathrm{d}{x}\mathrm{d}{y}. Since the irradiance field E is diffraction-limited, the “true” resolution (resolving power) of the image I is a combination of the optical system and the pixel size. This is why the design of a high-resolution imaging systems often begins with a pixel size \Delta that is smaller than the diffraction-limited optical resolution. Throughout this paper we consider the reconstruction of the image I from measurements obtained using low-resolution sensors with pixel sizes significantly larger than \Delta . Thus, we are focused on improving the sensor resolution and working in regimes where the diffraction-limited image has higher resolution than our sensors. In other words, we are focused on sensor super-resolution imaging, not super-resolution below the diffraction limit, which is a distinct field in optical microscopy. To define a tractable model for analysis, we consider sensors with pixel sizes that are integer multiples of \Delta . This simplifies the analysis, and it also represents a robust model for CCD cameras in which photoelectrons accumulated within individual pixels can be binned into a contiguous rectangular form prior to readout. Such CCD hardware binning is regularly used to improve noise statistics for low-signal measurement, and we will leverage binning to explore a range of effective pixel sizes. Suppose we have a low-resolution sensor L with pixel size k\Delta for a positive integer k . When L is properly aligned with H , each low-resolution pixel measures the sum of k^{2} high-resolution pixels. By translating L within the imaging