Progressive Flow-inspired Unfolding for Spectral Compressive Imaging

Xiaodong Wang, Ping Wang, Zijun He, Mengjie Qin, Xin Yuan · 2025

Read Progressive Flow-inspired Unfolding for Spectral Compressive Imaging by Xiaodong Wang, Ping Wang, Zijun He, Mengjie Qin, Xin Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-12079.txt.

Introduction

A single flat snapshot that secretly encodes a full spectrum at every pixel is the raw material of coded aperture snapshot spectral imaging. Xiaodong Wang and four co-authors improve how that hyperspectral cube gets rebuilt in 2025, targeting the jerky behavior of deep unfolding networks.

Unfolding alternates explicit data-fitting steps with learned denoising, and quality can lurch unevenly from stage to stage. Borrowing from diffusion and flow matching, the proposed framework forces a smooth path from rough first guess to finished image, so refinement stays gradual and controllable. A spatial-spectral transformer built for the job, plus a frequency-domain fusion module, keeps the cost down. Tests on simulated and real captures report better quality and efficiency than leading earlier methods.

Catalog record

CREATORXiaodong Wang, Ping Wang, Zijun He, Mengjie Qin, Xin Yuan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-12079

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Progressive Flow-inspired Unfolding for Spectral Compressive Imaging Xiaodong Wang, Ping Wang, Zijun He, Mengjie Qin, Xin Yuan Abstract Coded aperture snapshot spectral imaging (CASSI) retrieves a 3D hyperspectral image (HSI) from a single 2D compressed measurement, which is a highly challenging reconstruction task. Recent deep unfolding networks (DUNs), empowered by explicit data-fidelity updates and implicit deep denoisers, have achieved the state of the art in CASSI reconstruction. However, existing unfolding approaches suffer from uncontrollable reconstruction trajectories, leading to abrupt quality jumps and non-gradual refinement across stages. Inspired by diffusion trajectories and flow matching, we propose a novel trajectory-controllable unfolding framework that enforces smooth, continuous optimization paths from noisy initial estimates to high-quality reconstructions. To achieve computational efficiency, we design an efficient spatial-spectral Transformer tailored for hyperspectral reconstruction, along with a frequency-domain fusion module to gurantee feature consistency. Experiments on simulation and real data demonstrate that our method achieves better reconstruction quality and efficiency than prior state-of-the-art approaches. Introduction Hyperspectral imaging (HSI) captures fine-grained spectral signatures and has been widely applied in remote sensing, biomedical imaging, and material analysis. However, acquiring full 3D hyperspectral cubes is time-consuming and hardware-demanding. To address this, Coded Aperture Snapshot Spectral Imaging (CASSI) ( Arce et al. 2013 ; Yuan, Brady, and Katsaggelos 2021 ) has emerged as a promising solution that captures the full spectral volume in a single shot by encoding spatial-spectral information through a coded aperture and disperser. Reconstructing the hyperspectral image from the CASSI measurement is a severely ill-posed inverse problem. Consider the recovery of the target hyperspectral cube \mathbf{x}\in\mathbb{R}^{n} from the compressed measurements \mathbf{y}\in\mathbb{R}^{m} obtained through \mathbf{y}=\mathbf{A}\mathbf{x}+\mathbf{n}, (1) where \mathbf{A}\in\mathbb{R}^{m\times n} with m\ll n encodes the CASSI system, and \mathbf{n} denotes additive noise. This severe ill-posed problem is typically addressed via maximum a posteriori (MAP) estimation ( Kamilov et al. 2023 ; Venkatakrishnan, Bouman, and Wohlberg 2013 ) : \hat{\mathbf{x}}=\arg\min_{\mathbf{x}}\frac{1}{2}\|\mathbf{y}-\mathbf{A}\mathbf{x}\|_{2}^{2}-\log p(\mathbf{x}), (2) where p(\mathbf{x}) is a prior for the distribution of natural images. Here, the data fidelity term \frac{1}{2}\|\mathbf{y}-\mathbf{A}\mathbf{x}\|_{2}^{2} corresponds to -\log p(\mathbf{y}|\mathbf{x}) under Gaussian noise assumption. Solving this optimization typically alternates between gradient updates for data consistency and proximal operations that enforce the prior p(\mathbf{x}) . While the data consistency update has a closed-form solution, the challenge lies in designing appropriate priors that capture the complex spatial-spectral correlations inherent in hyperspectral data. Based on different prior modeling strategies, reconstruction methods are divided into four categories. Iterative optimization methods solve Eq. ( 2 ) using hand-crafted priors such as sparsity ( Yuan 2016 ; Chen, Wang, and Zhang 2023 ) , and low-rank constraints ( Gelvez and Arguello 2020 ) , offering theoretical guarantees but limited expressiveness and requiring extensive hyperparameter tuning. Plug-and-play (PnP) methods ( Qiu, Wang, and Meng 2021 ; Zheng et al. 2021 ) replace the prior term in iterative solvers with pre-trained minimum mean square error (MMSE) denoisers, although most available denoisers are trained on RGB/grayscale images, thus lacking the capability to model complex spectral correlations. Deep unfolding networks ( Cai et al. 2022c ; Dong et al. 2023 ; Li et al. 2023 ; Wu et al. 2024 ; Qin et al. 2025 ; Zhang et al. 2024b ; Zhang et al. 2024a ) parameterize each iteration of prior updating as learnable neural network, enabling data-driven optimization while maintaining algorithmic interpretability to achieve state-of-the-art performance. End-to-end networks ( Wang et al. 2025a ; Meng, Ma, and Yuan 2020 ; Cai et al. 2022b ) abandon explicit optimization structures entirely, instead learning implicit priors through deep architectures trained on paired data. Despite their success, these approaches share a fundamental limitation: inaccurate or inadequate priors lead to uncontrollable reconstruction trajectories. When the prior term fails to accurately model the true data distribution, the iterative optimization process may follow erratic or inefficient paths through the solution space. This trajectory instability manifests differently across methods. In PnP approaches, MMSE denoisers often over-smooth images, causing the optimization to take circuitous paths that heavily depend on manual parameter tuning for convergence. Deep unfolding networks exhibit training instability due to their sensitivity to initialization and training data. These trajectory deviations not only slow convergence but also compromise reconstruction quality. Therefore, we argue for a fundamental paradigm shift: rather than letting priors implicitly determine trajectories, we propose to jointly design both the reconstruction trajectory and the prior network. This dual approach enables explicit control over how the optimization evolves while simultaneously learning more effective priors. Our work is inspired by the trajectory design in generative models such as Flow Matching ( Lipman et al. 2022 ) , InDi ( Delbracio and Milanfar 2023 ) and diffusion bridge ( Chung, Kim, and Ye 2023 ) , where they share a similar trajectory spirit: the intermediate states is interpolated by taking a convex combination of initial and last states. By learning to interpolate between these intermediate states, we transform the abrupt measurement-to-image mapping into a smooth, controllable flow that naturally avoids local minima and training instabilities. Building on these insights, we design a trajectory-controllable unfolding network specifically tailored for hyperspectral reconstruction. Our approach introduces learnable trajectory interpolation mechanisms that enable continuous control over the reconstruction path, transforming the discrete unfolding process into a flexible continuous trajectory. Through our analysis, we discover that skip connections play a crucial role in shaping this trajectory by modulating information flow across iterations. This motivates us to design a frequency-aware skip connection module that adaptively controls the propagation of different frequency components throughout the unfolding process. Furthermore, recognizing the unique characteristics of hyperspectral data, we develop an efficient spatial-spectral transformer architecture that captures long-range dependencies in both spatial and spectral dimensions. Our main contributions are summarized as follows: • We propose a trajectory-controllable compressed spectral reconstruction algorithm based on back-projection unfolding networks, dubbed FLoUNet. By decomposing the ill-posed inverse problem into a series of progressively easier optimization steps, our framework ensures training stability throughout the reconstruction process and improves reconstruction quality compared to traditional unfolding approaches. • We design an efficient spatial-spectral hybrid network architecture with a novel frequency-aware fusion module in the U-Net skip connections. Our analysis reveals that skip connections play a crucial role in trajectory control, and our frequency-aware design enables better information flow across different spectral components. • Extensive experiments demonstrate that our method achieves state-of-the-art performance on both simulated and real-world hyperspectral datasets, validating the effectiveness of our trajectory-controllable framework and spatial-spectral network design. Related Work Hyperspectral Image Reconstruction To recover the inverse problem in CASSI, one often use proximal algorithms to solve the optimization problems of form ( 2 ) when the prior functions are non-smooth, by leveraging the proximal operator, \text{prox}_{\lambda h}(\mathbf{v})=\arg\min_{\mathbf{x}}\left\{\frac{1}{2\lambda}\|\mathbf{x}-\mathbf{v}\|_{2}^{2}+h(\mathbf{x})\right\} (3) where h(\mathbf{x})=-\log p(\mathbf{x}) and \lambda is a regularization parameter. The PnP concept suggests replacing the proximal operator applying as an off-the-shelf Gaussian denoiser, whereas deep unfolding scheme treats the proximal operator as a trainable neural network. In either scheme, we can formulate the typical iterative update as: \displaystyle\mathbf{z}_{k} \displaystyle\leftarrow\mathbf{x}_{k}-\gamma\frac{\partial}{\partial\mathbf{x}_{k}}\left\|\mathbf{W}\left(\mathbf{y}-\mathbf{H}\mathbf{x}_{k}\right)\right\|_{2}^{2}, (4) \displaystyle\mathbf{x}_{k+1} \displaystyle\leftarrow\text{prox}_{\sigma}(\mathbf{z}_{k}), (5) where we use a generalized weighted gradient step ( 4 ) to signify the measurement consistency updating and a network \text{prox}_{\sigma} to denote the proximal operator, \gamma is the step size and \mathbf{W} depends on the noise covariance, if the noise is Gaussian ( Chung et al. 2022

Read the complete text