Spectral Compressive Imaging via Chromaticity-Intensity Decomposition
Xiaodong Wang, Zijun He, Ping Wang, Lishun Wang, Yanan Hu, Xin Yuan · 2025
Read Spectral Compressive Imaging via Chromaticity-Intensity Decomposition by Xiaodong Wang, Zijun He, Ping Wang, Lishun Wang, Yanan Hu, Xin Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-16690.txt.
Introduction
Xiaodong Wang and co-authors rebuild color-rich images from a single snapshot in a 2025 optics paper. A coded camera can capture light across many colors at once. But space and color data arrive tangled in one shot. Untangling them is a hard puzzle, made worse when light changes shift the colors.
Their method splits a scene into brightness and pure color parts. That split helps recover the true surface colors, which stay fixed as light shifts. Tests on fake and real camera data show top scores for color accuracy. Code and models will be shared in public. Faster color imaging could aid farms, clinics, and labs.
Catalog record
| CREATOR | Xiaodong Wang, Zijun He, Ping Wang, Lishun Wang, Yanan Hu, Xin Yuan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-16690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spectral Compressive Imaging via Chromaticity-Intensity Decomposition Xiaodong Wang, Zijun He, Ping Wang, Lishun Wang, Yanan Hu, Xin Yuan Abstract In coded aperture snapshot spectral imaging (CASSI), the captured measurement entangles spatial and spectral information, posing a severely ill-posed inverse problem for hyperspectral images (HSIs) reconstruction. Moreover, the captured radiance inherently depends on scene illumination, making it difficult to recover the intrinsic spectral reflectance that remains invariant to lighting conditions. To address these challenges, we propose a chromaticity-intensity decomposition framework , which disentangles an HSI into a spatially smooth intensity map and a spectrally variant chromaticity cube. The chromaticity encodes lighting-invariant reflectance, enriched with high-frequency spatial details and local spectral sparsity. Building on this decomposition, we develop CIDNet —a Chromaticity-Intensity Decomposition unfolding network within a dual-camera CASSI system. CIDNet integrates a hybrid spatial-spectral Transformer tailored to reconstruct fine-grained and sparse spectral chromaticity and a degradation-aware, spatially-adaptive noise estimation module that captures anisotropic noise across iterative stages. Extensive experiments on both synthetic and real-world CASSI datasets demonstrate that our method achieves superior performance in both spectral and chromaticity fidelity. Code and models will be publicly available. 1 Introduction Figure 1: (a) Chrmaticity-Intensity decomposition of HSI images (b) Chromaticity exhibits highlight removal, lowlight enhancement and high-frequency textures. Coded aperture snapshot spectral imaging (CASSI) has emerged as a promising architecture for capturing hyperspectral images (HSIs) in a single shot arce2013compressive ; wagadarikar2008single ; yuan2021snapshot . By jointly modulating the spectral cube with a coded aperture and dispersing it spatially through a prism, CASSI produces a 2D compressed measurement that encodes both spatial and spectral information. This compressive measurement fuses (shears) the spectral bands, making each pixel of the 2D sensor a mixture of many wavelengths. As a result, recovering the full 3D spectral image becomes a severely under-determined, ill-posed inverse problem. The difficulty comes mainly from two aspects. One is that spatial and spectral signals are highly overlapped and entangled in the compressed measurement. Many works attempt to address this through various priors or deep models, broadly categorized into four paradigms. Optimization-based methods liu2018rank ; yuan2016generalized introduce hand-crafted priors such as total variation or low-rank constraints. However, their performance is often limited in recovering spatial structures, especially under complex textures or noise. Plug-and-Play (PnP) approaches qiu2021effective ; zheng2021deep integrate powerful pre-trained denoisers into iterative solvers, yet these methods typically denoise each or few spectral band independently, neglecting spectral correlation and structure. Deep unfolding methods cai2022degradation ; dong2023residual ; li2023pixel ; meng2020gap ; zhang2024dual ; zhang2024improving bridge model-based and data-driven paradigms by learning iterative modules guided by the CASSI physics. End-to-end networks cai2022mask ; hu2022hdnet ; meng2020end ; miao2019net ; wang2025sˆ leverage CNNs or Transformers to directly infer the spectral cube from measurements. These deep learning-based frameworks implicitly exploit spatial-spectral dependencies and have shown promising performance. Recently, diffusion model pan2024diffsci ; wu2024latent ; zengspectral and Mamba qin2025detail have been used for spectral reconstruction. Nonetheless, all these approaches rely on network backbones to learn spatial-spectral features in an implicit manner. There lacks a clear and interpretable decomposition or quantitative structure that explicitly characterizes the physical roles of spatial and spectral components during reconstruction. The second challenge is that existing methods often overlook the impact of illumination. Since the captured spectral measurement is radiance-based, it inherently entangles the intrinsic surface reflectance with scene illumination. This coupling makes the reconstruction sensitive to lighting variations across time and environments, thereby limiting spectral accuracy. To address similar issues in the RGB image, prior works have explored intrinsic image decomposition bell2014intrinsic ; garces2022survey ; li2018cgintrinsics ; li2018learning and Retinex-based models wei2018deep ; wu2022uretinex to explicitly separate reflectance from illumination, enabling applications such as shadow removal and low-light enhancement. In the hyperspectral remote sensing community, several studies have also extended intrinsic decomposition to spectral reflectance and illumination separation jin2018intrinsic ; kang2014intrinsic ; yu2023hi , offering better invariance to lighting conditions. However, to the best of our knowledge, such decomposition has not yet been incorporated into CASSI reconstruction. In this paper, we propose a novel chromaticity learning framework for compressive spectral imaging, which leverages a chromaticity-intensity decomposition prior under the CASSI sensing mechanism. Our motivation is illustrated in Fig. 1 , where the spectral image cube \mathbf{X} is factorized as: \mathbf{X}=\mathbf{C}\odot\mathbf{I}, (1) where \mathbf{C} denotes the chromaticity cube and \mathbf{I} represents the intensity image . Notably, \mathbf{C} exhibits several desirable properties: (i) spatially invariant to illumination, suppressing highlights and enhancing details in low-light regions; (ii) spectrally sparse with localized support (as illustrated latter); (iii) enriched with high-frequency texture, essential for fine-detail recovery. See Appendix C for more details. In contrast, the intensity component \mathbf{I} captures the global illumination structure in the scene. It is interesting to note that the chromaticity exhibits more intrinsic characteristics of the sample compared to hyperspectral images. Hence, learning the chromaticity instead of HSIs seems to benefit the field more. Building upon the above observations, we propose a physically interpretable chromaticity-intensity decomposition model tailored for CASSI systems. By leveraging a dual-camera CASSI setup, we validate this decomposition paradigm within both traditional optimization-based solvers and deep unfolding frameworks. To further explore its potential, we design a novel Chromaticity-Intensity Decomposition Network (CIDNet) , which incorporates the spectral sparsity of chromaticity through a sparse TopK spectral Transformer, and models spatially anisotropic noise via a degradation-aware, spatially-adaptive variance estimator. In summary, our main contributions are summarized as follows: i) We propose a novel chromaticity-intensity decomposition model for spectral compressive imaging, which explicitly separates hyperspectral images into lighting-invariant chromaticity and smooth intensity. We further validate its effectiveness on optimization-based and unfolding algorithms in a dual-camera CASSI setting. ii) We develop an intensity-guided deep unfolding network that incorporates the chromaticity decomposition into unfolding algorithm. The network features a hybrid spatial-spectral Transformer architecture, where the encoder leverages window-based local spatial attention and the decoder employs sparse TopK spectral attention to capture localized spectral structures. iii) We introduce a degradation-aware, spatially-adaptive dual noise estimation module to model anisotropic noise across different reconstruction stages. This module enables each iteration to adaptively handle varying noise levels across spatial locations. iv) Extensive experiments on both synthetic and real datasets demonstrate that our method achieves state-of-the-art performance in terms of spectral reconstruction and chromaticity fidelity. Figure 2: (a) The architecture of our CIDNet with K stages (iterations). (b) The CASSI system uses an intensity-guided mask to modulate the chromaticity. (c) Diagram of asymmetric backbone for our hybrid spatial-spectral transformer. (d) Sparse TopK spectral self-attention module. 2 Proposed Method 2.1 Degradation Model of CASSI Inspired by chromaticity-intensity decomposition in RGB intrinsic image analysis, we extend this concept to the hyperspectral domain. Given a hyperspectral image cube \mathbf{X}\in\mathbb{R}^{H\times W\times N_{\lambda}} , we decompose it into a spatially smooth intensity image \mathbf{I}\in\mathbb{R}^{H\times W} and a chromaticity cube \mathbf{C}\in\mathbb{R}^{H\times W\times N_{\lambda}} as: \mathbf{X}(u,v,\lambda)=\mathbf{C}(u,v,\lambda)\odot\mathbf{I}(u,v), (2) where (u,v) denotes spatial location, \lambda is the spectral band index, and \odot denotes pixel-wise multiplication. Specifically, the intensity image is defined as the average spectral energy per pixel: \mathbf{I}(u,v)=\textstyle\frac{1}{N_{\lambda}}\sum_{\lambda=1}^{N_{\lambda}}\mathbf{X}(u,v,\lambda), (3) intensity image can be approximated as a PAN image in dual-camera CASSI and the chromaticity is computed as the normalized spectral signature: \mathbf{C}(u,v,\lambda)=\textstyle\frac{\mathbf{X}(u,v,\lambda)}{\mathbf{I}(u,v)+\epsilon}, (4) where \epsilon is a small constant to avoid division by zero. This decomposition separates the multiplicative effect of illumination \mathbf{I}(u,v) from the spectral reflectance \mathbf{C}(u,v,\lambda) ,