A Parametric Non-negative Coupled Canonical Polyadic Decomposition Algorithm for Hyperspectral Super-Resolution

Xi-Yuan Liu, Xiao-Feng Gong, Lei Wang, Wei Feng, Qiu-Hua Lin · 2025

Read A Parametric Non-negative Coupled Canonical Polyadic Decomposition Algorithm for Hyperspectral Super-Resolution by Xi-Yuan Liu, Xiao-Feng Gong, Lei Wang, Wei Feng, Qiu-Hua Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15197.txt.

Introduction

Sharpening a satellite image by fusing a detailed but colour-poor picture with a colourful but blurry one is a workhorse trick in remote sensing. Xi-Yuan Liu and co-authors improve the tensor method behind that fusion. Image values cannot be negative, yet earlier solvers either ignored that fact or enforced it by crude clipping that disturbs the optimisation.

Their algorithm folds the non-negativity into the maths itself, tying each entry to the square of a hidden parameter so the constraint holds automatically. Working through the calculus for gradients and curvature lets the solver proceed smoothly inside a least-squares framework. Experiments on the super-resolution task show the cleaner handling pays off in image quality. The authors present the method as a drop-in upgrade for coupled tensor fusion.

Catalog record

CREATORXi-Yuan Liu, Xiao-Feng Gong, Lei Wang, Wei Feng, Qiu-Hua Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15197

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Parametric Non-negative Coupled Canonical Polyadic Decomposition Algorithm for Hyperspectral Super-Resolution Xi-Yuan Liu, Xiao-Feng Gong, Lei Wang, Wei Feng, Qiu-Hua Lin Abstract Recently, coupled tensor decomposition has been widely used in data fusion of a hyperspectral image (HSI) and a multispectral image (MSI) for hyperspectral super-resolution (HSR). However, exsiting works often ignore the inherent non-negative (NN) property of the image data, or impose the NN constraint via hard-thresholding which may interfere with the optimization procedure and cause the method to be sub-optimal. As such, we propose a novel NN coupled canonical polyadic decomposition (NN-C-CPD) algorithm, which makes use of the parametric method and nonlinear least squares (NLS) framework to impose the NN constraint into the C-CPD computation. More exactly, the NN constraint is converted into the squared relationship between the NN entries of the factor matrices and a set of latent parameters. Based on the chain rule for deriving the derivatives, the key entities such as gradient and Jacobian with regards to the latent parameters can be derived, thus the NN constraint is naturally integrated without interfering with the optimization procedure. Experimental results are provided to demonstrate the performance of the proposed NN-C-CPD algorithm in HSR applications. † † address: School of Information and Communication Engineering, Dalian University of Technology, China E-mails: [email protected] 1 Introduction Recently, coupled tensor decomposition techniques [ 1 , 2 , 3 , 4 , 5 , 6 ] have attracted great attention in multiset data fusion of a hyperspectral image (HSI) and a multispectral image (MSI) to get super-resolution image (SRI) [ 7 ] . In [ 1 ] , an unconstrained coupled canonical polyadic decomposition (C-CPD) algorithm based on alternating least squares (ALS) was proposed for hyperspectral super-resolution (HSR). In [ 2 ] , a nonlocal C-CPD algorithm based on alternating direction method of multipliers (ADMM) method [ 8 ] was proposed for HSI-MSI data fusion. In [ 3 ] , HSI and MSI are approximated to the coupled Tucker (C-Tucker) model. With the degradation mechanism from SRI to HSI/MSI established as the flexible coupling [ 9 ] between HSI and MSI datasets, these coupled tensor based techniques can well exploit the coupling structure between HSI and MSI datasets, thereby achieving accurate reconstruction of SRI. However, the inherent non-negative (NN) feature of HSI and MSI data is mostly ignored in these methods. In [ 10 ] , an NN coupled matrix decomposition method was proposed for HSR. Adding NN constraint improves the stability of the algorithm [ 11 ] . However, this approach was based on the matrix model and did not take full advantage of the high-dimensional structure of the datasets. In [ 4 ] , a C-Tucker decomposition based on NN and nonlocal 4-D tensor dictionary learning which considered the non-negativity and sparsity of the datasets fully was proposed. In [ 5 ] , an NN coupled block term decomposition (C-BTD) method based on alternating projection gradient (APG) was proposed. The C-BTD model writes the HSI/MSI data into the sum of low multilinear rank terms, which is more flexible than C-CPD that uses rank-1 terms. However, the NN constraint is imposed via hard-thresholding, which may interfere optimization procedure. In [ 6 ] , a C-BTD algorithm with minimum volume regularizations and incorporate the \beta -divergence was proposed for images fusion and the factor matrices were gotten via the multiplicative update method. In this paper, we propose a novel NN-C-CPD algorithm by using a parametric method to impose NN constraint within the C-CPD nonlinear least squares (NN-C-CPD-NLS) framework [ 12 ] . The NN constraint is reformulated as a squared relationship between the NN entries of the factor matrices and a set of latent parameters [ 13 , 12 ] . By applying the chain rule, the gradient and Jacobian with respect to the latent parameters can be derived, and thus the NN constraint can be naturally integrated into the optimization procedure. Numerical experiments are conducted to illustrate the performance of the proposed algorithms in comparison with several existing coupled tensor/matrix based HSI/MSI fusion methods. Notations : Scalars, vectors, matrices and tensors are denoted by italic lowercase, lowercase boldface, uppercase boldface letters, and uppercase calligraphic letters, respectively. We use vec( \cdot ) to represent the vectorization operation. \mathbf{Y}_{(n)} is denoted by the mode- \it{n} matrix representation of a third-order NN tensor {\boldsymbol{\mathcal{Y}}}\in{\mathbb{R}^{I\times J\times K}_{+}} . We use ‘ \circ ’, ‘ \otimes ’, ‘ * ’ and ‘ {\times_{n}} ’ to denote vector outer product, Kronecker product, Hadamard product and mode- \it{n} product, respectively. An NN CPD expresses {\boldsymbol{\mathcal{Y}}}\in{\mathbb{R}^{I\times J\times K}} as the sum of minimal number of rank-1 terms where \mathbf{A}=[{\mathbf{a}_{1}},\ldots,{\mathbf{a}_{R}}],\mathbf{B}=[{\mathbf{b}_{1}},\ldots,{\mathbf{b}_{R}}],\mathbf{C}=[{\mathbf{c}_{1}},\ldots,{\mathbf{c}_{R}}], and \it{R} is defined as the NN rank of {\boldsymbol{\mathcal{Y}}} . {\boldsymbol{\mathcal{Y}}}\mathrel{\mathop{\kern 0.0pt=}\limits^{\Delta}}[\kern-1.49994pt[\mathbf{A},\mathbf{B},\mathbf{C}]\kern-1.49994pt]_{R}=\sum\limits_{r=1}^{R}{{\mathbf{a}_{r}}\circ{\mathbf{b}_{r}}\circ{\mathbf{c}_{r}}}\in{\mathbb{R}^{I\times J\times K}}, 2 PROBLEM FORMULATION We denote the target SRI tensor by \boldsymbol{\mathcal{Y}}_{S}\in\mathbb{R}^{I\times J\times K}_{+} which approximately admits an NN CPD model [ 14 ] as : \boldsymbol{\mathcal{Y}}_{S}\approx[\![\mathbf{A},\mathbf{B},\mathbf{C}]\!]_{R}, (1) where \mathbf{A}\in\mathbb{R}^{I\times R}_{+} and \mathbf{B}\in\mathbb{R}^{J\times R}_{+} are factor matrices in spatial dimensions, \mathbf{C}\in\mathbb{R}^{K\times R}_{+} is the factor matrix in the spectral dimension. HSI and MSI are degraded versions of SRI, with high spectral resolution but low spatial resolution, and low spectral resolution but high spatial resolution, respectively. We denote the HSI and MSI datasets as \boldsymbol{\mathcal{Y}}_{H}\in\mathbb{R}^{I_{H}\times J_{H}\times K}_{+} and \boldsymbol{\mathcal{Y}}_{M}\in\mathbb{R}^{I\times J\times K_{M}}_{+} , respectively, where I_{H}<I , J_{H}<J , K_{M}<K . The degradation from SRI to HSI and MSI can be modeled as follows: \displaystyle\boldsymbol{\mathcal{Y}}_{H}(:,:,k)=\mathbf{P}_{1}\boldsymbol{\mathcal{Y}}_{S}(:,:,k)\mathbf{P}_{2}^{T},k\!=\!1,\ldots,K, (2) \displaystyle{\boldsymbol{\mathcal{Y}}_{M}}( \displaystyle i,j,:)\!=\!{\mathbf{P}_{M}}{\boldsymbol{\mathcal{Y}}_{S}}(i,j,:),i\!=\!1,\ldots,I,j\!=\!1,\ldots,J, where \mathbf{P}_{1}\in\mathbb{R}^{I_{H}\times I}_{+} and \mathbf{P}_{2}\in\mathbb{R}^{J_{H}\times J}_{+} are two matrices that perform spatial blurring plus downsampling along the horizontal dimension and vertical dimension, respectively. \mathbf{P}_{M}\in\mathbb{R}^{K_{M}\times K}_{+} is a band-selection and averaging matrix in the spectral dimension. We refer to [ 1 ] for details. From ( 2 ) we know \boldsymbol{\mathcal{Y}}_{H} and \boldsymbol{\mathcal{Y}}_{M} can be written as: \displaystyle\boldsymbol{\mathcal{Y}}_{H} \displaystyle=\boldsymbol{\mathcal{Y}}_{S}\times_{1}\mathbf{P}_{1}\times_{2}\mathbf{P}_{2}, (3) \displaystyle{\displaystyle\boldsymbol{\mathcal{Y}}_{M}}={\boldsymbol{\mathcal{Y}}_{S}}\times_{3}{\mathbf{P}_{M}}. An illustration of spatial and spectral degradation is shown in Fig. 1 . As such, according to ( 2 )-( 3 ), the HSI and MSI datasets together admit an NN C-CPD with flexible coupling [ 9 ] as follows: \displaystyle{\boldsymbol{\mathcal{Y}}_{H}}=[\kern-1.49994pt[{\mathbf{P}_{1}}\mathbf{A},{\mathbf{P}_{2}}\mathbf{B},\mathbf{C}]\kern-1.49994pt]_{R}, (4) \displaystyle{\boldsymbol{\mathcal{Y}}_{M}}=[\kern-1.49994pt[\mathbf{A},\mathbf{B},{\mathbf{P}_{M}}\mathbf{C}]\kern-1.49994pt]_{R}, where \mathbf{P}_{1}\in\mathbb{R}^{I_{H}\times I}_{+} , \mathbf{P}_{2}\in\mathbb{R}^{J_{H}\times J}_{+} and \mathbf{P}_{M}\in\mathbb{R}^{K_{M}\times K}_{+} are known matrices. Figure 1: The degradation of SRI 3 PROPOSED ALGORITHM The NN C-CPD model in ( 4 ) can be computed by solving the following least squares optimization problem subject to NN constraint: \begin{array}[]{l}\mathop{\mathrm{min}}\limits_{\mathbf{A},\mathbf{B},\mathbf{C}}{f}={f_{1}}+{f_{2}},\\ \mathrm{s.t.},\mathbf{A}\geq\mathbf{0},\mathbf{B}\geq\mathbf{0},\mathbf{C}\geq\mathbf{0},\end{array} (5) where {f_{1}}=\parallel{\boldsymbol{\mathcal{Y}}_{H}}-[\kern-1.49994pt[{\mathbf{P}_{1}}\mathbf{A},{\mathbf{P}_{2}}\mathbf{B},\mathbf{C}]\kern-1.49994pt]_{R}\!\parallel_{F}^{2},\;{f_{2}}=\;\parallel\!{\boldsymbol{\mathcal{Y}}_{M}}-[\kern-1.49994pt[\mathbf{A},\mathbf{B},{\mathbf{P}_{M}}\mathbf{C}]\kern-1.49994pt]_{R}\!\parallel_{F}^{2} . Note that the NN constraint can be formulated as the entry-wise squared relation between \mathbf{A} , \mathbf{B} , \mathbf{C} and a set of latent parameters \mathbf{D}\in\mathbb{R}^{I\times R} , \mathbf{E}\in\mathbb{R}^{J\times R} , \mathbf{F}\in\mathbb{R}^{K\times R} , as: \mathbf{A}=\mathbf{D}*\mathbf{D},\mathbf{B}=\mathbf{E}*\mathbf{E},\mathbf{C}=\mathbf{F}*\mathbf{F}. (6) Therefore, the problem ( 5 ) can be solved by optimization with regards to latent variables \mathbf{D} , \mathbf{E} , \mathbf{F} , which are linked to model factor matrices \mathbf{A} , \mathbf{B} , \mathbf{C} by ( 6 ). Next, we will explain how to solve it by making the use of the NLS framework for C-CPD and the well-established chain rule for deriving derivatives. 3.1 The NLS algorithm We use the NLS algorithm based on trust-region and Gauss-Newton (GN) methods which is of quadratic convergence when it approaches convergence to solve the problem ( 5 ). The second-order Taylor expansion of objective function is: {f}(\mathbf{x})\!\approx\!{f}({\mathbf{x}_{k}})\!+\!\mathbf{p}_{k}^{T}{\frac{{\partial{f}({\mathbf{x}_{k}})}}{{\partial{\mathbf{x}_{k}}}}}\!+\!\frac{1}{2}\mathbf{p}_{k}^{T}{{\bf{H}}_{k}}\mathbf{p}_{k},\left\|{\mathbf{p}_{k}}\right\|\leq{\Delta_{k}},\vskip-2.84526pt with current iteration point \mathbf{x}\mathrel{\mathop{\kern

Read the complete text