A Tractable Two-Step Linear Mixing Model Solved with Second-Order Optimization for Spectral Unmixing under Variability
Xander Haijen, Bikram Koirala, Xuanwen Tao, Paul Scheunders · 2025
Read A Tractable Two-Step Linear Mixing Model Solved with Second-Order Optimization for Spectral Unmixing under Variability by Xander Haijen, Bikram Koirala, Xuanwen Tao, Paul Scheunders (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17212.txt.
Introduction
Xander Haijen, Bikram Koirala, Xuanwen Tao, and Paul Scheunders offer a new way to unmix the light signals recorded in each pixel of a satellite image. Their paper appeared in two thousand twenty-five. Each pixel blends light from several pure materials, and the blend shifts as conditions change across the scene. Older models either miss that shift or turn too heavy to solve.
Their model adds two scaling steps: one that varies across the whole image and one set per pixel. That split keeps the math only mildly tangled. They solve it with a method that uses curvature facts, a first for this kind of problem. The method needs almost no hand tuning. Tests on fake and real data match or beat the best known tools, even when the pure materials are unknown.
Catalog record
| CREATOR | Xander Haijen, Bikram Koirala, Xuanwen Tao, Paul Scheunders |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-17212
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Tractable Two-Step Linear Mixing Model Solved with Second-Order Optimization for Spectral Unmixing under Variability Xander Haijen, Bikram Koirala, Xuanwen Tao, Paul Scheunders Abstract Spectral unmixing is an important task in hyperspectral image processing. It can be thought of as a regression problem, where the observed variable (i.e., an image pixel) is to be found as a function of the response variables (i.e., the pure materials in a scene, called endmembers). The Linear Mixing Model (LMM) has received a great deal of attention, due to its simplicity and ease of use in, e.g., optimization problems. Its biggest flaw is that it assumes that any pure material can be characterized by one unique spectrum throughout the entire scene. In many cases, this is incorrect: the endmembers face a significant amount of spectral variability caused by, e.g., illumination conditions, atmospheric effects, or intrinsic variability. Researchers have suggested several generalizations of the LMM to mitigate this effect. However, most models lead to ill-posed and highly non-convex optimization problems, which are hard to solve and have hyperparameters that are difficult to tune. They also use first-order optimization methods, which are not suitable for the complex problems they address. In this paper, we propose a Two-Step Linear Mixing Model (2LMM) that bridges the gap between model complexity and computational tractability. The model achieves this by introducing two distinct scaling steps: an endmember scaling step across the image, and another for pixel-wise scaling. We show that this model leads to only a mildly non-convex optimization problem, which we solve with an optimization algorithm that incorporates second-order information. To the authors’ knowledge, this work represents the first application of second-order optimization techniques to solve a spectral unmixing problem that models endmember variability. Our method is highly robust, as it requires virtually no hyperparameter tuning and can therefore be used easily and quickly in a wide range of unmixing tasks. We show through extensive experiments on both simulated and real data that the new model is competitive and in some cases superior to the state of the art in unmixing. The model also performs very well in challenging scenarios, such as blind unmixing. I Introduction Hyperspectral imaging (HSI) has been widely used as an alternative to high-spatial-resolution RGB images in remote sensing for the detection of, e.g., terrestrial features and ground cover classification [ 1 ] . As HSI typically lacks sufficient spatial resolution, an important task is spectral unmixing , i.e., the subpixel estimation of the coverages of pure materials. A major challenge during unmixing is the fact that the signatures of the pure materials vary throughout the image, due to various causes. As a result, researchers have focused much attention on developing unmixing methods that can mitigate this effect. I-A Unmixing under spectral variability The linear mixing model (LMM) serves as the basis for many unmixing models and techniques. The basic assumption of the LMM is that the surface within a given image is covered by a low number of distinct pure materials that have relatively constant spectral signatures. These distinct materials are called the endmembers (EMs) [ 2 ] . The LMM assumes that the reflected spectrum in each pixel can be described as a linear combination of the pure materials. The relative area covered by any given EM is known as its fractional abundance . Performing unmixing using the LMM is usually done by minimizing the Euclidean distance between the measured spectrum and a reconstructed spectrum. This leads to a convex minimization problem, which is separable per pixel. As a consequence, the problem can be solved efficiently and in a parallelized way. However, the LMM is not suited for performing unmixing when spectral variability is present. It has a significant model mismatch, which leads to poor results. As a result, researchers have developed a wide variety of methods to mitigate the effects of spectral variability [ 3 ] . In these methods, EM signatures either originate from a spectral library or can be obtained from the image using an Endmember Extraction Algorithm (EEA). The most important unmixing methods are summarized below. I-A 1 Methods that use spectral libraries These methods assume the availability of a spectral library, which is an overcomplete collection of multiple signatures for each EM that represent the possible variability for that EM. The simplest method that uses spectral libraries is Multiple Endmember Spectral Mixture Analysis (MESMA) [ 4 ] . MESMA assumes an LMM in each pixel, and for every pixel, it finds the best-fitting EM signatures using least-squares. This is a combinatorial problem, so it can quickly become prohibitively large. Several variants exist, but they are only effective for small spectral libraries. As a way to reduce the computational burden of MESMA, sparse unmixing was proposed. Only one least-squares problem per pixel is solved, while enforcing abundance sparsity to limit the number of signatures that are actually contributing to the pixel. A well-known method for sparse unmixing is the Sparse Unmixing by variable Splitting and Augmented Lagrangian (SUnSAL) [ 5 ] , of which several variants exist [ 6 ] . I-A 2 Parametric physics-based models Physics-based models explicitly model the physical interaction of light with a material, described by a (relatively low) number of parameters. For example, the community standard for modeling topographic effects is Hapke’s model [ 7 , 8 ] . Hapke’s model uses the Single Scattering Albedo (SSA) of a material, in combination with incident and reflected angles, to determine the reflectance spectrum of a material. Physics-based models tend to be very complicated and very difficult, if not impossible, to invert. In the context of unmixing, this leads to extremely challenging and ill-posed optimization problems. I-A 3 Parametric physically motivated models Since full physics-based models are too complicated, simpler models, which are not physics-based, but physically motivated, are often used [ 3 ] . Starting from the LMM, several consequent generalizations have been proposed. Some approaches model the variability as a scaling of the EM signatures, which is especially suited for illumination- and topography-induced variability. The Scaled LMM (SLMM) includes a pixel-wise scaling factor. This simple model leads to a convex optimization problem. The Extended LMM (ELMM) is a generalization of the SLMM, and it includes a scaling factor for every EM in every pixel [ 9 ] . Next, the Generalized LMM (GLMM) incorporates wavelength-specific effects and includes additional scaling factors for each spectral band [ 10 ] . The variability can also be modeled as an additive perturbation, accounting for intrinsic variability and inter-class variability, i.e., variability due to the presence of unknown materials. The Perturbed LMM (PLMM) includes a pixel-wise additive perturbation on the EMs [ 11 ] . The Augmented LMM (ALMM) combines the pixel-wise scaling factor from the SLMM with the additive perturbation of the PLMM [ 12 ] . Most of these models are non-convex and are solved using an alternating least squares (ALS) approach, which iteratively solves a series of convex least-squares sub-problems. I-A 4 Models jointly estimating EMs and abundances The performance of the models above depends heavily on the quality of the reference EMs. When they are provided a priori, we have no control over their quality. When pixels in an image are highly mixed or