Deep Diffusion Models and Unsupervised Hyperspectral Unmixing for Realistic Abundance Map Synthesis
Martina Pastorino, Michael Alibani, Nicola Acito, Gabriele Moser · 2025
Read Deep Diffusion Models and Unsupervised Hyperspectral Unmixing for Realistic Abundance Map Synthesis by Martina Pastorino, Michael Alibani, Nicola Acito, Gabriele Moser (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13484.txt.
Introduction
Martina Pastorino and co-authors combine two tools to fake realistic maps of what materials cover the ground, as seen by hyperspectral satellites. Such maps, called abundance maps, say how much of each surface material sits in every pixel. Real maps are scarce, which limits training and testing of analysis software. The team's first step unmixes raw satellite data without labels, separating the pure materials and their maps. A diffusion model then learns from those maps and generates new ones with believable spatial patterns.
The whole method is unsupervised, so it adapts to new data sets without hand labeling. The team validated it on real imagery from the PRISMA Earth observation mission. The synthetic maps kept the spatial and spectral character of natural scenes. The authors aim the tool at data augmentation, benchmarking, and fair evaluation of hyperspectral methods, where realistic test data are hard to gather.
Catalog record
| CREATOR | Martina Pastorino, Michael Alibani, Nicola Acito, Gabriele Moser |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-13484
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Diffusion Models and Unsupervised Hyperspectral Unmixing for Realistic Abundance Map Synthesis Martina Pastorino, Michael Alibani, Nicola Acito, Gabriele Moser Abstract This paper presents a novel methodology for generating realistic abundance maps from hyperspectral imagery using an unsupervised, deep-learning-driven approach. Our framework integrates blind linear hyperspectral unmixing with state-of-the-art diffusion models to enhance the realism and diversity of synthetic abundance maps. First, we apply blind unmixing to extract endmembers and abundance maps directly from raw hyperspectral data. These abundance maps then serve as inputs to a diffusion model, which acts as a generative engine to synthesize highly realistic spatial distributions. Diffusion models have recently revolutionized image synthesis by offering superior performance, flexibility, and stability, making them well-suited for high-dimensional spectral data. By leveraging this combination of physically interpretable unmixing and deep generative modeling, our approach enables the simulation of hyperspectral sensor outputs under diverse imaging conditions—critical for data augmentation, algorithm benchmarking, and model evaluation in hyperspectral analysis. Notably, our method is entirely unsupervised, ensuring adaptability to different datasets without the need for labeled training data. We validate our approach using real hyperspectral imagery from the PRISMA space mission for Earth observation, demonstrating its effectiveness in producing realistic synthetic abundance maps that capture the spatial and spectral characteristics of natural scenes. 1 Introduction Hyperspectral imaging has emerged as a powerful tool in various scientific and industrial applications, because of its very high spectral resolution. By capturing detailed spectral information across a broad range of wavelengths, hyperspectral sensors provide valuable insights into the composition and characteristics of materials present in a scene. This capability has enabled advances in multiple domains, including remote sensing richards , environmental monitoring Zhang18032024 , urban planning 9773336 , precision agriculture 10353994 , and biomedical imaging for disease diagnosis and image-guided surgery PMC3895860 . However, despite its potential, the widespread adoption of hyperspectral imaging is hindered by some challenges, as their acquisition may be constrained by environmental factors such as atmospheric conditions and sensor limitations. Additionally, real-world hyperspectral datasets may suffer from noise, radiometric distortions, and spatial inconsistencies, further complicating their use for algorithm development and validation. To mitigate these limitations, synthetic data generation has become an increasingly relevant approach. The ability to produce realistic hyperspectral datasets allows researchers to simulate sensor performance, support the planning of space missions, and generate large-scale training data for machine learning models. A crucial aspect of hyperspectral image simulation is the generation of abundance maps, which describe the fractional composition of materials within each pixel. Since hyperspectral images result from the interaction of multiple materials within a given spatial resolution, abundance maps provide an interpretable representation of the scene content. Instead of synthesizing hyperspectral data directly in the high-dimensional spectral space, the simulation task can be reformulated in the abundance space, reducing computational complexity while preserving the statistical and spatial characteristics of real data. Recent advances in generative modeling have provided robust frameworks for synthetic data generation, particularly with the rise of foundation generative models bommasani_arxiv . These large-scale models, trained on vast and diverse datasets, have demonstrated impressive generalization capabilities in various domains, including text brown_nips , images Radford2021LearningTV ; dm ; dm_icml , and even hyperspectral data synthesis unmixingDM . Foundation generative models, such as diffusion models and transformer-based architectures, offer scalable and versatile solutions for data generation by capturing complex distributions with minimal supervision. In the context of hyperspectral imaging, such models can be adapted to learn meaningful spectral-spatial representations spectral_gpt , facilitating the creation of realistic synthetic datasets. By leveraging the strengths of these generative paradigms, our approach integrates domain-specific constraints with state-of-the-art generative modeling to enhance the realism and usability of synthetic abundance maps. A key approach for abundance estimation is blind linear hyperspectral unmixing, which aims to decompose hyperspectral images into their constituent spectral signatures, known as endmembers, and their corresponding abundance maps. Unlike supervised unmixing methods, which rely on prior knowledge of endmember spectra, blind unmixing methods estimate both the spectral signatures and abundances directly from the data hysupp . Given the importance of unmixing in hyperspectral analysis, numerous techniques have been developed, utilizing statistical MV_bum , Bayesian BSMA , and deep learning-based methodologies cnnaeu ; pgmsu . These approaches seek to improve the accuracy and robustness of abundance estimation, which is a crucial step in hyperspectral image interpretation and synthesis. In recent years, diffusion models have emerged as state-of-the-art generative models for image synthesis bishop ; dm ; unmixingDM ; dm_gan ; dm_icml . Unlike traditional generative adversarial networks (GANs) gan ; cyclegan or autoencoders luppino , which directly learn mappings from latent representations to images, diffusion models operate by progressively transforming random noise into structured images through a stepwise denoising process. This approach, inspired by stochastic differential equations, has demonstrated remarkable success in generating high-quality samples while avoiding common pitfalls of GANs, such as mode collapse and training instability bishop ; dm_gan . By learning to reverse a noise corruption process, diffusion models effectively capture complex spatial structures and realistic feature distributions, making them well-suited for hyperspectral data synthesis. In this work, we propose an unsupervised methodology for generating synthetic abundance maps derived from real hyperspectral imagery. The approach integrates blind linear unmixing for extracting spectral endmembers and abundance maps with a diffusion model for generating realistic spatial distributions that mimic the patterns observed in real-world hyperspectral data. The unmixing process provides a physically interpretable decomposition of hyperspectral signals, while the diffusion model ensures that the generated abundance maps exhibit realistic spatial coherence and material distributions. By leveraging hyperspectral datasets from the PRISMA mission, we ensure that the synthetic abundance maps maintain spectral fidelity and physical plausibility, making them useful for hyperspectral image simulation, domain adaptation, sensor performance assessment, and data augmentation for machine learning applications. Compared to the previous method in unmixingDM , we do not propose a specific autoencoder-based unmixing method to produce the abundance maps used to train the diffusion model. We rather use a set of existing hyperspectral unmixing methods, drawing from the three methodological families (statistical, deep learning, and least squares-based), in order to obtain heterogeneous abundance maps. This allows for more generality: the generated output by the diffusion model is not conditioned to a single unmixing algorithm and its possible specific limitations, but is influenced by the dictionary of methods. This paper is organized as follows. Section 2 describes the proposed methodology, detailing the integration of blind unmixing techniques and diffusion-based generative modeling. Section 3 presents the experimental validation, showcasing synthetic abundance maps generated for different land cover types, including mountainous, vegetated, urban, and mixed environments. The effectiveness of the proposed approach is evaluated through qualitative visual analysis, demonstrating its potential for advancing hyperspectral image simulation and providing reliable synthetic datasets for remote sensing research and beyond. 2 Proposed Method 2.1 Overview of the proposed approach Figure 1 : Architecture of the proposed method for the synthesis of realistic abundance maps. This work is framed within the broader scope of hyperspectral data simulation, a challenging task due to the high spectral dimensionality of hyperspectral imagery. Directly synthesizing high-fidelity hyperspectral data remains difficult; therefore, we propose an intermediate synthesis approach that focuses on generating realistic abundance maps. By addressing the synthesis problem in the abundance space—where the dimensionality