AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors

Zuopeng Zhao, Ying Liu, Xiaoyu Li, Su Luo, Lu Li, Wenwen Liu · 2026

Read AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors by Zuopeng Zhao, Ying Liu, Xiaoyu Li, Su Luo, Lu Li, Wenwen Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14341.txt.

Introduction

Zhao and five co-authors introduce AnyBand-Diff, a spectral-prior-guided diffusion framework for robust spectral reconstruction in remote sensing imagery. Diffusion models applied directly to remote sensing imagery often disregard physical laws, leading to spectral distortion and mismatch. A Masked Conditional backbone with dual stochastic masking recovers spectral information from any bands. Physics-Guided Sampling uses gradients from a differentiable model to steer denoising toward plausible results. A Multi-Scale Physical Loss enforces constraints across pixel, region, and global levels jointly. Tests confirm reliable imagery and accurate reconstruction.

Catalog record

CREATORZuopeng Zhao, Ying Liu, Xiaoyu Li, Su Luo, Lu Li, Wenwen Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52602
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14341

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors Zuopeng Zhao, Ying Liu, Xiaoyu Li, Su Luo, Lu Li, Wenwen Liu Abstract Existing diffusion models have made significant progress in generating realistic images. However, their direct adaptation to remote sensing imagery often disregards intrinsic physical laws. This oversight frequently leads to spectral distortion and radiometric inconsistency, severely limiting the scientific utility of generated data. To address this issue, this paper introduces AnyBand-Diff, a novel spectral-prior-guided diffusion framework tailored for robust spectral reconstruction. Specifically, we design a Masked Conditional Diffusion backbone integrated with a dual stochastic masking strategy, empowering the model to recover complete spectral information from arbitrary band subsets. Subsequently, to ensure radiometric fidelity, a Physics-Guided Sampling mechanism is proposed, leveraging gradients from a differentiable physical model to explicitly steer the denoising trajectory toward the manifold of physically plausible solutions. Furthermore, a Multi-Scale Physical Loss is formulated to enforce rigorous constraints across pixel, region, and global levels in a joint manner. Extensive experiments confirm the effectiveness of AnyBand-Diff in generating reliable imagery and achieving accurate spectral reconstruction, contributing to the advancement of physics-aware generative methods for Earth observation. 1 Introduction Remote sensing (RS) imagery stands as a cornerstone for a myriad of critical applications, ranging from environmental monitoring and disaster management to urban planning ( Daras et al. 2023 ) ( Xie et al. 2025 ) ( Hao & Yu 2023 ) . In these domains, the capacity to accurately analyze and interpret data from satellite and airborne sensors is pivotal for informed decision-making ( de Araújo et al. 2025 ) ( Wu et al. 2023 ) . However, the efficacy of deep learning paradigms in this field is inherently predicated on the availability of large-scale, high-fidelity annotated datasets. Regrettably, the acquisition of such data remains a formidable challenge, plagued by prohibitive costs, atmospheric perturbations (e.g., cloud occlusion), and sensor-specific constraints ( Hussain et al. 2022 ; Burke et al. 2021 ) . These impediments create a severe data scarcity bottleneck, substantially impeding the advancement of RS applications, particularly in resource-constrained regions or under adverse environmental conditions ( Shirmard et al. 2022 ) ( Xing et al. 2025 ) . To mitigate these data constraints, Generative Artificial Intelligence (GenAI)—and specifically diffusion probabilistic models—has emerged as a paradigm-shifting solution, offering the capability to synthesize realistic imagery to alleviate data paucity ( Zhang et al. 2017 ) ( Le et al. 2025 ) ( Liu et al. 2025b ) ( Esser et al. 2024 ) . Diffusion models, in particular, have demonstrated remarkable potential in reconstructing high-quality visual content from minimal priors ( Kang et al. 2025 ) ( Guan et al. 2024 ) ( Liu et al. 2025c ) . Nevertheless, a fundamental challenge remains largely unaddressed: unlike natural imagery, which prioritizes perceptual plausibility, remote sensing data constitutes rigorous physical measurements of surface properties, such as radiance and reflectance across specific spectral bands ( Yu et al. 2025b ; Dubovik et al. 2021 ) . Consequently, for generative models deployed in RS, visual fidelity alone is insufficient. It is imperative that these models maintain physical fidelity, ensuring that every generated pixel strictly adheres to radiometric consistency and faithfully reflects real-world spectral signatures. Figure 1 : The overall architecture of the AnyBand-Diff model. The input consists of a subset of spectral bands, which are randomly masked and embedded to simulate real-world sensor limitations or data loss. The model employs a PGS module to ensure spectral fidelity and physical consistency in the generated hyperspectral images. The diffusion process is carried out through Diffusion U-Net networks, with a pretraining step that incorporates physics-aware loss functions. The generated full hyperspectral image can be used for various downstream tasks such as land cover classification, change detection, and vegetation monitoring. Despite their promise, existing generative frameworks suffer from critical deficiencies regarding physical consistency. A primary limitation is that these models often over-rely on perceptual texture synthesis, neglecting the underlying physical principles governing light-material interactions. This oversight frequently leads to spectral hallucinations, resulting in deviations in critical biophysical indices (e.g., NDVI) that are vital for quantitative analysis. A second major drawback is the rigidness of conditional generation mechanisms. Most prevalent models are trained on fixed input-output mappings (e.g., RGB-to-Multispectral), rendering them ill-suited for heterogeneous real-world scenarios where input data may stem from diverse sensors or suffer from arbitrary band loss ( Goktepe et al. 2025 ) . This lack of flexibility severely curtails their applicability to incomplete or multi-source datasets. Furthermore, there exists a notable imbalance in multi-scale fidelity constraints. Conventional single-scale loss functions typically optimize for global image plausibility but fail to enforce physical realism across pixel, object, and scene levels—a hierarchical consistency that is indispensable for RS tasks requiring both fine-grained spectral precision and broad contextual coherence. To bridge these gaps, we present AnyBand-Diff , a novel spectral-prior-guided diffusion framework tailored specifically for the physical rigors of remote sensing data. The core objective of AnyBand-Diff is to explicitly embed physical priors into the generative lifecycle, guaranteeing that the synthesized imagery is not only visually compelling but also physically valid. Our key insight lies in leveraging spectral physical principles to constrain the model at multiple stages: guiding the sampling trajectory, refining intermediate states, and optimizing the training objectives. In summary, our main contributions are as follows: • We propose a sampling strategy that leverages gradients from a differentiable physical model to steer the reverse diffusion process, ensuring spectral accuracy and physical validity. • We develop a backbone with dual stochastic masking, enabling robust full-spectrum reconstruction from arbitrary band subsets to effectively handle sensor-corrupted data. • We formulate a hierarchical loss that enforces rigorous constraints across pixel, region, and global levels, jointly guaranteeing radiometric fidelity and spatial coherence. 2 Related Work 2.1 Remote sensing image generation The landscape of remote sensing (RS) image generation has witnessed a paradigm shift driven by deep generative models, evolving from Generative Adversarial Networks (GANs) to the more recent Denoising Diffusion Probabilistic Models (DDPMs) ( Ho et al. 2020 ) . Early approaches primarily leveraged GAN-based architectures to address data scarcity. Seminal works such as CycleGAN ( Zhu et al. 2017 ) and Pix2PixHD ( Wang et al. 2018 ) have been extensively adapted for RS tasks, including super-resolution, cloud removal, and domain adaptation. While effective in enhancing spatial resolution and in-painting missing regions, GANs are inherently plagued by training instability (e.g., non-convergence) and mode collapse. More critically, in the context of spectral data, GANs often prioritize perceptual plausibility over radiometric accuracy. Although specific variants like SpecGAN ( Meng et al. 2022 ) attempted to incorporate spectral constraints, they still struggle to model the complex, high-dimensional joint distributions of multi-band data, frequently resulting in spectral distortion. Diffusion models have emerged as a robust alternative, offering high-fidelity synthesis across diverse RS tasks. Recent advancements have focused on enhancing spatial and semantic consistency. MapGen-Diff ( Tian et al. 2024 ) and Sui et al. ( Sui et al. 2024 ) effectively leverage denoising diffusion bridges, semantic priors, and adversarial learning to improve structural fidelity in map generation and super-resolution tasks. In multi-modal contexts, RSVQ-Diffusion ( Gao et al. 2025 ) and CC-Diff ( Zhang et al. 2025a ) integrate transformer

Read the complete text