HarmoniDiff-RS: Training-Free Diffusion Harmonization for Satellite Image Composition

Xiaoqi Zhuang, Jefersson A. Dos Santos, Jungong Han · 2026

Read HarmoniDiff-RS: Training-Free Diffusion Harmonization for Satellite Image Composition by Xiaoqi Zhuang, Jefersson A. Dos Santos, Jungong Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19392.txt.

Introduction

Zhuang, Dos Santos, and Han propose HarmoniDiff-RS, a training-free diffusion method for blending composite satellite images across diverse domains. Satellite image blending matters for remote sensing tasks like data augmentation, disaster simulation, and urban planning. Their method aligns source and target domains with a latent mean shift that moves radiometric traits between them. A timestep-wise latent fusion balances blending with content preservation, and a light harmony classifier picks the most coherent result.

Catalog record

CREATORXiaoqi Zhuang, Jefersson A. Dos Santos, Jungong Han
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31957
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19392

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HarmoniDiff-RS: Training-Free Diffusion Harmonization for Satellite Image Composition Xiaoqi Zhuang, Jefersson A. Dos Santos, Jungong Han Abstract Satellite image composition plays a critical role in remote sensing applications such as data augmentation, disaste simulation, and urban planning. We propose HarmoniDiff-RS , a training-free diffusion-based framework for harmonizing composite satellite images under diverse domain conditions. Our method aligns the source and target domains through a Latent Mean Shift operation that transfers radiometric characteristics between them. To balance harmonization and content preservation, we introduce a Timestep-wise Latent Fusion strategy by leveraging early inverted latents for high harmonization and late latents for semantic consistency to generate a set of composite candidates. A lightweight harmony classifier is trained to further automatically select the most coherent result among them. We also construct RSIC-H , a benchmark dataset for satellite image harmonization derived from fMoW, providing 500 paired composition samples. Experiments demonstrate that our method effectively performs satellite image composition, showing strong potential for scalable remote-sensing synthesis and simulation tasks. Code is available at: https://github.com/XiaoqiZhuang/HarmoniDiff-RS 1 Introduction Composing satellite images is a fundamental but under-explored problem in remote sensing. A reliable image composition framework could enable data augmentation, disaster simulation, and urban planning by synthesizing reasonable satellite scenes under various temporal, geographic, and environmental conditions. In natural image composition Pérez et al. 2003 ; Chen et al. 2024 ; Pham et al. 2024 ; Lu et al. 2023 , the main challenge lies in achieving semantic alignment between the well-segmented source foreground and the target background.To achieve visual realism, the source object is often allowed to undergo non-rigid geometric deformation or appearance adjustments, such as changing the pose or shape to better fit the surrounding context (e.g., the sheep in Fig. 1 adapts from a standing to a sitting posture). In contrast, satellite image composition focuses on structurally rigid sources such as buildings, roads, or ports, where geometric integrity must be preserved for the result to remain realistic. The primary challenge therefore shifts from semantic alignment to boundary harmonization and radiometric consistency, ensuring seamless integration without distorting the original structure, as shown in Fig. 1 . Therefore, in this paper, we define satellite image composition as the task of harmonizing a rigid source region with a target scene, ensuring boundary smoothness and appearance consistency without altering the original geometry . Note that our definition of satellite image composition differs from its conventional use in remote sensing, where the term typically refers to multi-sensor or multi-temporal image fusion for radiometric normalization or mosaicking. Figure 1 : Comparison between natural Pham et al. 2024 (upper) and satellite (bottom) image composition. Natural image composition emphasizes semantic alignment and may involve non-rigid source deformation, while satellite composition focuses on boundary harmonization under geometric rigidity. Despite significant progress in natural image harmonization and blending Pérez et al. 2003 ; Chen et al. 2024 ; Pham et al. 2024 ; Lu et al. 2023 , these methods are not directly applicable to satellite imagery. First, they often rely on deforming the source geometry to better blend with the target, an operation unsuitable for the structurally rigid targets commonly found in satellite scenes such as buildings and roads. Second, unlike natural image datasets with object-level segmentation masks, satellite imagery rarely provides accurate source delineations, making it challenging to define precise compositional boundaries. These differences motivate the development of a harmonization-based framework that can handle rigid, structure-preserving compositions without requiring segmentation-level supervision. To address the above challenges, we propose HarmoniDiff-RS, a training-free diffusion harmonization framework for satellite image composition. Unlike existing approaches that rely on online optimization Chen et al. 2024 ; Pham et al. 2024 , or fine-tuning Zhang et al. 2020 ; Tan et al. 2023 ; Yang et al. 2022 , our method operates entirely in the diffusion latent space to exploit generative priors for harmonization. We first perform Latent Mean Shift Normalization, aligning the radiometric and stylistic statistics of the source latent with those of the target latent to ensure consistent illumination and color/spectral balance. Then, inspired by the properties of the Denoising Diffusion Implicit Model (DDIM) Song et al. 2021 inversion, we observe that early inverted latents yield more harmonious but less identity-preserving results, whereas later latents retain structure but suffer from boundary artifacts. To balance these complementary effects, we propose a Timestep-wise Latent Fusion strategy that selectively combines early and late latents under an edge-aware mask, achieving both boundary smoothness and geometric preservation. Finally, a lightweight Harmony Classifier evaluates each timestep’s output and selects the most harmonious composition as the final result. Together, these components enable geometry-preserving and radiometrically consistent composition without any model training or optimization. In summary, our main contributions are as follows: • We define and address the novel task of realistic satellite image composition , which differs from natural image composition by focusing on boundary harmonization and geometric preservation rather than semantic alignment or object deformation. We further propose a training-free diffusion harmonization framework, HarmoniDiff-RS , to tackle this task. • We introduce a diffusion-latent harmonization mechanism that jointly performs radiometric alignment and timestep-wise latent fusion. This mechanism leverages the complementary properties of early and late inverted latents to achieve both structural fidelity and boundary smoothness, resulting in visually consistent compositions without fine-tuning. • We construct a benchmark RSIC-H for satellite image composition, which includes a new dataset with diverse cross-domain source–target pairs and two quantitative metrics, Harmony Score (HS) and Boundary Gradient Difference (BGD), for assessing compositional realism and boundary smoothness. 2 Related Work 2.1 Remote Sensing Diffusion Models Diffusion models Ho et al. 2020 ; Song et al. 2021 have emerged as powerful generative frameworks that gradually denoise Gaussian noise into realistic images through iterative refinement. DDIM Song et al. 2021 provides a deterministic sampling and inversion formulation, enabling bidirectional mapping between image and latent domains without retraining. This property makes DDIM particularly appealing for tasks requiring real-image manipulation, as it allows controlled editing and harmonization while preserving structural content. Recently, several works have adapted diffusion models to remote sensing imagery. Text2Earth Liu et al. 2025 and DiffusionSat Khanna et al. 2024 proposed text-to-satellite generation models, capable of synthesizing satellite images based on text descriptions, and the image quality is far superior to that generated using the traditional text-to-image model. Beyond text-driven generation, diffusion models have introduced other controllability by conditioning on bounding boxes Tang et al. 2024b , street maps Sastry et al. 2024 , or sketches Tang et al. 2024a , enabling fine-grained spatial generation. More recently, CC-Diff++ Zhang et al. 2025 focuses on the issue of regional inconsistency in controlled generation, proposing cross-region constraints to improve spatial coherence. Although it mitigates disharmony during conditioned synthesis, CC-Diff++ Zhang et al. 2025 still generates new images from noise rather than adapting or harmonizing real satellite imagery. In contrast, our work tackles the problem of satellite image composition , where the goal is not to generate an entire scene but to seamlessly integrate the source patch and the target scene with consistent appearance and radiometric properties. 2.2 Image Composition Image composition aims to seamlessly integrate a foreground object into a background image while maintaining visual realism and structural coherence. Early methods approached this problem through pixel-domain blending techniques such as Poisson image

Read the complete text