RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning
Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang, Yong Xu, Zhulin An †, Yongjun Xu, Zitong Yu † · 2026
Read RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning by Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang, Yong Xu, Zhulin An †, Yongjun Xu, Zitong Yu † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28266.txt.
Introduction
Yelin Wang and eight colleagues, including Zitong Yu, teach large vision-language models to describe what changed between two satellite images of the same place taken at different times. Earlier change-captioning systems used conventional networks whose limited capacity capped quality, while simply retraining a large model stumbles on scarce data.
Wang's team built RSICCLLM, a post-training framework with a difference-aware fine-tuning stage that forces the model to extract change features before describing them. A preference stage then trains against two kinds of deliberately wrong captions, sharpening fine-grained accuracy. They also released an instruction dataset and a benchmark for the task. With a modest seven-billion-parameter model, their system surpassed far larger models on change captioning tests.
Catalog record
| CREATOR | Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang, Yong Xu, Zhulin An †, Yongjun Xu, Zitong Yu † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28266
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang, Yong Xu, Zhulin An †, Yongjun Xu, Zitong Yu † Abstract Remote Sensing Image Change Captioning (RSICC) aims to describe changes between bi-temporal remote sensing images and holds significant research and application value. However, most existing methods rely on conventional deep learning architectures, and the limited model capacity constrains performance. Although large-model post-training techniques have achieved great success in general domains, their direct transfer to RSICC remains challenging due to data scarcity and the need for fine-grained change understanding. To address this, we propose RSICCLLM, the first post-training framework for large vision-language models in RSICC. Specifically, we design a data generation paradigm , release the instruction dataset RSICI, and establish a task-specific RSICC benchmark . We further introduce Difference-aware Supervised Fine-tuning to explicitly extract change representations and guide the model in perceiving and understanding temporal differences. In addition, we propose Dual-Negative Preference Optimization (DNPO) , which employs two complementary negative-sample construction strategies to construct the preference dataset RSICP and further refine model performance. Extensive experiments validate the superior capability of RSICCLLM, which achieves outstanding results with only 7B parameters, surpassing models of substantially larger scales. The code and dataset will be made publicly available at https://github.com/keaill/RSICCLLM . * * footnotetext: These authors contributed equally to this work. † † footnotetext: Corresponding Authors. 1 Introduction Remote sensing image change captioning (RSICC) generates descriptions of changes between bi-temporal remote sensing images [ 73 , 19 , 33 , 61 , 65 , 50 , 70 ] . Unlike remote sensing image change detection (RSICD), which reports only visual differences [ 64 , 35 , 62 , 68 , 69 , 71 , 18 ] , RSICC maps visual evidence to semantics, improving interpretability and supporting many important public affairs, such as environmental assessment and disaster response. As an essential component of the remote sensing field, RSICC still faces multiple challenges [ 73 , 51 , 52 , 58 , 57 , 22 , 23 ] , such as accurately perceiving real changes between bi-temporal images while ignoring irrelevant factors like illumination, and capturing subtle, diverse land-cover variations while aligning them with natural language. Therefore, RSICC holds substantial scientific and practical significance. Figure 1 : The differences between the previous approaches and ours. (a) Previous methods are constrained by limited model capacity and data scarcity , hindering performance in change captioning. (b) Existing remote-sensing foundation models are rarely post-trained for RSICC with instruction or preference alignment, mainly due to limited RSICC data and preference supervision. (c) We introduce a data generation paradigm and train a refined larger model with Supervised Fine-tuning and Dual-Negative Preference Optimization, achieving superior results. Recently, RSICC has attracted increasing research attention and made continuous progress. Semantic-CC [ 72 ] uses a SAM-based dual-image encoder with a lightweight multi-scale change detection (CD) decoder for pixel-level semantic guidance. Pix4Cap [ 31 ] adds a CD branch to produce pseudo-labels and a semantic-fusion augmentation to inject CD features into the captioner. Prompt-CC [ 34 ] introduces an image-level change classifier and a multi-prompt strategy that leverages an off-the-shelf caption generator to produce plausible captions without retraining. However, these methods are primarily based on conventional deep learning frameworks, and their relatively small model capacity imposes an upper limit on overall performance. Meanwhile, large-scale models and post-training techniques have shown strong success in general domains [ 16 , 56 ] and are being introduced into remote sensing [ 26 , 47 ] . For example, RS-GPT and Falcon leverage large-scale multimodal training to achieve strong performance on remote-sensing captioning and various downstream tasks [ 21 , 60 ] . Compared with conventional deep learning models, large models offer significant gains from increased capacity. However, due to the scarcity of specific datasets for RSICC and the limited ability of existing vision-language models to understand temporal changes, generating accurate and reliable change descriptions remains challenging. Motivated by these observations, we explore whether large-scale models and post-training techniques can be introduced into the RSICC field to enhance understanding of changes and achieve performance breakthroughs. Based on this idea, we propose RSICCLLM, the first post-training framework of large models tailored for RSICC. The differences between the previous approaches and ours are shown in Fig. 1 . We first construct an instruction dataset generation paradigm for RSICC using large-scale RSICD data. Specifically, we employ Qwen-VL-Max to generate instruction samples by feeding bi-temporal remote sensing images, together with their corresponding binary masks as geometric priors. By prompting the model to describe changes within the masked regions, we obtain a high-quality instruction dataset named Remote Sensing Image Change Instruction dataset (RSICI) . Based on this dataset, we establish a task-specific RSICC benchmark . We then adopt Qwen2.5-VL-7B as the backbone for subsequent training. To further improve the model’s perception and understanding of temporal changes while suppressing irrelevant factors, we propose Difference-aware Supervised Fine-tuning , which explicitly extracts change representation and enhance the visual encoder with Central Difference Convolution (CDConv) [ 63 ] and Hough Transform modules [ 4 ] . Using RSICI, we perform Supervised Fine-tuning (SFT) to obtain RSICCLLM-sft. Subsequently, we propose Dual-Negative Preference Optimization (DNPO) to further enhance model performance. We first design two strategies for constructing negative samples and build the Remote Sensing Image Change Preference dataset (RSICP) . In addition, we perform preference optimization on RSICCLLM-sft using RSICP and introduce a new loss operator to stabilize the training process, yielding the final model RSICCLLM. Our main contributions can be summarized as follows: • We design a new instruction dataset generation paradigm in RSICC, building a large-scale instruction dataset RSICI and establish a task-specific RSICC benchmark . We also release the first preference dataset RSICP dedicated to this task. • We propose RSICCLLM, the first post-training framework of large models for RSICC. To improve the model’s understanding of temporal changes, we propose Difference-aware Supervised Fine-tuning. And a new preference optimization objective DNPO is introduced to progressively refine the model’s performance. • Extensive experiments demonstrate the superior performance of our approach. Notably, RSICCLLM achieves state-of-the-art performance across all evaluation metrics with only 7B parameters. 2 Related Works Remote Sensing Image Change Captioning. RSICC has recently emerged as a new research direction in remote sensing [ 10 , 49 , 15 , 12 ] . Early work by Chouaf et al . [ 11 ] explored RSICC on a private dataset with a VGG-16 encoder and an RNN decoder, which was later extended by Hoxha et al . [ 19 ] using image- and feature-level fusion encoders. Liu et al . [ 33 ] established the LEVIR-CC benchmark and proposed a CNN–transformer framework to emphasize changed regions. Subsequent studies further improved RSICC with progressive scale-aware modeling [ 32 ] and Mamba-based spatio-temporal feature extraction [ 6 ] . All the aforementioned methods are deep-learning-based, and their progress is severely constrained by limited datasets and small model capacity. In contrast, our approach addresses these limitations by introducing a data generation paradigm and a large-scale training framework. Multimodal Reasoning. Recent work shifts multimodal reasoning from supervised learning to reinforcement-based fine-tuning with explicit reasoning [ 53 , 59 , 39 ,