From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge Expansion Conference: The 31-th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’25); Oct 19 – 23th, 2025; Honolulu, Hawai’i 2275 Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowle
Zheng Wang, Kai Ying, Bin Xu, Chunjiao Wang, Cong Bai † · 2025
Read From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge Expansion Conference: The 31-th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’25); Oct 19 – 23th, 2025; Honolulu, Hawai’i 2275 Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowle by Zheng Wang, Kai Ying, Bin Xu, Chunjiao Wang, Cong Bai † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07050.txt.
Introduction
Zheng Wang and co-authors extend satellite rainfall estimates from a narrow scanning strip to the whole visible disc of the Earth, in a 2025 paper. Microwave and radar sensors measure rain well but see only a swath; infrared sensors see everything yet relate weakly to surface rain. The task is to teach an infrared-only model the accuracy of the richer sensors.
Their two-stage system first distills knowledge from a multimodal teacher into the infrared model inside the swath, using coordinated masking and wavelet enhancement. A second stage adapts the model across the full disc while balancing both knowledge sources. On their new benchmark, the system beat leading operational rainfall products. Timely global rain maps feed flood warnings and water management.
Catalog record
| CREATOR | Zheng Wang, Kai Ying, Bin Xu, Chunjiao Wang, Cong Bai † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07050
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge Expansion Conference: The 31-th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’25); Oct 19 – 23th, 2025; Honolulu, Hawai’i 2275 Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3711896.3736971 ISBN: 979-8-4007-1454-2/2025/08 Thanks: †Corresponding author CCS: Applied computing Earth and atmospheric sciences CCS: Information systems Multimedia and multimodal retrieval Zheng Wang, Kai Ying, Bin Xu, Chunjiao Wang, Cong Bai † Abstract . Accurate near-real-time precipitation retrieval has been enhanced by satellite-based technologies. However, infrared-based algorithms have low accuracy due to weak relations with surface precipitation, whereas passive microwave and radar-based methods are more accurate but limited in range. This challenge motivates the Precipitation Retrieval Expansion (PRE) task, which aims to enable accurate, infrared-based full-disc precipitation retrievals beyond the scanning swath. We introduce Multimodal Knowledge Expansion, a two-stage pipeline with the proposed PRE-Net model. In the Swath-Distilling stage, PRE-Net transfers knowledge from a multimodal data integration model to an infrared-based model within the scanning swath via Coordinated Masking and Wavelet Enhancement (CoMWE). In the Full-Disc Adaptation stage, Self-MaskTune refines predictions across the full disc by balancing multimodal and full-disc infrared knowledge. Experiments on the introduced PRE benchmark demonstrate that PRE-Net significantly advanced precipitation retrieval performance, outperforming leading products like PERSIANN-CCS, PDIR, and IMERG. The code will be available at https://github.com/Zjut-MultimediaPlus/PRE-Net . Figure 1. (a) The Precipitation Retrieval Expansion (PRE) task utilizes both strongly correlated PMW and PR data, as well as weakly correlated IR data for learning, while only IR data offers full-disc coverage. The PRE task leverages these heterogeneous data to achieve high-quality full-disc precipitation retrieval. (b) Multimodal knowledge expansion pipeline of PRE-Net. Multimodal knowledge is transferred via knowledge distillation in the Swath-Distilling stage and is further expanded from scanning swath to full-disc precipitation retrieval in the Full-Disc Adaptation stage. 1. Introduction Accurate precipitation measurements are crucial for hydrometeorological studies, water resource management, and disaster prevention ( Trenberth et al. 2003 ; Oki and Kanae 2006 ) . These are typically divided into direct observations via ground-based rain gauges and indirect satellite retrievals. While rain gauges are reliable, their sparse distribution and inability to capture oceanic precipitation limit their effectiveness ( Prigent 2010 ) . In contrast, satellite-based retrievals offer broader coverage, making them a promising alternative for precipitation estimation. Satellite-based precipitation retrieval primarily uses three types of sensor data: infrared (IR), passive microwave (PMW), and spaceborne precipitation radar (PR). IR data, collected by Geostationary-Earth-orbit (GEO) satellites, offers high spatiotemporal resolution ( \leq 4 km, 5-30 min intervals) and near-global coverage ( Lebedev et al. 2019 ) , making it widely used in operational retrievals ( Nguyen et al. 2018 ; Hong et al. 2004 ; Nguyen et al. 2020 ) . However, IR data often shows a weak correlation with precipitation, as it mainly captures cloud-top features rather than hydrometeor profiles ( Behrangi et al. 2009 ; Arkin and Meisner 1987 ) , leading to low-quality precipitation retrieval. In contrast, PMW and PR reflectivity, obtained from low-Earth-orbit (LEO) satellites, can penetrate cloud layers to detect the 3D microstructure of precipitation particles ( Chen et al. 2019a ) . Advanced retrieval methods ( Kummerow et al. 2001 ; Liu et al. 2022 ; Chen et al. 2019b ) exploit these direct precipitation-cloud relations, achieving superior performance. However, both PMW and PR suffer limited spatial coverage (narrow scanning swath of 2,873 km /245 km width), and low spatiotemporal resolution (90 mins, 13 km & 90 mins, 5 km ) compared to IR data (full-disc, 5 mins, and 4 km). Those data’s heterogeneous issue hinders their ability to offer continuous, global coverage, which is crucial for effective precipitation monitoring. To overcome these limitations and enable high-quality full-disc precipitation retrievals, we propose a novel P recipitation R etrieval E xpansion (PRE) task, as illustrated in Fig. 1 (a). This task leverages the complementary strengths of multimodal data (IR, PMW, and PR) to address the constraints of narrow coverage and enhance retrieval accuracy. While multimodal data is available within a single scanning swath, IR remains the only modality with full-disc coverage, making it essential for expanding precipitation retrieval beyond the scanning swath. This paper frames the PRE task as an incomplete multimodal learning problem ( Wang et al. 2020b ; Chen and Zhang 2020 ) . To tackle this challenge, one possible approach is to generate missing multimodal data ( Pan et al. 2022 ; Sun et al. 2021 ; Ma et al. 2021 ) . However, the missing modalities are hardly recoverable due to the varying physical properties captured by the different data mentioned above. Alternatively, modality-agnostic learning methods ( Zhang et al. 2023b ; Havaei et al. 2016 ; Dorent et al. 2019 ) aim to learn representations that are invariant to the specific modality. However, learning shared features may be useless when there is a strong imbalance in how each modality correlates with precipitation. In contrast, we find that knowledge distillation (KD) ( Wei et al. 2023 ; Wang et al. 2023 ; Wang et al. 2020c ) offers a more feasible solution. It transfers precipitation-related knowledge from high-quality multimodal data to low-quality IR data through a teacher-student model, facilitating more effective learning with missing modalities. Despite this, transferring knowledge is challenging, especially because IR data’s broader coverage doesn’t necessarily translate to more useful knowledge about precipitation. To answer the above challenges, we propose a multimodal knowledge expansion pipeline consisting of two stages, as illustrated in Fig. 1 . In the first stage, Swath-Distilling , we employ feature-based knowledge distillation to transfer precipitation-related knowledge from a teacher, trained on multimodal data (PMW, PR, IR), to a student that operates on IR-only. We design a lightweight PRE-Net model with only 48M parameters to accomplish this and introduce the Co ordinated M asking and W avelet E nhancement (CoMWE) module. It consists of two key components: R e- M asked K nowledge D istillation (RMKD), which encodes richer content knowledge by applying strategically reconstructed masks with a high mask ratio; D etail- A ware W avelet E hancement (DAWE), which preserves fine-grained details by leveraging high-frequency wavelet components. In the second stage, Full-Disc Adaptation , we present Self-MaskTune , a simple yet effective fine-tuning method that generalizes precipitation retrieval from scanning swath to full-disc. Self-MaskTune achieves this by balancing multimodal knowledge and full-disc IR knowledge through guided parameter updates. This pipeline enables PRE-Net to effectively learn from multimodal data while addressing the constraints of narrow coverage and missing modalities, ultimately enhancing full-disc precipitation retrieval. Our contributions are as follows: (i) We introduce the Precipitation Retrieval Expansion task, aiming at high-quality IR-based full-disc precipitation retrievals, and provide a benchmark. (ii) We propose PRE-Net, featuring a multimodal knowledge expansion pipeline with two stages: Swath-Distilling and Full-Disc Adaptation, enabling effective multimodal knowledge transfer to overcome quality and coverage difference limitations. (iii) We introduce the CoMWE module to effectively encode richer knowledge and high-frequency components, and Self-MaskTune to adaptively balance knowledge distilled from multimodal data with new knowledge learned