Learning to Refine: Spectral-Decoupled Iterative Refinement Framework for Precipitation Nowcasting
Yunlong Zhou, Chen Zhao, Danyang Peng, Fanfan Ji, Xiao-Tong Yuan · 2026
Read Learning to Refine: Spectral-Decoupled Iterative Refinement Framework for Precipitation Nowcasting by Yunlong Zhou, Chen Zhao, Danyang Peng, Fanfan Ji, Xiao-Tong Yuan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02661.txt.
Introduction
Zhou and co-authors refine rain forecasts by splitting them across frequency bands. Short-term rain forecasts guide flood and storm response. Regression models blur fine storm detail and break known turbulence power laws. Diffusion models invent sharp detail that lacks a physical anchor. The team's framework, SDIR, casts the task as step-wise refinement. A stable low-frequency skeleton comes first. Fine textures are then refined under physical constraints.
Two paths share the work. The Synoptic Frequency-Guided Former handles global structure with scale-adaptive transformers. The Fourier Residual Refiner handles fine residuals with Fourier neural operators. A loss on the power spectrum enforces spectra that match turbulence. A dynamic mask shapes that loss. Tests on three benchmarks beat top methods in spatial accuracy. Spectral fidelity rivals diffusion-based methods. Both blur and invented detail are cut. The aim is nowcasting that field users can trust.
Catalog record
| CREATOR | Yunlong Zhou, Chen Zhao, Danyang Peng, Fanfan Ji, Xiao-Tong Yuan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02661
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Refine: Spectral-Decoupled Iterative Refinement Framework for Precipitation Nowcasting Yunlong Zhou, Chen Zhao, Danyang Peng, Fanfan Ji, Xiao-Tong Yuan Abstract Accurate precipitation nowcasting is vital for disaster mitigation, but deep learning methods face a key trade-off: regression models produce over-smoothed, spectrally decaying predictions that blur convective details and violate turbulence power laws; diffusion models generate realistic yet unanchored hallucinations lacking physical grounding. We propose Spectral-Decoupled Iterative Refinement (SDIR), a deterministic framework that reformulates nowcasting as progressive frequency-decoupled refinement. SDIR first extracts a stable low-frequency synoptic skeleton, then iteratively refines high-frequency textures under physical constraints, eliminating both blurring and hallucinations. It features a dual-path design: the Synoptic Frequency-Guided Former (SFG-Former) with Scale-Adaptive Transformers for global structure, and the Fourier Residual Refiner (FR-Refiner) with Scale-Conditioned Fourier Neural Operators for fine residuals. A Physically Consistent Power Spectral Density (PCPSD) loss with dynamic masking enforces a turbulence-consistent spectral distribution. Experiments on three benchmarks show SDIR significantly outperforms SOTA methods in spatial accuracy while achieving spectral fidelity competitive with diffusion-based methods, enabling reliable high-resolution operational nowcasting. Code link: https://github.com/RuntimeWarning/SDIR. Figure 1 : Paradigm comparison in precipitation nowcasting. (a) Regression: Suffers from spectral decay and loss of peak intensity, falling significantly below the ground truth (GT) in the PSD plot. (b) Diffusion: Generates realistic high-frequency details but lacks physical grounding, resulting in stochastic hallucinations inconsistent with the GT. (c) SDIR (Ours): Reformulates nowcasting as deterministic spectral evolution, progressively restoring high-frequency details from a low-frequency synoptic skeleton. 1 Introduction Precise precipitation nowcasting, predicting high-resolution rainfall intensity within a short-term horizon (0–2 hours), is a cornerstone of modern meteorological services ( 27 ) . Its accuracy is paramount for urban flood management, aviation safety, and disaster mitigation ( 24 ) . However, as climate volatility intensifies, the demand for forecasts that are both physically consistent and spatially fine-grained has reached an unprecedented level ( 23 ) . Early radar-based extrapolation methods, such as optical flow ( 1 ) , effectively capture short-term motion but struggle with non-linear convective growth and decay. The recent paradigm shift toward deep learning has significantly advanced the field ( 22 ) . Initial spatiotemporal models based on CNNs and RNNs, particularly ConvLSTM ( 27 ) , greatly improved feature extraction by integrating convolutional operations into recurrent structures. More recently, generative frameworks—including Generative Adversarial Networks (GANs) ( 8 ) and diffusion models—have pushed boundaries further, generating high-fidelity precipitation fields that maintain structural clarity over extended lead times ( 11 ; 26 ; 39 ) . Despite these advancements, a fundamental trade-off persists, as illustrated in Figure 1 . Traditional spatial-domain regression models ( Figure 1 (a)) suffer from a well-known over-smoothing effect ( 20 ; 45 ) . Driven by pixel-wise objectives like MSE, these models minimize loss by averaging potential outcomes under spatial uncertainty, inevitably eroding sharp convective details into blurred patterns. This regression-to-the-mean behavior not only suppresses peak rainfall intensities but also disrupts the natural energy cascade across spatial scales, resulting in physically inconsistent forecasts that deviate from turbulence power laws ( 15 ; 29 ) . In contrast, diffusion models ( Figure 1 (b)) ( 5 ) attempt to recover these details via stochastic sampling from noise, producing visually realistic convective cells. However, this stochasticity often leads to “unanchored hallucinations”—generating structures that appear plausible but lack grounding in the input data’s physical context, such as misplaced rain cells or exaggerated intensities. This trade-off highlights why nowcasting requires a refinement-based approach: precipitation evolution is inherently multi-scale and progressive, starting with stable large-scale motions that serve as boundary conditions for smaller-scale details ( 12 ) . A single-pass model struggles to balance global stability with local sharpness without either blurring (regression) or hallucinating (stochastic generation). To address this, we need a deterministic framework that decouples the prediction into frequency bands, iteratively refining from coarse low-frequency skeletons to fine high-frequency textures ( 40 ; 43 ) . This ensures physical anchoring at every stage, mitigating hallucinations while countering over-smoothing by explicitly supervising spectral fidelity. We propose the Spectral-Decoupled Iterative Refinement (SDIR) framework, which reformulates precipitation nowcasting as a physically grounded, coarse-to-fine spectral refinement process, as shown in Figure 1 (c). Unlike diffusion models that begin from stochastic noise and risk physically inconsistent predictions, SDIR deterministically extracts a stable low-frequency skeleton from the historical sequence, which serves as a reliable anchor for subsequent refinements. It then uses this skeleton along with historical data as dual conditions to progressively unlock high-frequency textural details through multi-step, frequency-guided inference. The frequency decoupling is crucial because it mirrors atmospheric physics: low frequencies capture global synoptic patterns (e.g., storm fronts) that must be stabilized first to constrain high-frequency local textures (e.g., convective cells), ensuring the entire spectrum adheres to turbulence laws. This is realized via a two-stage hybrid architecture: the Synoptic Frequency-Guided Former (SFG-Former) employs Scale-Adaptive Transformers to capture long-range spatiotemporal dependencies and produce a sharp, physically consistent low-frequency skeleton as a robust foundation. The Fourier Residual Refiner (FR-Refiner) leverages Scale-Conditioned Fourier Neural Operators (SFNO) to synthesize high-frequency residual textures, compensating for spectral decay in a fully deterministic manner. To enforce physical consistency, we introduce a Physically Consistent Power Spectral Density (PCPSD) loss with dynamic masking, which ensures adherence to atmospheric turbulence power laws throughout the refinement process. By bridging the gap between stochastic generative detail and deterministic reliability, SDIR transforms nowcasting into a robust, physically plausible refinement process. The core contributions of this work are outlined below. • We propose the SDIR framework, which reformulates precipitation nowcasting as a multi-stage deterministic spectral evolution process, effectively bridging the trade-off between generative realism and structural reliability by iteratively refining from anchored low-frequency skeletons to high-frequency details. • We introduce a hybrid dual-path architecture that synergizes the global structural modeling of the SFG-Former with the local high-frequency synthesis of the FR-Refiner, achieving seamless integration of long-range meteorological dependencies and spectral fidelity. • We present a PCPSD loss equipped with a dynamic masking mechanism that enforces adherence to atmospheric turbulence power laws by aligning the model’s energy distribution with the ground truth spectrum. • Extensive experiments on three public benchmarks demonstrate that SDIR effectively mitigates blurring in longer-lead-time forecasts, outperforming state-of-the-art (SOTA) methods in spatial accuracy while achieving competitive or superior spectral realism. Figure 2 : The overall architecture and operational paradigm of SDIR. (a) Architecture Overview: SDIR couples the SFG-Former for synoptic skeleton extraction with the FR-Refiner for spectral detail synthesis. The model is optimized using a combination of reconstruction and PCPSD losses. (b) Scale-Adaptive Transformer. (c) Fourier Residual Refiner. (d) Frequency-Unlocking Inference: During inference, SDIR starts from a zero state ( s=0 ) and performs iterative steps with increasing s , updating the low-frequency condition C_{s} to progressively synthesize high-resolution details. 2 Related Work 2.1 Regression-based Models The field of precipitation nowcasting was significantly advanced by ConvLSTM ( 27 ) , which integrated convolutions into recurrent neural networks to capture spatiotemporal correlations. Subsequent works, such as TrajGRU ( 28 ) , PredRNN ( 35 ) , PredRNN++ ( 34 ) , and MIM ( 37 ) , improved modeling of non-linear motion and non-stationary dynamics through trajectory offsets, memory flows, and differential units. Physics-informed approaches like PhyDNet ( 9 ) introduced deep disentanglement to separate dynamics from residuals. With the