SwiftGS: Episodic Priors for Immediate Satellite Surface Recovery

Rong Fu, Jiekai Wu, Haiyun Wei, Xiaowen Ma, Shiyin Lin, Kangan Qian, Chuang Liu, Jianyuan Ni, Simon James Fong · 2026

Read SwiftGS: Episodic Priors for Immediate Satellite Surface Recovery by Rong Fu, Jiekai Wu, Haiyun Wei, Xiaowen Ma, Shiyin Lin, Kangan Qian, Chuang Liu, Jianyuan Ni, Simon James Fong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18634.txt.

Introduction

Fu and co-authors introduce SwiftGS for fast 3D surface recovery from satellite images. Multi-date imagery brings shifting light, mixed sensors, and costly per-scene fitting. SwiftGS predicts Gaussian primitives plus a light signed distance field in one forward pass. Episodic training teaches it priors that transfer across scenes. A physics graph models projection, lighting, and sensor response during rendering. Spatial gating blends sparse Gaussian detail with global structure. Zero-shot tests give accurate elevation maps and steady views at far lower compute cost.

Catalog record

CREATORRong Fu, Jiekai Wu, Haiyun Wei, Xiaowen Ma, Shiyin Lin, Kangan Qian, Chuang Liu, Jianyuan Ni, Simon James Fong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70345
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SwiftGS: Episodic Priors for Immediate Satellite Surface Recovery Rong Fu, Jiekai Wu, Haiyun Wei, Xiaowen Ma, Shiyin Lin, Kangan Qian, Chuang Liu, Jianyuan Ni, Simon James Fong Abstract Rapid, large-scale 3D reconstruction from multi-date satellite imagery is vital for environmental monitoring, urban planning, and disaster response, yet remains difficult due to illumination changes, sensor heterogeneity, and the cost of per-scene optimization. We introduce SwiftGS , a meta-learned system that reconstructs 3D surfaces in a single forward pass by predicting geometry–radiation-decoupled Gaussian primitives together with a lightweight SDF, replacing expensive per-scene fitting with episodic training that captures transferable priors. The model couples a differentiable physics graph for projection, illumination, and sensor response with spatial gating that blends sparse Gaussian detail and global SDF structure, and incorporates semantic–geometric fusion, conditional lightweight task heads, and multi-view supervision from a frozen geometric teacher under an uncertainty-aware multi-task loss. At inference, SwiftGS operates zero-shot with optional compact calibration and achieves accurate DSM reconstruction and view-consistent rendering at significantly reduced computational cost, with ablations highlighting the benefits of the hybrid representation, physics-aware rendering, and episodic meta-training. Keywords Gaussian splatting, Hybrid representation, Meta-learning, Zero-shot 3D reconstruction, Shadow-aware 1 Introduction High-resolution satellite imagery underpins applications in environmental monitoring, urban planning, and large-scale mapping. Recovering consistent three-dimensional geometry and photometric properties from multi-temporal collections remains challenging, as assumptions in traditional stereo and multi-view stereo pipelines often break under heterogeneous, multi-date archives with varying sensor geometries, illumination, and surface reflectance [ 56 , 46 ] . Neural rendering approaches, including NeRF variants, provide high-fidelity view synthesis and geometry but typically require costly per-scene optimization, limiting scalability across large repositories [ 53 , 48 ] . Explicit primitive-based methods such as 3D Gaussian splatting offer fast training and rendering [ 14 ] , yet many Earth-observation systems still depend on per-scene fitting, dense coverage, or precise RPC metadata to reach state-of-the-art DSM accuracy, which hinders zero-shot deployment to new regions, sensors, or sparse inputs. Satellite-specific difficulties, including strong view-dependent shadows, radiometric mismatches across dates, transient objects, and occasional RPC errors, further complicate reconstruction [ 56 , 55 , 4 ] . Addressing these challenges requires representations and training protocols that encode robust, transferable priors while supporting compact, physically interpretable local adaptations. Meta-learning and episodic training provide a principled path to transfer by optimizing across diverse scene distributions so that models acquire priors that generalize to novel episodes and obviate per-scene optimization at inference [ 38 , 23 ] . For satellite imagery, effective meta-trained systems require a representation that preserves fine local geometry and globally coherent topology by balancing Gaussian primitives, which capture high-frequency and view-dependent structure but lack explicit topological constraints, with implicit signed-distance fields, which ensure watertight continuity yet may over-smooth sharp discontinuities. The model should also include a physically grounded image formation component that accounts for projection geometry, illumination, atmospheric attenuation, and sensor-specific radiometry while remaining robust to noisy or incomplete RPC metadata. The predictor and training protocol should deliver immediate and accurate zero-shot predictions and support compact, physically interpretable per-scene calibration to accommodate domain shift. Our contributions are as follows. Firstly , we propose a hybrid scene representation that combines geometry and radiance decoupled Gaussian primitives with a compact implicit signed-distance field via learned spatial gating, where Gaussians model high-frequency geometry and view-dependent appearance through separate covariance parameterizations and the SDF preserves global continuity and topology while enabling explicit handling of shadows and illumination; in parallel, a differentiable physics-based rendering graph integrates projection models, atmospheric effects, and sensor response to support shadow-aware synthesis and robust behavior under RPC uncertainty. Secondly , we design a predictor with bidirectional semantic and geometric fusion and dynamic expert routing so that computation adapts to scene content, and we train it with an episodic meta-learning protocol augmented by auxiliary multi-view stereo guidance to achieve strong zero-shot generalization without per-scene optimization. Finally , we enable efficient scene-specific refinement through a compact low-dimensional calibration vector and demonstrate state-of-the-art zero-shot DSM accuracy at substantially reduced inference cost, with ablations confirming the central roles of the hybrid representation, physics-aware rendering, and meta-training, and with extensions to continual learning via incremental Gaussian memory and information-theoretic active view selection for scalable operation on streaming data. 2 Related Work 2.1 Neural rendering for satellite photogrammetry Satellite imagery presents unique reconstruction challenges distinct from conventional photography, including RPC camera models, extreme illumination variations, and multi-temporal radiometric inconsistencies. Early neural radiance field adaptations for Earth observation focused on incorporating rational polynomial camera geometries and handling transient objects [ 33 , 34 , 36 ] . Subsequent developments addressed shadow modeling and lighting decomposition for accurate elevation recovery in shaded regions [ 15 , 4 ] . Recent Gaussian splatting pipelines have demonstrated improved efficiency for satellite applications, though most retain per-scene optimization requirements [ 1 , 3 , 28 , 39 ] . SAT-NGP introduced fast relightable reconstruction using neural graphics primitives [ 6 ] , while tile-based frameworks enable scaling to global coverage [ 5 ] . These methods establish foundations for our zero-shot generalization objective, yet they fundamentally rely on scene-specific fitting or dense view coverage. SwiftGS advances beyond these limitations through meta-learned priors that eliminate per-scene optimization. 2.2 Geometric calibration and physical illumination modeling Accurate satellite reconstruction demands explicit handling of RPC metadata uncertainties and physically-grounded illumination representation. Practical RPC evaluation strategies employ cached-basis decompositions and low-rank approximations to manage computational complexity [ 21 , 51 , 30 ] . Self-calibration techniques address geometric inaccuracies through learned correction modules [ 54 ] . Shadow detection benchmarks emphasize geometry-aware supervision for robust performance across diverse solar conditions [ 35 , 16 ] . Transient object robustness and appearance stabilization rely on uncertainty-weighted losses and consistency regularization [ 13 , 20 ] . Our differentiable physics graph extends these principles through fully differentiable projection, atmospheric attenuation, and sensor response modeling, enabling end-to-end optimization while maintaining interpretability. 2.3 Meta-learning and transferable priors for reconstruction Episodic training paradigms offer principled mechanisms for encoding generalizable knowledge across scene distributions. Remote sensing applications demonstrate fast adaptation for hyperspectral classification and band selection through cross-domain meta-learning [ 26 , 18 , 31 , 27 ] . Vision research establishes that episodic optimization produces priors generalizing across unseen scenes [ 42 , 54 , 43 , 12 ] . Recent meta-learned radiance and splatting models specifically target out-of-distribution robustness with lightweight fine-tuning capabilities [ 24 , 32 ] . SwiftGS distinguishes itself through hybrid primitive prediction combining Gaussian splatting with implicit surfaces, coupled with extremely compact calibration vectors that preserve zero-shot inference efficiency. 2.4 Geometric supervision and scalable system design Multi-view stereo provides complementary geometric guidance for radiance-based reconstruction. Sparse-to-dense MVS networks improve height estimation under limited baselines through adaptive multi-scale processing [ 52 , 45 , 51 , 30 ] . Coarse-to-fine cost volumes with importance sampling reduce memory footprints while preserving accuracy [ 49 , 47 ] . Large-area deployment necessitates tiling strategies, distributed processing, and adaptive density control [ 10 , 47 , 41 ] . Conservative growth mechanisms and streaming architectures support real-time applications [ 19 , 25 , 22 ] . Our framework integrates an auxiliary MVS teacher for training-time geometric priors while maintaining single-pass inference efficiency, alongside incremental memory management

Read the complete text