SeasonScapes: Learning Large-scale Re-lightable 3D Landscapes with Seasonal Variation from Sparse Webcams
Timo Kleger, Deheng Zhang, Luc Van Gool, Danda Pani Paudel · 2026
Read SeasonScapes: Learning Large-scale Re-lightable 3D Landscapes with Seasonal Variation from Sparse Webcams by Timo Kleger, Deheng Zhang, Luc Van Gool, Danda Pani Paudel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09039.txt.
Introduction
Timo Kleger and four co-authors build SeasonScapes, a way to make large 3D landscapes that change with the seasons and can be lit anew. Their data comes from webcams in the Swiss mountains: more than eighty-five thousand images from thirty-two spots, taken at thirteen times across a full year.
The team projects the webcam images onto a 3D mesh of the terrain, which spans over fifty by sixty kilometers. Gaps from blocked views and missing data are filled with a diffusion model that paints directly on the mesh. The finished seasonal landscapes can then be rendered again under new lighting with standard tools, giving researchers a rare record of how a whole region changes through the year.
Catalog record
| CREATOR | Timo Kleger, Deheng Zhang, Luc Van Gool, Danda Pani Paudel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09039
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SeasonScapes: Learning Large-scale Re-lightable 3D Landscapes with Seasonal Variation from Sparse Webcams Timo Kleger, Deheng Zhang, Luc Van Gool, Danda Pani Paudel Abstract Large-scale scene creation from sparse views in the wild remains an open and significant problem in computer vision due to challenges such as camera calibration errors, limited scene coverage, and high scene complexity, including lighting and appearance variations. To address this, we introduce a digital twin of the Swiss alpine landscape, capturing temporal variations across seasons and times of day using our newly proposed SeasonScapes dataset for sparse-view mountain scenes with seasonal changes. We associate sparsely distributed webcams across 3000 km 2 \text{km}^{2} of the Bernese Highlands with a low-resolution satellite image and elevation map via 2D–3D correspondence optimization. To overcome limited scene coverage, we propose a 3D mesh painting method that inpaints novel views using priors from the ControlNet pipeline. Unlike prior works that focus on centered, bounded objects, our approach handles large-scale, unbounded scenes by introducing linear or cubic spline inpainting trajectories between GPS coordinates and performing occlusion-aware painting via UV indexing through depth rendering – rather than relying solely on normal-based filtering. By running the pipeline across varying times of day and seasons, we create a dataset with rich appearance and lighting diversity. Using this data, we train a relightable Gaussian Splat model with appearance Multi-Layer Perceptron. Figure 1 : We introduce SeasonScapes framework and a the SeasonScapes dataset: Swiss Sparse-view Mountain Scenes with Seasonal Changes that covers over 50 km \times 60 km, composed of more than 85,000 webcam images captured from 32 different locations across 13 timestamps throughout a full year. By projecting these timestamp-specific images onto a 3D mesh, we construct seasonal 3D landscapes that reflect natural appearance changes over time. To address occlusions and missing data, we leverage conditional diffusion models for image-guided inpainting directly on the mesh. The resulting completed meshes can be further relighted using standard physically-based renderer. 1 Introduction Large-scale 3D landscape reconstruction holds substantial importance for real-world applications such as environmental monitoring, weather modeling, virtual tourism, infrastructure planning and disaster response. However, this is a challenging task in computer vision and graphics due to the high variance of the weather, season, and illumination. Beyond traditional mesh-based systems like Google Earth that rely on static geometry and blended satellite texture maps, our work focuses on achieving photometrically consistent 3D representations capable of modeling diverse illumination conditions and view-dependent appearance variations. We leverage known 3D geometry and sparse webcam imagery to reconstruct up-to-date scene states with high visual fidelity. Existing large-scale 3D datasets primarily target on static urban environments 27 ; 46 ; 12 , with limited coverage of natural landscapes. These dataset have siginificantly advanced task like large-scale reconstruction in terms of efficiency, hierarchical scene representation 46 ; 30 ; 23 and task like scene understanding and localization 31 ; 10 . To address this gap, we introduce the SeasonScapes dataset for sparse-view mountain scenes with seasonal and intraday illumination change, covering 3,000 \text{km}^{2} of alpine Swiss terrain across 12 months to capture seasonal variations and complete diurnal cycles from dawn to dusk. This spatially and temporally comprehensive dataset enables modeling of both long-term environmental transitions and short-term illumination changes in natural mountain landscapes. We expand upon NeRF-W’s temporal modeling dataset 32 in scope and capability by offering: (1) large-scale natural landscapes rather than isolated urban landmarks; (2) precise timestamp annotations for all webcam observations; (3) calibrated 2D-3D correspondences between ground-level imagery and georeferenced satellite data. Although prior works 25 ; 40 ; 32 tackle 3D reconstruction in unconstrained environments, they do not target large-scale landscape reconstruction from sparsely distributed camera views. We introduce SeasonScapes, a novel framework for reconstructing large-scale, relightable 3D landscapes that capture both seasonal and diurnal variations. Building upon our multimodal dataset, SeasonScapes integrates: macro-scale environmental structures (terrain topography, hydrographic boundaries, and urban infrastructure) with micro-scale dynamic observations (temporal illumination changes, biological activity patterns, and subsurface features). This approach advances beyond satellite-only reconstruction methods 9 ; 53 , enabling comprehensive spatiotemporal scene understanding across multiple scales. Our framework generates temporally consistent 3D landscapes with photorealistic lighting—spanning day/night cycles and seasonal variations from summer to winter—using arbitrary unconstrained webcam inputs. The pipeline begins by texturing the base mesh through projective blending of available 2D observations, then completes missing regions with depth-conditioned diffusion models that leverage optimized inpainting trajectories to preserve spatial consistency. Finally, we train a relightable Gaussian model that employs a multi-layer perceptron to capture dynamic scene properties. Through comprehensive experiments across three diverse test scenes, we demonstrate our method’s ability to render realistic environments while accurately modeling scene dynamics across varying lighting and seasonal conditions. Our contributions can be summarized as: \bullet We present SeasonScapes dataset, a high-quality large-scale multimodal dynamic dataset with seasonal and diurnal variations, covering 3,000 \text{km}^{2} of alpine terrain. \bullet We propose SeasonScapes framework for relightable 3D landscape creation that leverages diffusion priors to inpaint unseen regions with high fidelity. \bullet We incorporate dynamic embeddings into relightable gaussian training, enabling effective modeling of temporal changes in large-scale outdoor scenes. The source code, configurations, rendered examples and where to download the SeasonScapes dataset are available at: https://github.com/ChlaegerIO/SeasonScapes. 2 Related Work Large-scale Landscape dataset. Early work 37 ; 12 ; 42 ; 6 introduced paired 2D-3D semantic data for scene understanding, but primarily focused on urban and vehicular environments. The RUGD dataset 50 centers on off-road semantic segmentation, subsequent works 16 ; 47 extend this to 3D scene understanding. However, these datasets remain limited in scale, covering less than 20 km of trajectory data. 4 also introduced dataset featuring alpine region elevation models, demonstrating robust cross-domain camera pose estimation through learned descriptor matching. 47 benchmark the 2D and 3D semantic segmentation. Most closely related to our work is 4 which introduced a dataset featuring alpine region elevation models and demonstrated robust cross-domain camera pose estimation through learned descriptor matching. Sparse-view mesh colorization. Traditional methods for synthesizing textures on 3D assets typically relied on placing hand-crafted patterns or performing global optimization 15 ; 24 ; 45 . More recently, learning-based approaches have demonstrated strong performance in generating plausible textures for complex 3D shapes 8 ; 20 ; 39 ; 44 . One notable method, TEXTure 41 , iteratively applies a pretrained depth-to-image diffusion model to paint the texture map from multiple viewpoints, conditioning each step on previous results. While effective, this approach lacks global context and often produces view-inconsistent textures. TexFusion 5 addresses this limitation by aggregating texture information across multiple views during the denoising process, thereby improving view consistency. Text2Tex 7 further automates viewpoint selection, reducing manual intervention. Despite these advancements, existing methods still suffer from lighting bias introduced by 2D priors, leading to inconsistent textures under varying illumination. To mitigate this, Paint3D 57 introduces a refinement model trained on illumination-free texture data, significantly reducing lighting artifacts and improving overall consistency. We adapt these diffusion-based texture inpainting techniques to the challenging setting of large-scale landscape reconstruction, achieving photorealistic and view-consistent rendering across varying illumination and viewpoints. 3D Scene editing and relighting. Recent advancements in novel view synthesis 34 ; 2 ; 22 ; 56 have primarily concentrated on static environment reconstruction. Subsequent works 26 ; 19 ; 48 ; 58