WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos
Jongmin Park, Jeonghwan Yun, Minh-Quan Viet Bui, Munchurl Kim · 2026
Read WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos by Jongmin Park, Jeonghwan Yun, Minh-Quan Viet Bui, Munchurl Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02096.txt.
Introduction
Park and co-authors rebuild dynamic 3D scenes from single-camera videos. Monocular input gives limited multi-view cues for reconstruction. Past methods struggle to balance global shape and fine detail. Their WebSpline framework targets coherent, high-fidelity results. Fast rendering is part of the design goal.
Each dynamic Gaussian follows a learnable cubic Hermite spline. That is the structure-informed spline representation at the core. A structural proxy graph organizes the motion across Gaussians. Optimization proceeds in two stages for the system. The graph starts from 2D point tracks in the video. Temporal rigidity regularization refines it toward coherence. Moving objects keep structural consistency across the sequence. The method suits real-time dynamic scene rendering.
Catalog record
| CREATOR | Jongmin Park, Jeonghwan Yun, Minh-Quan Viet Bui, Munchurl Kim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02096
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos Jongmin Park, Jeonghwan Yun, Minh-Quan Viet Bui, Munchurl Kim Abstract Dynamic scene reconstruction from monocular videos remains highly challenging, as existing methods often struggle to balance global structural coherence and local fine-grained details under limited multi-view cues. To address this challenge, we propose WebSpline, a novel dynamic 3D Gaussian framework that enables structurally coherent and high-fidelity reconstruction from monocular videos with fast rendering. The core of WebSpline is the Structure-Informed Spline (SIS) representation, which models each dynamic Gaussian trajectory using a learnable cubic Hermite spline whose motion is structurally organized with an auxiliary Structural Proxy Graph (SPG). The proposed framework is optimized in two stages: (i) in the first stage, the SPG is initialized from 2D point tracks and refined with temporal rigidity regularization to establish structural coherence for moving objects across the sequence; and (ii) in the second stage, the SIS representation is initialized from the refined SPG and optimized under both spatial and structural neighborhood constraints. At inference, Gaussian motion is obtained solely by evaluating the learned SIS, enabling fast rendering. Extensive experiments on the challenging monocular dynamic scene benchmarks, iPhone and NVIDIA, demonstrate that our WebSpline achieves state-of-the-art rendering quality while rendering over 10 × \times faster than WorldTree, the second-best method on the iPhone dataset. Figure 1: WebSpline achieves high-quality dynamic scene reconstruction with fast rendering from monocular videos. (a) Qualitative comparison with state-of-the-art methods on novel view synthesis (top) and visualized Gaussian trajectories (bottom). (b) WebSpline achieves the best rendering quality while rendering over 10 \times faster than the second-best method. 1 Introduction Dynamic scene reconstruction from monocular videos is a fundamental task in 3D vision, with broad applications in virtual reality (VR), robotics, and autonomous driving. High-fidelity reconstruction in this setting requires modeling complex object deformations and time-varying geometry from limited observations while preserving spatio-temporal consistency. Recently, 3D Gaussian Splatting (3DGS) [ 15 ] has established a powerful paradigm for scene reconstruction by representing a scene with learnable 3D Gaussians and rendering them via differentiable splatting, which enables high-quality, real-time rendering. However, since 3DGS [ 15 , 16 , 17 , 52 , 51 ] is primarily designed for static scenes, extending it to monocular dynamic scene reconstruction remains highly challenging. To tackle these challenges, several recent methods [ 44 , 10 , 48 , 21 , 43 , 33 , 42 , 5 , 36 , 28 ] have extended 3DGS [ 15 ] to dynamic scene reconstruction for monocular videos by modeling the time-varying deformations of 3D Gaussians. Recent state-of-the-art (SOTA) methods can be categorized by their Gaussian motion modeling strategies: (i) scaffold-based methods [ 21 , 43 , 53 ] and (ii) primitive-motion-parameterized methods [ 33 , 42 ] . The scaffold-based methods [ 21 , 43 , 53 ] model Gaussian motions through scaffold structures, where the trajectory of each Gaussian is determined by blending the motions of neighboring scaffolds over time. While effective in preserving structural consistency, such blending often introduces over-smoothing artifacts, resulting in blurry renderings and degraded perceptual quality. In contrast, the primitive-motion-parameterized methods [ 33 , 42 ] model per-Gaussian motion using learnable trajectory parameters such as spline functions [ 33 ] or SE(3) motion coefficients [ 42 ] . These methods can produce sharper renderings, but the motion of each Gaussian is less constrained, often leading to geometric instability for moving objects. To address these limitations, we propose WebSpline, a novel dynamic Gaussian framework for structurally coherent and high-fidelity monocular dynamic scene reconstruction with fast rendering. At the core of WebSpline is a structurally organized spline representation that models each dynamic Gaussian with flexible per-primitive trajectories while leveraging an auxiliary graph structure during training. WebSpline consists of two components: (i) a Structural Proxy Graph (SPG) and (ii) a Structure-Informed Spline (SIS) representation, optimized through a two-stage framework. In the first stage, we construct the SPG initialized from 2D point tracks and optimize it to serve as a robust structural foundation. To achieve this, we introduce an orientation-similarity-based temporal rigidity loss to refine the SPG node trajectories for structural coherence across the sequence. In the second stage, guided by the optimized SPG, the SIS is introduced for parameterized representation of each dynamic Gaussian trajectory using a cubic Hermite spline [ 1 , 7 ] with learnable control points. Within SIS, each dynamic Gaussian is associated with a corresponding SPG node, aligning its spline trajectory with the structurally organized SPG node trajectory. During SIS optimization, we define two types of neighborhoods, spatial and structural, and impose temporal rigidity constraints over these neighborhoods. These rigidity constraints stabilize SIS learning by preserving both local geometric consistency and structural coherence over time, while retaining the flexibility needed to capture fine-grained non-rigid motion. At inference, the SPG is no longer required, and Gaussian motion is obtained solely by evaluating the learned SIS, enabling fast rendering. Notably, while SplineGS [ 33 ] also represents dynamic Gaussian motion with spline trajectories, WebSpline incorporates spatial and structural neighborhood constraints, thereby reducing noisy artifacts and promoting more reliable geometry. Extensive experiments show that WebSpline significantly outperforms the SOTA dynamic Gaussian methods, as shown in Table 1 and Figs. 1 , 3 , and 4 . WebSpline achieves PSNR gains of +0.36 dB and +0.61 dB over the second-best methods on the iPhone [ 9 ] and NVIDIA [ 49 ] datasets, respectively. Furthermore, WebSpline enables 10 \times faster rendering than WorldTree [ 43 ] , the second-best method on the iPhone dataset. Our contributions are as follows: • We propose WebSpline , a novel approach for dynamic 3D Gaussians that enables structurally coherent and high-fidelity reconstruction for monocular videos with fast rendering. • We introduce the Structure-Informed Spline (SIS) , which parameterizes fine-grained Gaussian trajectories under the structural organization of a Structural Proxy Graph (SPG) for structurally coherent dynamic motion modeling. • We present a two-stage optimization strategy that first constructs the SPG as a structural foundation and then learns the SIS representation for structurally coherent spline motion. • Our WebSpline achieves SOTA performance in all metrics on challenging monocular benchmarks, while rendering over \mathbf{10\times} faster than the second-best method on the iPhone dataset. 2 Related Work 3D Scene Reconstruction. The emergence of neural radiance fields (NeRF) [ 31 , 3 , 4 ] has significantly advanced 3D scene reconstruction and novel view synthesis. NeRF [ 31 , 3 , 4 ] represents continuous 3D scenes using an MLP-based implicit representation and renders them via volumetric rendering. This process requires dense ray sampling and repeated MLP evaluations along each ray, resulting in substantial computation overhead during both training and inference. Although numerous NeRF-based approaches [ 6 , 38 , 41 , 8 , 32 , 50 ] have been proposed to accelerate rendering, they often struggle to achieve a favorable balance between rendering fidelity and efficiency. Recently, 3D Gaussian Splatting (3DGS) [ 15 ] has emerged as an explicit scene representation based on anisotropic 3D Gaussians, together with a differentiable rasterization pipeline. This design enables real-time rendering while maintaining high-quality scene reconstruction. However, 3DGS [ 15 ] is primarily designed for static scene reconstruction and lacks a temporal modeling capability, which limits its applicability for