DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Rendering
Jie Chen, Zhangchi Hu, Peixi Wu, Huyue Zhu, Hebei Li, Xiaoyan Sun · 2025
Read DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Rendering by Jie Chen, Zhangchi Hu, Peixi Wu, Huyue Zhu, Hebei Li, Xiaoyan Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19141.txt.
Introduction
Rebuilding a moving 3D scene in real time strains even strong graphics methods. Jie Chen and co-authors present DASH, a renderer for dynamic scenes, in a 2025 paper. Their method stores the scene in a four-dimensional hash grid, which sidesteps a weak flat-rank guess used by rivals.
A self-taught split first parts moving bits from still ones, with no labels needed. Only the moving bits go into the hash grid, which cuts clashes and waste. A smoothing rule calms jitter in the motion. On real data sets, the method hit top quality at 264 frames per second on one card. Fast, clean renders suit games and live capture.
Catalog record
| CREATOR | Jie Chen, Zhangchi Hu, Peixi Wu, Huyue Zhu, Hebei Li, Xiaoyan Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19141
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Rendering Jie Chen, Zhangchi Hu, Peixi Wu, Huyue Zhu, Hebei Li, Xiaoyan Sun Abstract Dynamic scene reconstruction is a long-term challenge in 3D vision. Existing plane-based methods in dynamic Gaussian splatting suffer from an unsuitable low-rank assumption, causing feature overlap and poor rendering quality. Although 4D hash encoding provides an explicit representation without low-rank constraints, directly applying it to the entire dynamic scene leads to substantial hash collisions and redundancy. To address these challenges, we present DASH, a real-time dynamic scene rendering framework that employs 4D hash encoding coupled with self-supervised decomposition. Our approach begins with a self-supervised decomposition mechanism that separates dynamic and static components without manual annotations or precomputed masks. Next, we introduce a multiresolution 4D hash encoder for dynamic elements, providing an explicit representation that avoids the low-rank assumption. Finally, we present a spatio-temporal smoothness regularization strategy to mitigate unstable deformation artifacts. Experiments on real-world datasets demonstrate that DASH achieves state-of-the-art dynamic rendering performance, exhibiting enhanced visual quality at real-time speeds of 264 FPS on a single 4090 GPU. Code: https://github.com/chenj02/DASH . Figure 1 : Our method achieves real-time rendering for dynamic scenes with high rendering quality. In real-world datasets with intricate details, our method outperforms 4DGaussian [ 41 ] , and Grid4D [ 13 ] in terms of rendering quality and time performance. The right figure is tested on Neural 3D Video [ 15 ] dataset, where the radius of the dot corresponds to the training time and and the horizontal axis is plotted on a logarithmic scale. † † † Corresponding authors 1 Introduction Novel view synthesis (NVS) is a critical 3D vision task, supporting VR, AR, and film production. It generates photorealistic scene renderings from arbitrary viewpoints/timestamps via 3D reconstruction from 2D images. While static scene modeling has high fidelity, dynamic reconstruction remains challenging due to complex nonlinear deformations and limited dense multi-view temporal data. Traditional methods for dynamic scene reconstruction typically employed Neural Radiance Fields (NeRF) [ 24 ] combined with deformation fields. However, MLP-based deformation networks [ 28 , 37 , 47 , 10 , 17 , 26 , 52 , 46 , 15 , 7 , 1 ] often suffer from slow convergence and rendering artifacts. Structured explicit representations, including plane-based [ 5 ] and hash-grid [ 25 ] methods, better preserves local geometry and accelerates training [ 31 , 9 , 4 , 44 , 8 , 38 , 11 , 33 , 34 ] . Recently, 3D Gaussian Splatting (3DGS) [ 14 ] has advanced static scene rendering through real-time Gaussian representations. This method has been extended to dynamic scenes by incorporating timestamp-conditioned deformation fields [ 41 , 48 , 21 , 54 , 18 , 13 , 2 , 35 ] . In dynamic novel view synthesis, both implicit and explicit neural networks have been employed to deform Gaussians. However, implicit MLP networks tend to over-smooth details, while explicit representations face other challenges. For example, plane-based methods such as 4DGaussian [ 41 ] decompose the 4D spatiotemporal encoding into six 2D planes. This approach relies on a low-rank assumption that deformation features share significant commonality and can be factorized into a compact representation [ 31 , 9 , 4 , 41 , 13 ] . However, this assumption is unsuitable, often resulting in feature overlap and reduced accuracy of deformation predictions, as shown in Fig. 2 . Although the grid-based method Grid4D [ 13 ] avoids the low-rank assumption by decomposing the 4D encoding into four 3D hash encodings, it still suffers from feature overlap that limits its performance. Instead of decomposing the 4D spatiotemporal features, 4D hash encoding provides a promising explicit representation without low-rank assumption, and eliminates the overlap in the features. However, directly applying a 4D hash encoding to a dynamic scene would require a larger hash table size due to the more hash collisions caused by the additional time dimension [ 38 ] . To address these problems, we propose DASH, a real-time dynamic scene rendering framework that employs 4D hash encoding coupled with self-supervised decomposition. Our key observation is that most scenes contain large static regions, which do not need to be stored in the 4D hash table. Based on this, we introduce a self-supervised dynamic-static decomposition method. This method leverages the inherent behavioral difference between static and dynamic elements during optimization, without requiring manual annotations or precomputed masks. Subsequently, static regions are reconstructed using standard Gaussian splatting [ 14 ] , while the deformation fields of dynamic regions are modeled using our novel 4D hash encoder without relying on the low-rank assumption. Finally, to resolve the inherent lack of smoothness in explicit representations [ 13 ] , we propose a spatio-temporal smoothness regularization that reduces unstable deformation artifacts and improves overall rendering fidelity. Experimental results demonstrate that DASH significantly outperforms other methods in both visual quality and rendering speed. In summary, our main contributions are as follows: • We introduce a novel self-supervised method to decompose dynamic scenes into static and dynamic components without manual annotations or precomputed masks. • We propose a novel explicit representation for dynamic scene rendering that leverages 4D hash encoding without relying on the low-rank assumption, and we apply a smooth regularization that effectively suppresses erratic deformation predictions. • Experiments show that DASH achieves state-of-the-art performance, with real-time rendering up to 264 FPS at a resolution of 1352\times 1014 . Figure 2 : Comparison of feature encoding. Compared to the plane-based method [ 41 ] and grid-based method [ 13 ] which concatenate low-rank features into 4D features, our method eliminates the overlap in the features when encoding points like A and B with heavily overlapping coordinates. 2 Related Works 2.1 NeRF-Based Dynamic Scene Rendering Novel view synthesis is a fundamental yet challenging task in 3D reconstruction. NeRF [ 24 ] pioneered implicit static scene representation using MLPs, and subsequent works [ 28 , 37 , 47 , 10 , 17 , 26 , 52 , 46 , 15 , 7 , 16 , 3 , 36 , 20 , 43 , 19 , 6 , 51 ] extended it to dynamic scenes by incorporating canonical 3D grids and deformation fields. D-NeRF [ 28 ] introduces implicit deformation fields on static models, providing an effective framework for dynamic scene rendering. HyperNeRF [ 26 ] models object topology deformations using higher-dimensional representations, while DyNeRF [ 15 ] leverages time-conditioned NeRF for 4D scene modeling. However, MLP-based implicit representations suffer from inherent over-smoothing and high computational costs due to dense ray sampling and volume rendering. To address these limitations, explicit representations such as triplanes [ 5 ] and hash encoding [ 25 ] improve NeRF by enhancing visual quality and training efficiency. Several plane-based explicit representations, including K-Planes [ 9 ] , HexPlane [ 4 ] , Tensor4D [ 31 ] , and 4K4D [ 44 ] , decompose 4D inputs into six 2D feature planes to facilitate dynamic scene rendering. Additionally, hash encoding and 3D grid-based explicit representations assist MLPs in predicting deformations with improved speed and accuracy [ 8 , 38 , 11 , 39 , 34 ] . Despite these advancements, existing NeRF-based methods still