3DOF+Quantization: 3DGS quantization for large scenes with limited Degrees of Freedom
Matthieu GENDRIN · 2025
Read 3DOF+Quantization: 3DGS quantization for large scenes with limited Degrees of Freedom by Matthieu GENDRIN (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06400.txt.
Introduction
Compressing a three-dimensional scene for viewers who barely move needs its own quantization, argue Matthieu Gendrin and two co-authors in a 2025 paper. 3D Gaussian Splatting rebuilds scenes from photos for free viewpoint movement, but on large scenes the input photos come from a small zone, and useful new views stay near it. The authors call that regime 3DoF+, limited positions with free orientation.
For coordinate quantization they show projection error scales with the squared inverse distance of a point. A spherical-coordinate quantization scheme follows from that law. Rate-distortion tests on the well-known Garden scene illustrate the gains, and the method targets streaming large reconstructions to constrained viewers.
Catalog record
| CREATOR | Matthieu GENDRIN |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06400
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
3DOF+Quantization: 3DGS quantization for large scenes with limited Degrees of Freedom Matthieu GENDRIN Abstract 3DGS [ Kerbl et al., 2023 ] is a major breakthrough in 3D scene reconstruction. With a number of views of a given object or scene, the algorithm trains a model composed of 3D gaussians, which enables the production of novel views from arbitrary points of view. This freedom of movement is referred to as 6DoF for 6 degrees of freedom: a view is produced for any position (3 degrees), orientation of camera (3 other degrees). On large scenes, though, the input views are acquired from a limited zone in space, and the reconstruction is valuable for novel views from the same zone, even if the scene itself is almost unlimited in size. We refer to this particular case as 3DoF+, meaning that the 3 degrees of freedom of camera position are limited to small offsets around the central position. Considering the problem of coordinate quantization, the impact of position error on the projection error in pixels is studied. It is shown that the projection error is proportional to the squared inverse distance of the point being projected. Consequently, a new quantization scheme based on spherical coordinates is proposed. Rate-distortion performance of the proposed method are illustrated on the well-known Garden scene. 1 Introduction 3DGS [ Kerbl et al., 2023 ] has opened new possibilities in terms of novel view synthesis of 3D scenes. The quality and training performance are such that a major part of the 3D research community has switched to this model. With this success comes the need to compress such models, which is achieved in several ways in the literature. Papantonakis et al. [ Papantonakis et al., 2024 ] proposes to optimize the number of gaussians and the color coefficients, and to use a codebook-based quantization method. Scaffold-GS ( [ Lu et al., 2024 ] ) introduces a structured description of the model to obtain additional compression performance. HAC ( [ Chen et al., 2024 ] ) builds upon Scaffold-GS adding entropy minimization for further rate savings. These previous work provides compelling rate-distortion, without any hypothesis on the degrees of freedom of the camera. As a complement, this paper analyses how the 3DoF+ hypothesis can be leveraged to perform a more accurate bit allocation to the spatial coordinates, giving more precision to the gaussians near the cameras, to the expense of gaussians located further away. Note that this work is complementary to the existing methods. 2 Preliminaries 3D Gaussian Splatting (3DGS) [ Kerbl et al., 2023 ] models a 3D scene with 3D gaussians, and renders viewpoints through a differentiable splatting and tile-based rasterization. Each Gaussian is defined by a 3D covariance matrix \bm{\Sigma}\in\mathbb{R}^{3\times 3} and location (mean) \bm{\mu}\in\mathbb{R}^{3} , where \mathbf{x}\in\mathbb{R}^{3} is a random 3D point, and \bm{\Sigma} is defined by a diagonal matrix \mathbf{S}\in\mathbb{R}^{3\times 3} representing scaling and rotation matrix \bm{R_{g}}\in\mathbb{R}^{3\times 3} to guarantee its positive semi-definite characteristics, such that \bm{\Sigma}=\bm{R_{g}}\bm{S}\bm{S}^{\top}\bm{R_{g}}^{\top} . \displaystyle G(\mathbf{x})=exp(-\frac{1}{2}(\mathbf{x}-\bm{\mu})^{\top}\bm{\Sigma}^{-1}(\mathbf{x}-\bm{\mu})) (1) To render an image from a random viewpoint, 3D Gaussians are first splatted to 2D, and render the pixel value \mathbf{C}\in\mathbb{R}^{3} using \alpha -composed blending, where \alpha\in\mathbb{R} measures the contribution to this pixel of each Gaussian after 2D projection, \mathbf{c}\in\mathbb{R}^{3} is view-dependent color modeled by Spherical Harmonic (SH) coefficients, and N is the number of sorted Gaussians contributing to the rendering. The 3DGS rendering is illustrated in figure 1 . \displaystyle\mathbf{C}=\sum_{n\in N}c_{n}\alpha_{n}\prod_{j=1}^{n-1}(1-\alpha_{j}) (2) Note that the gaussian calculation exposed in eq. ( 1 ) is actually done in 2D after projection of the gaussians center and covariance matrix on the screen image. The projection of the center is done with the classical formulation given in eq. ( 3 ). Figure 1: Gaussian render example. The rendering has been modified on the left part to highlight the gaussians, while the right part is the standard 3DGS rendering. 3 Position dependent quantization methodology Perspective projection For the sake of simplicity, let us first consider a toy system with a single camera. Any point with coordinates (x,y,z) in the camera referential is projected to the image plan as (u,v) : \displaystyle u=f\frac{x}{z} (3) \displaystyle v=f\frac{y}{z} Under a high-rate hypothesis, quantizing the point coordinates (x,y,z) with a scalar, unitary quantizer can be modeled as adding an independent noise \delta to the coordinates. 1. the impact on (u,v) of the noise \delta on x,y is proportional to \frac{1}{z} 2. the impact on (u,v) of the noise \delta on z is proportional to \frac{1}{z^{2}} Of course, we don’t want to encode the model for one precise camera, but This gives the intuition of how the 3DoF+ assumption can be leveraged: the z coordinate of the local referential is to be quantized differently than the (x,y) . For example, we could use larger quantization steps for x,y,z when z is large. And even larger step for z than for x,y . 1 1 1 Note that this encourages to use spherical coordinates here for performing positional quantization. Simple scalar quantization on spherical coordinates would then lead to well adapted vector quantization of positions. To generalize from this toy example, we note that z is approximately the distance between the camera and the gaussian, and that the cameras are all in the same area in 3DoF+. As such, the reasoning holds for all cameras. Figure 2: 3DoF+ scene. Inner circle, radius R_{i} , is the limit of the possible camera poses. Outer circle, radius R , defines the minimum gaussian distance to the center. Figure 2 illustrates a typical 3DoF+ scene, with the camera positions in a small spatial zone compared to the distance to the closest points. Spherical coordinates To make the distance between a gaussian and a camera more explicit, the gaussian coordinates are now expressed in spherical coordinates (\rho,\theta,\phi) . The origin is set in the area of the cameras centers. With this referential and the 3DoF+ assumption, the \rho coordinate of any point approximates the distance between this point and any camera. Now on, we’ll consider a point of spherical coordinates \rho\mathbf{d} is the unit direction vector defined by: \displaystyle\mathbf{d}= \displaystyle(\sin\theta\cos\phi,\sin\theta\sin\phi,\cos\theta)^{T} (4) Considering that a camera can point to any direction, we will work on the 360\degree projection. This projection associates each point with its projection on the sphere of radius f . We will now work in a referential with the camera as center, keeping the orientation of the world referential. This referential will be referred to as the local referential. \displaystyle\mathbf{P}= \displaystyle\mathbf{P}_{0}+\rho\mathbf{d} (5) Where \mathbf{P}_{0} is the world origin in the local referential. The projection \mathbf{p} of \mathbf{P} on the sphere is: \displaystyle\mathbf{p}= \displaystyle\frac{\mathbf{P}}{||\mathbf{P}||} (6) And the derivation of this projection gives (cf details in appendix): \displaystyle\frac{\partial\mathbf{p}}{\partial\theta}= \displaystyle f\frac{\rho}{||\mathbf{P}||}(\cos\theta\cos\phi,\cos\theta\sin\phi,-\sin\theta)^{T}+O(\epsilon) (7) \displaystyle\frac{\partial\mathbf{p}}{\partial\phi}= \displaystyle f\frac{\rho\sin\theta}{||\mathbf{P}||}(-\sin\phi,\cos\phi,0)^{T}+O(\epsilon) \displaystyle\frac{\partial\mathbf{p}}{\partial\rho}= \displaystyle-f\frac{1}{\rho^{2}}((\mathbf{P}_{0}^{T}\mathbf{d})\mathbf{d}-\mathbf{P}_{0})+o(\epsilon^{2}) \displaystyle\epsilon= \displaystyle\frac{||\mathbf{P}_{0}||}{||\mathbf{P}||} This means that uniform quantization is relevant for \theta and \phi , since their impact is bounded by finite values close to 1. The impact of \rho quantization on the other hand depends on the value of \rho itself. Thus quantizing the coordinate uniformly would be suboptimal. It is proposed to parameterize \rho as: \rho=\frac{1}{t} , yielding: \displaystyle\frac{\partial\mathbf{p}}{\partial t}= \displaystyle f((\mathbf{P}_{0}^{T}\mathbf{d})\mathbf{d}-\mathbf{P}_{0})+o(\epsilon^{2}) (8) Which is a good candidate for uniform quantization, since it does not depend on the position of \mathbf{P}