Learning Representations from 3D Gaussian Splats
Julia Farganus, Krzysztof Żurawicki 0, Arkadiusz Gaweł 0, Weronika Jakubowska, Halina Kwaśnicka · 2026
Read Learning Representations from 3D Gaussian Splats by Julia Farganus, Krzysztof Żurawicki 0, Arkadiusz Gaweł 0, Weronika Jakubowska, Halina Kwaśnicka (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29549.txt.
Introduction
Julia Farganus and four colleagues compare geometric deep learning models for classifying scenes stored as three-dimensional Gaussian splats. Gaussian splatting was built for rendering views, not for understanding scenes, so the team tests point-based and graph-based models on classic point-cloud sets and dedicated splat sets. Scenes are compressed into latent codes and judged by full classification, linear probes, and clustering. Results show steady differences between model families and reveal how Gaussian-specific attributes shape code quality.
Catalog record
| CREATOR | Julia Farganus, Krzysztof Żurawicki 0, Arkadiusz Gaweł 0, Weronika Jakubowska, Halina Kwaśnicka |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34910 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29549
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Representations from 3D Gaussian Splats Julia Farganus, Krzysztof Żurawicki 0, Arkadiusz Gaweł 0, Weronika Jakubowska, Halina Kwaśnicka Abstract 3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of various geometric deep learning architectures for the classification of 3D scenes represented using Gaussian Splatting. We benchmark point-based and graph-based models across both traditional point cloud datasets and dedicated Gaussian Splatting datasets. Scenes are embedded into latent representations, which are evaluated through end-to-end classification, linear probing, and clustering analysis. Our study provides insight into the suitability of different geometry-aware architectures and input feature configurations for learning effective 3D Gaussian Splat representations. The results highlight consistent differences between architectural families and reveal the impact of Gaussian-specific attributes on the quality of representation. 1 Introduction As AI becomes increasingly integral to daily life, machines must not only process, but truly understand data that describe the physical world. While natural phenomena often yield complex, high-dimensional data, research demonstrates [ 1 ] that these representations can be compressed into fewer dimensions for downstream tasks. A primary example is 3D structures, whose unordered and sparse nature poses significant challenges for standard neural networks. To address these complexities, we focus on 3D point-based representations, exploring various architectural approaches to the classification task and analyzing their learned embedding space. The importance of learning embeddings is grounded in the hypothesis that high-dimensional data actually resides on a lower-dimensional manifold [ 1 ] . Specifically, within the 3D domain, expressive embeddings that preserve semantic distances and similarities can be utilized to bypass resource-intensive computations in the native 3D space. Although creation of representations has been previously approached by masked autoencoders [ 14 ] or multi-task learning [ 9 ] , we frame this task in a more direct manner, revisiting the efficacy of fully supervised learning. Our primary focus lies in comparing the underlying data structures and connectivity patterns inherent to the selected architectures. We base our research on the 3D Gaussian Splatting (3DGS) [ 10 ] that has been up to date explored mostly for rendering and visualization. Crucially, like 3D point clouds, 3DGS consists of a set of unordered centroids, suggesting a natural compatibility with existing geometric neural architectures. However, unlike raw points, these primitives exhibit spatial extent and directionality. While this extended feature set is optimized strictly for visual rasterization rather than geometric fidelity – and could theoretically introduce noise in downstream tasks – pioneering work [ 28 ] has shown that incorporating auxiliary features like opacity, scale, and rotation can actually enhance shape recognition and yield more separable latent spaces. Intuitively, incorporating purely visual features like opacity and color can significantly enhance class separation. For instance, textureless or solid objects are typically represented by a small number of large, opaque primitives with uniform color. Conversely, intricate objects with wire-like or porous structures require elongated primitives with varied opacities – to account for holes – and differing colors. Unlike purely centroid-based approaches, learning on 3DGS representations enables networks to differentiate between classes that share near-identical spatial geometry but possess distinct visual cues. Motivated by the sparsity of research in this direction, we pose a fundamental question: Can neural networks successfully extract meaningful geometric representations from features originally optimized purely for visual fidelity ? To systematically evaluate this, we model 3DGS scenes as graphs, allowing us to benchmark three distinct architectural paradigms: global connectivity, self-connectivity, and local connectivity (explained in Section 3.1 ). We evaluate the quality of the resulting internal representations through a suite of downstream tasks, including linear probing alongside hard and soft clustering. This geometric interpretation aligns our framework directly with Geometric Deep Learning [ 3 ] . This approach incorporates spatial symmetry and scale separation principles directly into neural architectures, effectively mitigating the curse of dimensionality. By applying graph embedding techniques, it maps sparse graphs with high-dimensional features into dense, low-dimensional vector spaces while strictly preserving structural properties. In this work, we provide an evaluation of such embeddings, derived as a by-product of the classification task. Our contributions are as follows: 1. Comprehensive evaluation of embeddings through supervised classification and unsupervised clustering tasks. 2. Establishment of Graph Neural Network baselines for classification on 3D Gaussian Splatting datasets. 3. Quantitative benchmarking of state-of-the-art architectures with follow-up recommendations. 2 Related work Existing classification frameworks adopt one of three primary representation strategies: projection-based, voxel-based, and point-based methods, each offering a unique strategy to encode 3D geometric structures into latent embeddings. Point cloud classification is a practical problem encountered in object detection, medicine, and 3D reconstruction [ 27 ] . The early solutions include projection-based methods [ 18 , 26 ] and voxel-based methods [ 31 , 26 , 5 ] . Nevertheless, these methods ignore geometric representation and fail to learn recognizing abstract shapes. More efficient solutions work directly with the unordered structure of 3D point cloud. PointNet [ 15 ] introduces an architecture that transforms each point independently. Follow-ups include PointNet++ [ 16 ] , which processes points hierarchically, and PointNeXt [ 17 ] , which extends PointNet++ by introducing residual connections and separable MLPs. Graph Neural Networks extend point-based methods by explicitly modeling local and non-local relationships between points through graph structures. Although many approaches are based on spectral graph theory, they struggle with generalization. SplineCNN [ 8 ] mitigates this limitation by operating directly in the spatial domain. Its convolution operator aggregates node features using a trainable kernel function based on B-spline bases. Another approach proposed in Graph Attention Network [ 19 ] (GAT) is to utilize masked attention layers, gaining efficiency from parallelization and shared weights for all edges. Previously mentioned methods use static neighborhood that may hamper the ability to fuse information from distant nodes. Dynamically built graphs were introduced in the Dynamic Graph Convolutional Neural Network [ 20 ] (DGCNN), through an EdgeConv operation that uses feature space to find semantically similar elements, even though they are distant in the 3D coordinate space. Other approaches for integrating contextual relationships involve pair-point impact function [ 30 ] or superpoint graph [ 12 ] . The work done in [ 21 ] , [ 24 ] addresses the extension of convolutional architectures to the 3D point cloud domain. Gaussian Splatting [ 10 ] is a novel technique for 3D visualization that has found use cases, for example, in medical imaging [ 2 ] and autonomous driving [ 11 ] . Let \mathcal{G}=\{g_{i}\}_{i=1}^{N} denote a 3D Gaussian Splatting representation consisting of N Gaussian primitives. According to the formulation [ 10 ] , each primitive is characterized by its spatial position \mathbf{p}_{i} , the anisotropic scaling factors \mathbf{s}_{i} , the orientation represented as a unit quaternion \mathbf{q}_{i} , opacity \alpha_{i} , and view-dependent color represented by spherical harmonic coefficients \mathbf{sh}_{i} : g_{i}=\left(\mathbf{p}_{i},\mathbf{s}_{i},\mathbf{q}_{i},\alpha_{i},\mathbf{sh}_{i}\right)\in\left(\mathbb{R}^{3},\mathbb{R}^{3},\mathbb{R}^{4},\mathbb{R}^{1},\mathbb{R}^{48}\right). In particular, considering only splat centroids \mathbf{p}_{i} makes them equivalent to a point cloud. As each feature carries a different meaning and lives in a separate domain, we also refer to them as heterogeneous attributes later on. The technique has been mainly employed for high quality rendering purposes with limited research exploring its potential as a replacement for point