Radiant Triangle Soup with Soft Connectivity Forces for 3D Reconstruction and Novel View Synthesis

Nathaniel Burgdorfer, Philippos Mordohai · 2025

Read Radiant Triangle Soup with Soft Connectivity Forces for 3D Reconstruction and Novel View Synthesis by Nathaniel Burgdorfer, Philippos Mordohai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23642.txt.

Introduction

Nathaniel Burgdorfer and Philippos Mordohai rebuild 3D scenes from loose triangles in a 2025 paper. Their scene form is a triangle soup: separate translucent triangles that stand in for surfaces. Unlike blob like kernels, flat triangles match real surfaces and can join into complex shapes, with color detail stored at each corner.

Optimization adds soft forces that pull triangles toward each other, urging smooth, joined surfaces without hard links. Tests on standard reconstruction and new view data sets improved shape accuracy over leading methods. Visual quality held up at the same time. The approach works at run time, refining a scene as it is fit.

Catalog record

CREATORNathaniel Burgdorfer, Philippos Mordohai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23642

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Radiant Triangle Soup with Soft Connectivity Forces for 3D Reconstruction and Novel View Synthesis Nathaniel Burgdorfer, Philippos Mordohai Abstract We introduce an inference-time scene optimization algorithm utilizing triangle soup, a collection of disconnected translucent triangle primitives, as the representation for the geometry and appearance of a scene. Unlike full-rank Gaussian kernels, triangles are a natural, locally-flat proxy for surfaces that can be connected to achieve highly complex geometry. When coupled with per-vertex Spherical Harmonics (SH), triangles provide a rich visual representation without incurring an expensive increase in primitives. We leverage our new representation to incorporate optimization objectives and enforce spatial regularization directly on the underlying primitives. The main differentiator of our approach is the definition and enforcement of soft connectivity forces between triangles during optimization, encouraging explicit, but soft, surface continuity in 3D. Experiments on representative 3D reconstruction and novel view synthesis datasets show improvements in geometric accuracy compared to current state-of-the-art algorithms without sacrificing visual fidelity. Figure 1: Optimizing Radiant Triangle Soup (RTS) produces high quality 3D models from captured images. Above, from left to right, are the rendered normal map, rendered depth map, rendered image, and the direct rasterization of the triangle primitives, as if they were opaque. 1 Introduction Gaussian Splatting (GS) methods are effective at Novel View Synthesis (NVS). However 3D Gaussian Splatting (3DGS) ( Kerbl et al., 2023 ) fails to accurately model the geometry of scene surfaces. 3D Gaussians are by design smooth, unbounded volumetric primitives, which are inherently ill-suited for representing flat surfaces and sharp boundaries. Optimization for novel view synthesis involves alpha-blending several overlapping Gaussians, none of which have to be located on the underlying surfaces. As a result, optimizing a representation of 3D Gaussian kernels for image synthesis commonly causes floaters or blurry artifacts in the scene. Several authors ( Huang et al., 2024 ; Guédon & Lepetit, 2024 ; Chen et al., 2024a ; Dai et al., 2024 ) have proposed flattening the kernels, with either strict 2D Gaussians ( Huang et al., 2024 ) or flattened 3D Gaussians via loss regularization ( Guédon & Lepetit, 2024 ; Chen et al., 2024a ) , to better model thin surfaces. These methods have shown that modifying the underlying primitives and enforcing optimization objectives on rendered geometry leads to improvements in geometric accuracy. While flat primitive help with surface alignment, diffuse ellipsoids still fail to accurately model depth discontinuities (see Fig. 8 ). Triangles are the fundamental primitives in computer graphics because they are necessarily planar and convex. They can approximate any surface as piecewise planar at any tolerance level, can directly model sharp discontinuities, and can be rendered rapidly without approximations. We present a new methodology for 3D reconstruction, which we named Radiant Triangle Soup (RTS) that enables gradient-based optimization of a Radiance Field (RF) using translucent triangle primitives as the scene representation (see Fig. 1 ). We provide a complete framework, including differentiable mechanisms for rasterization, as well as non-differentiable mechanisms for initialization, pruning, and densification. Our experiments show RTS achieves competitive results in terms of both appearance and geometry (see Fig. 7 ). Conceptually, RTS provides a feature that is not supported by any other GS scene representation: an avenue for explicit information sharing among 3D among primitives. Conventional Gaussian kernels interact via alpha-blending when rendered onto common pixels. Back-propagating from the loss at each pixel to the primitives is the only means of coordination across Gaussians. Using multiple images from various viewpoints gives rise to several indirect constraints on the primitives, but direct constraints are currently absent. Conversely, RTS is the first framework to enable direct information exchange among neighboring primitives. We formulate connectivity losses between neighboring triangle edges, allowing for a more direct and effective coordination of, and constraint on, primitive behavior throughout the optimization process. Even though using triangles as primitives alone achieves better geometric accuracy compared to Gaussian surfels, encouraging connectivity during optimization leads to more accurate surfaces with less floating artifacts (see Table 3 ). Color expressivity on a per-primitive basis is another dimension where the RTS representation excels. It is common practice to use a single color parametrization for each primitive. However, this may require large numbers of overlapping primitives in order to reconstruct details in the surfaces of the scene. Using triangles as the representation allows for each vertex to encode a separate color (in the form of Spherical Harmonics), leading to more expressive primitives through bilinear interpolation. To summarize, the work presented here: • Develops a new scene representation through alpha-blending of triangle primitives. • Introduces explicit 3D forces between primitives to encourage soft connectivity. • Increases primitive expressivity via multi-color encoding. 2 Related Work We begin this section with Gaussian splatting formulations that favor surfaces and continue with methods that rely on non-Gaussian primitives. Surveys on other aspects of Gaussian splatting, omitted due to space limitations, include ( Bao et al., 2025 ; Dalal et al., 2024 ; Luo et al., 2024 ; Wu et al., 2024 ) . The seminal work of Kerbl et al. (2023) on 3D Gaussian Splatting introduced an explicit alternative to NeRF ( Mildenhall et al., 2020 ) that is able to achieve high-quality rendering at much higher speed. 3DGS relies on interleaved differentiable optimization and non-differentiable density control of the explicit representation. The optimization process decreases view synthesis errors for one of the training images at each iteration and density control guides the placement of primitives. 2D Gaussian Splatting (2DGS) ( Huang et al., 2024 ) modified 3DGS to prioritize the reconstruction of surfaces, rather than volumetric material. This was accomplished by collapsing the 3D GS to 2D discs by setting the minimum eigenvalue of the Gaussian to 0. The authors of SuGaR ( Guédon & Lepetit, 2024 ) and PGSR ( Chen et al., 2024a ) devised similar techniques for aligning 2D Gaussian with the surfaces via regularization and a multi-view loss, respectively. Gaussian Surfels ( Dai et al., 2024 ) rely on monocular surface normal estimates and a normal-depth consistency loss. Gaussian Opacity Fields (GOF) ( Yu et al., 2024 ) extract surfaces as the zero-level set of 3D Gaussians. 3D-Half-Gaussian Splatting (3D-HGS) ( Li et al., 2024 ) enables the representation of perfectly planar surfaces and hard edges by attaching a splitting plane to each Gaussian, aligning it to the local surface, and setting the density of one of the half-spaces to 0. Figure 2: We begin with a set of sparse points. From these points we initialize a set of triangles and compute nearest neighbor connections for each triangle edge. During optimization, we render an image, depth map, and normal map for each view. We compute both 2D loss (over all output renderings), as well as 3D loss (directly over the primitive connections). Adaptive densification is non-differentiable and is performed at set intervals throughout the optimization. Triangle edge neighbors are recomputed following adaptive densification. Representations based on NeRF and 3DGS have found great success, but have also inspired researchers to seek alternatives. NeuRBF ( Chen et al., 2023 ) utilizes Radial Basis Functions (RBFs) to overcome limitations of NeRF due to the global nature of its MLP and features. GES ( Hamdi et al., 2024 ) is based on an

Read the complete text