Triangle Splatting for Real-Time Radiance Field Rendering
2025
Read Triangle Splatting for Real-Time Radiance Field Rendering (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19175.txt.
Introduction
Jan Held and co-authors argue for a comeback of the triangle in computer graphics, in a 2025 paper. The catalog leaves the creator field blank, but the text byline names the full team. Recent hit methods build scenes from soft blobs or from learned fields, pushing triangles aside. This team built a renderer that tunes triangles directly, using smooth gradients end to end. Each triangle is drawn as a soft splat, which pairs triangle speed with blob-like flexibility.
On a standard scene set, their method beat rival blob methods on picture quality and learning speed. It also topped a leading field method on indoor scenes. For one garden scene, it drew frames at more than twenty-four hundred per second at high definition, using a stock mesh renderer. The authors say triangles fit standard graphics hardware so well that mesh-based tuning now looks like the path ahead.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-19175
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Triangle Splatting for Real-Time Radiance Field Rendering Abstract The field of computer graphics was revolutionized by models such as Neural Radiance Fields and 3D Gaussian Splatting, displacing triangles as the dominant representation for photogrammetry. In this paper, we argue for a triangle comeback. We develop a differentiable renderer that directly optimizes triangles via end-to-end gradients. We achieve this by rendering each triangle as differentiable splats, combining the efficiency of triangles with the adaptive density of representations based on independent primitives. Compared to popular 2D and 3D Gaussian Splatting methods, our approach achieves higher visual fidelity, faster convergence, and increased rendering throughput. On the Mip-NeRF360 dataset, our method outperforms concurrent non-volumetric primitives in visual fidelity and achieves higher perceptual quality than the state-of-the-art Zip-NeRF on indoor scenes. Triangles are simple, compatible with standard graphics stacks and GPU hardware, and highly efficient: for the Garden scene, we achieve over 2,400 FPS at 1280×720 resolution using an off-the-shelf mesh renderer. These results highlight the efficiency and effectiveness of triangle-based representations for high-quality novel view synthesis. Triangles bring us closer to mesh-based optimization by combining classical computer graphics with modern differentiable rendering frameworks. The project page is https://trianglesplatting.github.io/ Figure 1 : We propose a new representation for differentiable rendering based on the most classical of 3D primitives: the triangle . We show how a triangle soup ( \ie unstructured, disconnected triangles) can be optimized effectively, generating state-of-the-art novel view synthesis images while being immediately compatible with classical rendering pipelines. The figure shows the final rendered output (left), a visualization of soft blending (middle), and the rendering of a random subset of triangles to highlight their structure (right). 1 Introduction Figure 2 : \myTitle Byproduct of the triangle-based representation \methodname unifies differentiable scene optimization with traditional graphics pipelines. The optimized triangle soup is compatible with any mesh-based renderer, enabling seamless integration into traditional graphics pipelines. In a game engine, we render at 2,400+ FPS at 1280×720 resolution on an RTX4090 (left) and 300+ FPS on a consumer laptop (right). One of the enduring challenges in 3D vision and graphics is identifying a truly universal primitive for representing 3D content in a differentiable form, enabling gradient-based optimization of geometry and appearance. Despite extensive research, no single data structure has emerged as a silver bullet. Instead, researchers have explored a variety of approaches, including neural fields [ 31 ] , explicit grids [ 10 ] , hash tables [ 32 ] , convex primitives [ 14 , 8 ] , and anisotropic Gaussians [ 21 ] , among others. Conversely, in conventional graphics pipelines, the triangle remains the undisputed workhorse. Game engines and other real-time systems primarily rely on triangles, as GPUs feature dedicated hardware pipelines for ultra-efficient triangle processing and rendering. Although other primitives exist ( \eg , quads in 2D or tetrahedra in 3D), they can always be subdivided into triangles. Moreover, surface reconstruction in 3D vision and graphics predominantly relies on triangle meshes to represent continuous, watertight geometry in an efficient, renderable form [ 20 ] . Despite their ubiquity, triangles are difficult to optimize in differentiable frameworks due to their discrete nature. Early attempts at differentiable optimization softened the non-differentiable occlusion at polygon edges, enabling gradients from image loss to flow into geometry and appearance parameters [ 19 , 26 ] . However, these methods require a predefined mesh template, making them unsuitable when the scene’s topology is unknown a priori. As a result, they struggle to capture fine geometric details and adapt to novel structures. To address these challenges, researchers adopted volumetric primitives, such as anisotropic 3D Gaussians in 3DGS [ 21 ] , which can be optimized for high-quality novel view synthesis. However, the unbounded support of Gaussians makes it difficult to define the “surface” of the representation, and their inherent smoothness hinders accurate modeling of sharp details. Surface structures can be partially restored using 2D Gaussian Splatting [ 15 ] or 3D convex polytopes [ 14 ] . Yet, a pivotal question remains: can triangles themselves be optimized directly? Learning to optimize a “triangle soup” ( \ie unstructured, disconnected triangles) via gradient-based methods could represent a major step towards the goal of template-free mesh optimization. Such an approach leverages decades of GPU-accelerated triangle processing and the mature mesh processing literature, making it easier to integrate these techniques within differentiable rendering pipelines. In this work, we introduce Triangle Splatting , a real-time differentiable renderer that splats a soup of triangles into screen space while enabling end-to-end gradient-based optimization. Triangle Splatting merges the adaptability of Gaussians with the efficiency of triangle primitives, surpassing 3D Gaussian Splatting (3DGS), 2D Gaussian Splatting (2DGS), and 3D Convex Splatting (3DCS) in visual fidelity, training speed, and rendering throughput. The optimized triangle soup is directly compatible with any standard mesh-based renderer. As shown in Figure 2 , our representation can be rendered in traditional game engines at over 2,400 FPS at 1280×720 resolution, demonstrating both high efficiency and seamless compatibility. To our knowledge, Triangle Splatting is the first splatting-based approach to directly optimize triangle primitives for novel-view synthesis and 3D reconstruction, delivering state-of-the-art results while bridging classical rendering pipelines with modern differentiable frameworks. Contributions. (i) We propose Triangle Splatting, a novel approach that directly optimizes unstructured triangles, bridging traditional computer graphics and radiance fields. (ii) We introduce a differentiable window function for soft triangle boundaries, enabling effective gradient flow. (iii) We demonstrate qualitatively and quantitatively that \methodname outperforms concurrent methods in terms of visual quality and rendering speed, and achieves superior perceptual quality compared to the state-of-the-art Zip-NeRF on indoor scenes. (iv) The optimized triangles are directly compatible with standard mesh-based renderers, enabling seamless integration into traditional graphics pipelines. 2 Related work Neural radiance fields have become the de-facto standard for image-based 3D reconstruction [ 30 ] . A large body of work has since addressed NeRF’s slow training and rendering by introducing multi-resolution grids or hybrid representations [ 5 , 10 , 24 , 32 , 37 ] , or baking procedures for real-time playback [ 7 , 13 , 34 , 35 ] . Improvements in robustness include anti-aliasing [ 1 , 2 , 3 ] , handling unbounded scenes [ 2 , 42 ] , and few-shot generalization [ 4 , 9 , 17 ] . Despite their success, implicit fields still require costly volume integration at render time. Our Triangle Splatting sidesteps this by optimizing explicit triangles that are traced once per pixel, leading to comparable fidelity but orders-of-magnitude faster rendering. For example, our triangles render ten times faster than Instant-NGP [ 32 ] , while matching its optimization speed and achieving significantly higher visual fidelity. Primitive-based differentiable rendering. Differentiable renderers back-propagate image loss to scene parameters, enabling end-to-end optimization of explicit primitives such as points [ 11 , 19 ] , voxels [ 10 ] , meshes [ 19 , 26 , 27 ] , and Gaussians [ 21 ] . 3D Gaussian Splatting [ 21 ] demonstrated that millions of anisotropic Gaussians can be fitted in minutes and rendered in real time. Follow-up work improved anti-aliasing [ 41 ] , offered exact volumetric integration [ 29 ] , or modeled dynamics [ 28 , 43 ] . Because Gaussians have infinite