TC-GS: A Faster Gaussian Splatting Module Utilizing Tensor Cores

Zimu Liao, Jifeng Ding, Siwei Cui, Ruixuan Gong, Boni Hu, Yi Wang, Hengjie Li, Hui Wang, Xingcheng Zhang, Rong Fu · 2025

Read TC-GS: A Faster Gaussian Splatting Module Utilizing Tensor Cores by Zimu Liao, Jifeng Ding, Siwei Cui, Ruixuan Gong, Boni Hu, Yi Wang, Hengjie Li, Hui Wang, Xingcheng Zhang, Rong Fu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24796.txt.

Introduction

Zimu Liao and co-authors present TC-GS, a module that speeds up 3D Gaussian Splatting, in a 2025 paper. That rendering method builds scenes from millions of soft blobs and blends them pixel by pixel, a step that eats most of the computing cost. Modern graphics chips have special tensor cores for matrix math that the standard pipeline leaves idle.

TC-GS rewrites the blending math as matrix multiplication, putting those idle cores to work. A coordinate reshuffle keeps rounding errors from the cores' low-precision math in check. The module plugs into existing top acceleration methods without changing their design. In tests it held image quality while adding a further speedup of over two times, for a total gain of up to five and a half times over the base method.

Catalog record

CREATORZimu Liao, Jifeng Ding, Siwei Cui, Ruixuan Gong, Boni Hu, Yi Wang, Hengjie Li, Hui Wang, Xingcheng Zhang, Rong Fu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24796

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TC-GS: A Faster Gaussian Splatting Module Utilizing Tensor Cores Zimu Liao, Jifeng Ding, Siwei Cui, Ruixuan Gong, Boni Hu, Yi Wang, Hengjie Li, Hui Wang, Xingcheng Zhang, Rong Fu Abstract . 3D Gaussian Splatting (3DGS) renders pixels by rasterizing Gaussian primitives, where conditional alpha-blending dominates the computational cost in the rendering pipeline. This paper proposes TC-GS, an algorithm-independ-ent universal module that expands the applicability of Tensor Core (TCU) for 3DGS, leading to substantial speedups and seamless integration into existing 3DGS optimization frameworks. The key innovation lies in mapping alpha computation to matrix multiplication, fully utilizing otherwise idle TCUs in existing 3DGS implementations. TC-GS provides plug-and-play acceleration for existing top-tier acceleration algorithms and integrates seamlessly with rendering pipeline designs, such as Gaussian compression and redundancy elimination algorithms. Additionally, we introduce a global-to-local coordinate transformation to mitigate rounding errors from quadratic terms of pixel coordinates caused by Tensor Core half-precision computation. Extensive experiments demonstrate that our method maintains rendering quality while providing an additional 2.18× speedup over existing Gaussian acceleration algorithms, thereby achieving a total acceleration of up to 5.6×. 2424 Conference: arXiv Preprint Version; October 11th; 2025 CCS: Computing methodologies Rasterization CCS: Computing methodologies Parallel algorithms Figure 1. TC-GS: a Tensor Core-based acceleration module for 3D Gaussian Splatting that can be effortlessly applied to existing 3DGS rendering pipelines. Integrated into 3DGS and its variants, it achieves an extra 2\times speedup while preserving rendering quality. Illustration of the TC-GS acceleration module applied to 3D Gaussian Splatting, showing speedup and rendering quality. † † cc-license: by 1. Introduction 3D Gaussian Splatting (3DGS) represents a significant advancement in neural rendering, employing Gaussian primitives to achieve NeRF-comparable quality while reducing optimization time to tens of minutes ( Mallick et al., 2024 ; Durvasula et al., 2023 ) . However, 3DGS rendering speed is heavily constrained by extensive model parameters and inefficient rendering pipelines ( Lu et al., 2024 ; Ren et al., 2024 ; Jiang et al., 2024 ) . Further acceleration remains essential for deployment on resource-constrained devices, real-time large-scale scene rendering systems, and low-latency edge computing scenarios. Despite numerous efforts to enhance computational efficiency ( Wang et al., 2024 ; Feng et al., 2024 ; Hanson et al., 2024 ; Huang et al., 2025 ) , they fail to tap into the most powerful computing units in modern GPUs. Moreover, existing acceleration modules are tightly coupled with core components, preventing modular reuse and inter-method adaptation. This coupling further limits the practical deployment and scalability of 3DGS-based solutions. Recent research ( Wang et al., 2024 ; Feng et al., 2024 ; Hanson et al., 2024 ; Huang et al., 2025 ) has identified the conditional alpha-blending process as the primary pipeline bottleneck. This process, which composites pixel colors with depth-sorted splatted Gaussian primitives, comprises three steps: (1) Alpha computation : computing the alpha value (opacity) of each splatted Gaussian fragment on the pixel; (2) Culling : eliminating fragments with low alpha values; and (3) Blending : compositing remaining fragments into final pixel colors. Many approaches ( Ye et al., 2025 ; Wang et al., 2024 ; Fan et al., 2024 ) employ early culling strategies to reduce the range of splatted Gaussians, thus minimizing redundant alpha-blending computations. Although they eliminate redundant computation, these methods require corresponding pipeline designs to mitigate load imbalance issues introduced by precise intersection ( Feng et al., 2024 ) calculations or sacrifice certain precision ( Wang et al., 2024 ) . Additionally, we observe that over 80% of Gaussian-pixel pairs that require culling remain in the pipeline. Consequently, the first two steps are the dominant part of the alpha-blending process. Unlike previous efforts to remove redundant computing ( Wang et al., 2024 ; Feng et al., 2024 ; Hanson et al., 2024 ; Huang et al., 2025 ) , we focus on utilizing Tensor Core Units (TCUs) to accelerate alpha computation, which remains an unexplored area. In modern GPUs, TCUs are deployed to perform matrix multiply accumulate (MMA), i.e., D=A\times B+C operations within a clock cycle, achieving high throughput on general matrix multiplication (GEMM) based computations including MLPs, CNNs, and transformers ( Vaswani et al., 2017 ) . However, due to their specialized computation pattern, TCUs struggle to be applied to non-GEMM computations, leaving them idle in 3DGS. To tackle this problem, this paper proposes TC-GS, a hardware-aligned redesign of alpha computation that unlocks Tensor Core acceleration for all 3DGS algorithms. TC-GS formulates a mapping from pixels and Gaussians into two matrices, where their matrix product yields logarithmic alpha values in batches. Implemented as a standalone module, TC-GS not only significantly improves rendering efficiency, but also enables seamless integration with existing 3DGS acceleration kernels, further enhancing overall performance. In summary, the paper proposes the following contributions: • A Detailed runtime analysis of the rendering pipeline showing that alpha computation in conditional alpha-blending is the performance bottleneck in 3DGS inference rendering. • The first use of Tensor Cores to accelerate alpha-blending, expanding the Tensor Core applicability beyond GEMM-based computations. • A global-to-local coordinate transformation ( G2L , Section 4.3 ) that reduces the absolute magnitudes of quadratic coordinate terms, which are sensitive to Tensor Core half-precision computation, enabling lossless rendering quality while maintaining full acceleration benefits. 2. Related Works 2.1. Fast 3D Gaussian Splatting 3DGS ( Kerbl et al., 2023 ) has emerged as a leading real-time rendering technique with photo-realistic visual quality, finding wide applications diverse domains including autonomous driving ( Zhou et al., 2024 ) , robotics ( Zhu et al., 2024 ) , and virtual reality ( Jiang et al., 2024 ) . Current acceleration research explores two primary optimization strategies to enhance 3DGS performance. The first strategy modifies the algorithm itself to achieve better efficiency ( Ye et al., 2025 ; Mallick et al., 2024 ; Lee et al., 2024 ) . CompactGS ( Lee et al., 2024 ) , Mini-splatting ( Fang and Wang, 2024 ) , PUP 3D-GS ( Hanson et al., 2025 ) , and gsplat ( Ye et al., 2025 ) introduce more efficient radiance field representations and adaptive resolution primitive pruning algorithms, while Taming-3DGS ( Mallick et al., 2024 ) presents mathematically equivalent but computationally efficient solutions for gradient computation and attribute updates, substantially accelerating training speed. Stochastic rasterization for sorting-free 3DGS ( Kheradmand et al., 2025 ) is an another approach of improving the algorithm itself. The second category focuses on improving computational efficiency of the original algorithm through intelligent task scheduling and CUDA kernel optimization ( Feng et al., 2024 ; Hanson et al., 2024 ; Wang et al., 2024 ; Ye et al., 2025 ; Gui et al., 2024 ; Durvasula et al., 2023 ) . Balanced-3DGS ( Gui et al., 2024 ) optimizes the forward computation of rendering CUDA kernels within warps while minimizing thread idle time and maximizing resource utilization by evenly distributing tasks across computational blocks. Several works, including AdRGaussian ( Wang et al., 2024 ) , FlashGS ( Feng et al., 2024 ) , and SpeedySplat ( Hanson et al., 2024 ) , aim to reduce the number of pixels processed per Gaussian by designing more precise Gaussian-tile bounding boxes, with FlashGS ( Feng et al., 2024 ) and SpeedySplat ( Hanson et al., 2024

Read the complete text