3D Gaussian Splat Vulnerabilities

Matthew Hull, Haoyang Yang, Pratham Mehta, Mansi Phute, Aeree Cho, Haoran Wang, Matthew Lau, Wenke Lee, Willian T. Lunardi, Martin Andreoni, Polo Chau, wenke, polo]@gatech.edu, [willian.lunardi, martin.andreoni]@tii.ae · 2025

Read 3D Gaussian Splat Vulnerabilities by Matthew Hull, Haoyang Yang, Pratham Mehta, Mansi Phute, Aeree Cho, Haoran Wang, Matthew Lau, Wenke Lee, Willian T. Lunardi, Martin Andreoni, Polo Chau, wenke, polo]@gatech.edu, [willian.lunardi, martin.andreoni]@tii.ae (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00280.txt.

Introduction

Matthew Hull and co-authors show how 3D Gaussian splatting can be attacked in a 2025 paper. The method builds a scene from many soft blobs that shift color with view angle. It now serves in safety fields such as robot travel. The team ask how a foe could bend a scene to cause harm. They built two attacks to probe that risk.

CLOAK hides foe content in the view shifts of the blobs. The scene looks sound from most spots, then shows the trap from one set view. DAGGER nudges the blobs in a planned way to fool object finders, with no need for the base training data. It fools a two-stage finder through a known gradient method. The pair of attacks mark a fresh risk class for 3D scene tools. Teams that ship such tools in robots should test for these tricks.

Catalog record

CREATORMatthew Hull, Haoyang Yang, Pratham Mehta, Mansi Phute, Aeree Cho, Haoran Wang, Matthew Lau, Wenke Lee, Willian T. Lunardi, Martin Andreoni, Polo Chau, wenke, polo]@gatech.edu, [willian.lunardi, martin.andreoni]@tii.ae
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00280

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

3D Gaussian Splat Vulnerabilities Matthew Hull, Haoyang Yang, Pratham Mehta, Mansi Phute, Aeree Cho, Haoran Wang, Matthew Lau, Wenke Lee, Willian T. Lunardi, Martin Andreoni, Polo Chau, wenke, polo]@gatech.edu, [willian.lunardi, martin.andreoni]@tii.ae Abstract With 3D Gaussian Splatting (3DGS) being increasingly used in safety-critical applications, how can an adversary manipulate the scene to cause harm? We introduce CLOAK , the first attack that leverages view-dependent Gaussian appearances—colors and textures that change with viewing angle—to embed adversarial content visible only from specific viewpoints. We further demonstrate DAGGER , a targeted adversarial attack directly perturbing 3D Gaussians without access to underlying training data, deceiving multi-stage object detectors e.g. , Faster R-CNN, through established methods such as projected gradient descent. These attacks highlight underexplored vulnerabilities in 3DGS, introducing a new potential threat to robotic learning for autonomous navigation and other safety-critical 3DGS applications. Fig. 1 : Our CLOAK attack conceals multiple adversarial cloaked textures in 3DGS scenes using Spherical Harmonics, causing the 3DGS representation of the car to become adversarial at different view points (red dots). For example, (A) when viewed from the top, the car appears as a suitcase, (B) “car” detection confidence decreases, (C) and when viewed directly from behind, displays a “stop sign.” 1 Introduction 3D Gaussian Splatting (3DGS) has rapidly gained popularity due to its efficiency in novel-view synthesis and real-time rendering of complex scenes, outperforming traditional methods like Neural Radiance Fields (NeRFs) Kerbl et al. 2023 . These advantages have led to growing interest in safety-critical domains such as autonomous driving Zhou et al. 2024 ; Li et al. 2024a , robotic navigation, and grasping Y.Zheng et al. 2024 , where rapid data generation and accurate sim2real transfer are essential. A typical 3DGS scene consists of 3D Gaussians initialized from structure-from-motion point clouds, optimized through backpropagation to refine positions, rotations, colors via Spherical Harmonics, scaling, and alpha blending. Despite the increasing adoption of 3DGS, vulnerabilities in its optimization processes and representations remain underexplored. Fig. 2 : Adversarial Gaussian splats demonstrating view-dependent color changes enabled by spherical harmonic rendering. We highlight a single splat with a light border for easier tracking of color changes across views, revealing its transition from green to gray when rotating from a side view (frames A–B) to an overhead view (frames C–E). We discovered that the view-dependent nature of Spherical Harmonics (SH)—commonly used in real-time rendering for realistic shading, enables adversaries to embed concealed adversarial appearances into 3DGS, each visible only from specific viewing angles (Fig. 1 ). For instance, an object such as a car could appear benign from ground level yet take on the appearance of asphalt or roadway when viewed aerially, effectively hiding from overhead surveillance systems (see Fig. 1 , 2 ). Furthermore, gradient-based adversarial methods like Projected Gradient Descent (PGD) can also be generalized to manipulate the Gaussian scene representation directly (Fig. 3 ), causing misclassifications and misdetections in downstream object detection tasks. Our findings reveal critical yet underexplored vulnerabilities inherent in 3DGS, highlighting a novel avenue for adversarial machine learning research and motivating the need for robust defensive strategies. To highlight these vulnerabilities, our main contributions are: 1. We introduce the CLOAK attack –to the best of our knowledge, the first attack to conceal multiple adversarial cloaked textures in 3DGS using Spherical Harmonics, causing the scene to become adversarial at different view points. We demonstrate CLOAK on YOLOv8, causing missed detections and misclassifications. CLOAK stands for C oncealed L ocalized O bject A ttack K inematics . 2. We introduce the DAGGER attack, a generalization of the PGD technique to 3DGS scenes . DAGGER directly manipulates 3DGS, targeting two-stage object detection models such as Faster R-CNN without needing access to the original image training data. DAGGER stands for D irect A ttack on G aussian G radient E vasive R epresentations . 3. An open-source implementation on GitHub 1 1 1 https://github.com/poloclub/3D-Gaussian-Splat-Attack to support reproducibility, further research, and defense development. 2 Related Work Adversarial attacks in the 2D space are well-established, and the corresponding vulnerabilities are extensively studied. However, such studies are not prevalent regarding 3D spaces Li et al. 2024b . Recently, differentiable renderers have been used to perform gradient optimization of components in a scene, which can be used to create highly realistic scenes where perturbations are applied to geometry, texture, pose, lighting, and sensors. This results in physically plausible objects that could be transferred to the real world. Adversarial ML researchers have also recently investigated exploiting novel views in NeRFs to create template inversion attacks to fool facial recognition systems Shahreza and Marcel 2023 . e.g., synthesizing novel views from limited data, and gaining access to systems using a 3D model of a face and the resulting new views. Importantly, these attacks do not require white-box access to the targeted model weights, highlighting a lower barrier for adversaries and raising concerns due to their practical feasibility. To date, only two works have explored limited threat model vulnerabilities in 3DGS. One introduces a computational cost attack targeting the split/densify stages of the 3DGS algorithm by perturbing training images, significantly increasing training time, scene complexity (in terms of Gaussian count), and memory usage, while reducing rendering frame rates; however, this approach does not target downstream models or tasks Lu et al. 2024 . The second work targets only a single model (CLIP ViT-B/16), employing data poisoning through segmentation and perturbation of target regions within images to induce targeted and untargeted misclassifications, and it does not directly manipulate the underlying 3DGS scene representation Zeybey et al. 2024 . 3 Attack Methods 3.1 Threat Models 3DGS synthesizes novel views by training a volumetric representation (using Gaussians and SH coefficients) from images, presenting adversaries with vulnerabilities at different pipeline stages (Fig 1 ). Our CLOAK attack models an adversary who can only manipulate training data, embedding concealed adversarial content visible solely from specific viewpoints, without direct access to internal scene parameters. In contrast, the DAGGER attack considers a stronger adversary who directly modifies the Gaussian representation, optimizing parameters like position, SH, scaling, rotation, and transparency. The resulting manipulated scene is rendered and passed to a downstream object detection model, causing targeted or untargeted misclassifications (Fig. 3 ). 3.2 CLOAK Attack Our CLOAK attack leverages the view-dependent appearance properties of 3DGS to conceal adversarial content within seemingly benign 3D scenes. By exploiting SH encoding, we can create objects with different appearances based on viewing angle. In 3DGS, each Gaussian is assigned SH coefficients rather than a fixed RGB color. These SH functions define how color varies with the incident viewing direction, allowing a Gaussian’s appearance to change dynamically depending on the observer’s perspective. During training, SH encode color information for varying camera views, enabling scenes to appear benign or adversarial depending on viewpoint. To hide adversarial views within an object, we begin with a benign textured version of a 3D model alongside one or more adversarial textures. A training image dataset is created by rendering the object with benign textures from one set of camera views and adversarial textures from targeted camera views. The attack trains the 3DGS scene so that certain viewpoints appear completely normal while others reveal hidden adversarial content. This technique enables sophisticated concealment. For example, a car can be

Read the complete text