Targeted View-Invariant Adversarial Perturbations for 3D Object Recognition

Christian Green, Mehmet Ergezer, Abdurrahman Zeybey · 2024

Read Targeted View-Invariant Adversarial Perturbations for 3D Object Recognition by Christian Green, Mehmet Ergezer, Abdurrahman Zeybey (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13376.txt.

Introduction

Christian Green, Mehmet Ergezer, and Abdurrahman Zeybey present a 2024 paper on attacks that fool systems which recognize three-dimensional objects. Such systems often view an object from many angles. A weak spot is a small, crafted noise pattern that makes the system name the wrong object.

Their method, called VIAP, builds one noise pattern that works from many viewpoints. It can also be aimed, forcing the system to output a chosen wrong label. They tested it on 1,210 images of 121 rendered objects. The untargeted version held up under rotations and other changes of view. The targeted version reached top accuracy above 95 percent in their tests. The work offers a way to stress-test vision systems before real-world use.

Catalog record

CREATORChristian Green, Mehmet Ergezer, Abdurrahman Zeybey
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13376

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Targeted View-Invariant Adversarial Perturbations for 3D Object Recognition Christian Green, Mehmet Ergezer, Abdurrahman Zeybey Abstract Adversarial attacks pose significant challenges in 3D object recognition, especially in scenarios involving multi-view analysis where objects can be observed from varying angles. This paper introduces View-Invariant Adversarial Perturbations (VIAP) , a novel method for crafting robust adversarial examples that remain effective across multiple viewpoints. Unlike traditional methods, VIAP enables targeted attacks capable of manipulating recognition systems to classify objects as specific, pre-determined labels, all while using a single universal perturbation. Leveraging a dataset of 1,210 images across 121 diverse rendered 3D objects, we demonstrate the effectiveness of VIAP in both targeted and untargeted settings. Our untargeted perturbations successfully generate a singular adversarial noise robust to 3D transformations, while targeted attacks achieve exceptional results, with top-1 accuracies exceeding 95% across various epsilon values. These findings highlight VIAP’s potential for real-world applications, such as testing the robustness of 3D recognition systems. The proposed method sets a new benchmark for view-invariant adversarial robustness, advancing the field of adversarial machine learning for 3D object recognition. Introduction Adversarial attacks have emerged as a critical area of research within artificial intelligence, exposing vulnerabilities in machine learning models that can be exploited to manipulate their outputs ( Carlini and Wagner 2017 ) . These attacks, often imperceptible to human observers, pose significant risks to real-world applications, particularly in the context of security ( Sharif et al. 2019 ) . As AI models continue to advance, so too does the urgency of understanding and addressing their susceptibility to adversarial threats ( Ren et al. 2020 ) . Conventional adversarial attacks primarily focus on generating perturbations for single views of objects, exploiting limitations in 2D image understanding ( Szegedy et al. 2013 ; Madry et al. 2017 ) . These attacks face limitations when applied to 3D objects, as they often lack robustness to real-world variations in perspective. Unlike 2D systems, 3D recognition systems must contend with viewpoint variability, transformations, and real-world conditions, making it difficult to craft perturbations that generalize effectively across multiple perspectives. This paper introduces View-Invariant Adversarial Perturbations (VIAP) , a novel framework designed to overcome these challenges by generating robust, universal perturbations for 3D objects. VIAP enables adversarial attacks that maintain their effectiveness across diverse transformations of a 3D object ( Zhi et al. 2018 ) , including rotations and viewpoint changes, while also allowing targeted manipulation of class labels ( Athalye et al. 2018 ) . Unlike prior methods that primarily focus on non-targeted attacks ( Ergezer et al. 2024 ) , VIAP extends adversarial capabilities to precise, controlled targeted attacks, broadening its practical applicability. Problem and Contributions Adversarial attacks in 3D object recognition confront a fundamental challenge: developing perturbations that remain effective across diverse viewpoints. Existing adversarial perturbation methods suffer from two critical limitations: (1) poor generalizability across multi-angle views, and (2) restricted capability for targeted attacks. Our work directly addresses these constraints through three key contributions: • A novel method for generating view-invariant universal perturbations that maintain effectiveness across multiple object perspectives. • A mathematical formalization of view-invariance in adversarial attacks, providing theoretical grounding for multi-view robustness. • Experimental validation demonstrating superior performance in both targeted and untargeted scenarios, outperforming established baseline methods. By introducing VIAP, we bridge critical gaps in current adversarial machine learning approaches, enabling more sophisticated and reliable attacks that can adapt to complex 3D recognition environments. In the following sections, we provide a review of related work to contextualize our contributions and identify existing gaps in adversarial research. We then present our targeted View-Invariant Adversarial Perturbation (VIAP) method, detailing the mathematical foundation and implementation. Extensive experiments validate the robustness and versatility of our approach in both targeted and untargeted scenarios, demonstrating its superiority over baseline methods. Finally, we discuss practical implications, limitations, and directions for future work, emphasizing the broader impact of this study on the security of 3D object recognition systems. Related Work This section reviews foundational adversarial attack methods, highlighting their principles and limitations, which set the stage for the proposed targeted View-Invariant Adversarial Perturbations approach discussed in the next section. Fast Gradient Sign Method (FGSM): One of the earliest adversarial attack methods, was proposed in 2014 ( Goodfellow, Shlens, and Szegedy 2015 ) . FGSM quickly gained popularity due to its simplicity, low computational cost, and ease of implementation. The method relies on attacks where the assailant knows the model’s architecture and weights. However, this reliance limits FGSM’s effectiveness in settings where only the input features are accessible. FGSM works by calculating the gradient of the loss with respect to the input image and then updating the image’s pixels in a direction that maximizes this loss. In Equation 1 , we let X and y be the input image and true label respectively. We assume X as a 3-D matrix (width × height × color). The perturbation strength is controlled by \epsilon . \nabla_{X}J(X,y_{true}) is the gradient of the model’s loss with respect to X . The sign of the gradient determines the direction of the perturbation. We initialize X^{adv}_{0}=X . X^{adv}=X+\epsilon\cdot\text{sign}(\nabla_{X}J(X,y_{true})) (1) While FGSM is primarily used for untargeted attacks, it can be adapted for targeted attacks by adjusting the gradient direction to minimize the loss between the targeted and predicted labels, as shown in Equation 2 . X^{adv}=X+\epsilon\cdot\text{sign}(\nabla_{X}J(X,y_{target})) (2) The Basic Iterative Method (BIM) Extends the idea of FGSM by applying the perturbation iteratively, allowing for a more effective adversarial attack ( Kurakin, Goodfellow, and Bengio 2017 ) . By clipping intermediate results at each step, BIM ensures that the perturbation stays within a defined range, as outlined in Equation 3 . This iterative approach typically enhances the success rate of the attack compared to the single-step FGSM. As with FGSM, we initialize BIM, X^{adv}_{0}=X . N in Equation 3 represents the iteration count. X_{N+1}^{adv}=\text{Clip}_{X,\epsilon}\{X_{N}^{adv}+\epsilon\cdot\text{sign}(\nabla_{X}J(X_{N}^{adv},y_{true}))\} (3) Untargeted View-Invariant Adversarial Perturbations: The conventional process of generating an adversarial noise involves crafting a unique perturbation for an image. The noise is applied to the image and fed through a classifier, leading to an incorrect class label prediction. Attempting to apply this perturbation to separate images often leads to inconsistent outputs by our classifier, rendering the noise useless. The previous iteration of VIAP, published as the universal perturbation method, was created to overcome this obstacle ( Ergezer et al. 2024 ) by formulating one perturbation universally applicable to various perspectives of one or more objects, \mathbb{X}^{\text{adv}} . To achieve this, a modification was made to the BIM. The gradients are calculated with respect to the adversarial noise itself, instead of the input image. This adjustment separated the number of input images from the shape of the generated adversarial noise. In turn, it allowed the attacker to control the input image’s dimensions and the associated noise, independently. This update enables simultaneous inputs of various views for the same object. The new algorithm provided solitary adversarial noise capable of collectively compromising the recognition of all these distinct perspectives at once (including rotations, changes in lighting, and potential deformations). Equation 4 details VIAP calculation where X is stacked input images as a 4-D tensor (image count, width, height, color), \mathbb{X} is the calculated perturbation as a 3-D matrix (width, height, color), matching the

Read the complete text