Revealing Hidden Vulnerabilities in Autoencoders through Gradient Signal Restoration
Chethan Krishnamurthy Ramanaik, Arjun Roy, Tobias Callies, Eirini Ntoutsi · 2025
Read Revealing Hidden Vulnerabilities in Autoencoders through Gradient Signal Restoration by Chethan Krishnamurthy Ramanaik, Arjun Roy, Tobias Callies, Eirini Ntoutsi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03646.txt.
Introduction
Chethan Krishnamurthy Ramanaik and co-authors wrote a 2025 paper on hidden weakness in autoencoders, AI tools that squeeze data down and rebuild it. Small crafted changes to input can wreck the rebuild, but past attacks often fell short. That made the tools look safer than they are.
The authors trace the shortfall to attack signals that fade as they pass through badly shaped layers. Their method, GRILL, restores those signals during attack tuning. Across many designs, and in both one-off and shared attacks, GRILL found much stronger attacks. Early tests suggest big mixed media models share the flaw. The work aims to make safety checks for such tools more honest.
Catalog record
| CREATOR | Chethan Krishnamurthy Ramanaik, Arjun Roy, Tobias Callies, Eirini Ntoutsi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-03646
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Revealing Hidden Vulnerabilities in Autoencoders through Gradient Signal Restoration Chethan Krishnamurthy Ramanaik, Arjun Roy, Tobias Callies, Eirini Ntoutsi Abstract . Adversarial robustness of deep autoencoders (AEs) has received less attention than that of discriminative models, although their compressed latent representations induce ill-conditioned mappings that can amplify small input perturbations and destabilize reconstructions. Existing white-box attacks for AEs, which optimize norm-bounded adversarial perturbations to maximize reconstruction damage, often converge to suboptimal perturbations, thereby potentially overstating AE robustness. We show that this limitation is linked to vanishing adversarial loss gradients during backpropagation through ill-conditioned layers, associated with near-zero singular values in their intermediate weight matrices. To address this, we propose GRILL (Gradient Signal Restoration in Ill-Conditioned Layers), a framework designed to mitigate gradient degradation and improve the reliability of adversarial robustness evaluation in encoder–decoder architectures. GRILL is designed to mitigate adversarial gradient degradation during optimization, enabling attacks to better approximate high-distortion perturbations under fixed norm constraints. Through extensive experiments across multiple AE architectures, under both sample-specific and universal attacks, as well as standard and adaptive attack settings, we show that GRILL significantly increases attack effectiveness, thereby exposing vulnerabilities hidden by existing attack limitations. Beyond AEs, we provide preliminary evidence that modern multimodal encoder–decoder architectures exhibit similar vulnerabilities. Code: https://github.com/ChethanKodase/illcond 1. Introduction Autoencoders (AEs) ( Goodfellow et al., 2016 ) are deployed in high-stakes applications, including image compression, reconstruction, denoising, anomaly detection, and generative modeling. By learning to approximately invert an encoder through a decoder, AEs inherently pose an inverse problem and exhibit structural non-invertibility due to dimensionality reduction. Despite this, adversarial vulnerabilities of AEs remain less studied than those of classification models ( Szegedy et al., 2013 ) . Rigorous robustness evaluation requires strong and well-understood white-box attack methodologies, which are a standard tool for robustness evaluation ( Akhtar et al., 2021 ) , as they are essential for identifying model vulnerabilities and designing effective defense ( van Spengler et al., 2024 ; Szegedy et al., 2013 ) . AEs are a prominent class of encoder–decoder architectures, motivating investigation of similar optimization challenges in broader encoder–decoder systems. Existing white-box attacks for AEs ( Carlini and Wagner, 2017 ; Gondim-Ribeiro et al., 2018 ; Cemgil et al., 2020 ) optimize norm-bounded perturbations to maximize reconstruction damage. However, encoder–decoder architectures often exhibit ill-conditioning due to dimensionality reduction and approximate inversion during gradient propagation. As a result, adversarial optimization may yield suboptimal perturbations, potentially overstating robustness. Ill-Conditioning as a Source of Adversarial Vulnerability . Ill-conditioning in neural networks can arise from highly imbalanced singular value spectra of the Jacobians of nonlinear network mappings, resulting in large condition numbers, as well as from structurally rank-deficient transformations induced by dimensionality reduction. Both effects are common in encoder–decoder architectures and can increase sensitivity to input perturbations. In practice, conditioning behavior is often approximated through the singular value spectra of intermediate layer weight matrices, which strongly influence gradient propagation ( Sedghi et al., 2018 ; Yoshida and Miyato, 2017 ; Pennington et al., 2017 ) . Prior studies ( Sinha et al., 2018 ; Wei et al., 2022 ) have shown that ill-conditioned networks can amplify small perturbations and increase adversarial vulnerability. Research on instabilities in deep inverse problems ( Antun et al., 2021 ; Antun et al., 2020 ) and the accuracy–stability trade-off ( Gottschling et al., 2025 ) further demonstrates that deep learning pipelines, including AEs, can exhibit severe ill-conditioning and increased sensitivity to perturbations. At the same time, near-zero singular values in ill-conditioned networks can suppress adversarial gradient propagation, degrading attack optimization. Why Small Singular Values Matter. Prior work on improving robustness has mainly focused on controlling large singular values through Lipschitz regularization and spectral normalization ( Barrett et al., 2022 ; Fazlyab et al., 2019 ) . In particular, several regularization methods ( Yoshida and Miyato, 2017 ; Miyato et al., 2018 ; Cisse et al., 2017 ; Gulrajani et al., 2017 ) explicitly constrain spectral norms, i.e., the largest singular values of weight matrices ( Virmaux and Scaman, 2018 ) , to limit perturbation amplification and improve stability. In addition, implicit self-regularization effects arising from optimization dynamics ( Martin and Mahoney, 2021 ) have been observed to promote similar spectral control during training. In contrast, considerably less attention has been paid to near-zero singular values, which can induce rank-deficiency and instability ( Kirsch and others, 2011 ) , suppress gradient propagation, and impair adversarial optimization, potentially preventing attacks from finding worst-case perturbations. Ill-Conditioning Behind the Illusion of Adversarial Robustness. Prior work on dynamical isometry ( Pennington et al., 2017 ) suggests that near-zero singular values break dynamical isometry, leading to ill conditioned Jacobians causing poor gradient flow and slow or stalled optimization. Similar effects were observed in quantized classification models during attack optimization ( Gupta and Ajanthan, 2022 ) , creating the illusion of adversarial robustness by simply impeding adversarial optimization rather than improving true robustness. However, the impact of ill-conditioning on gradient propagation during white-box adversarial optimization against encoder–decoder architectures remains largely unexplored. Our contributions are summarized as follows: (i) We identify a previously unexplored failure mode in AE adversarial optimization, where near-zero singular values suppress adversarial gradients and yield suboptimal attacks. (ii) We propose GRILL , a technique that is designed to mitigate gradient degradation during adversarial optimization in ill-conditioned encoder–decoder architectures. (iii) We show that GRILL consistently improves attack effectiveness and exposes vulnerabilities hidden by optimization limitations. (iv) We provide preliminary evidence that modern multimodal encoder–decoder architectures may exhibit similar vulnerabilities. Paper organization: Section 2 reviews related work. Section 3 introduces preliminaries and attack formulations. We first introduce LGR in Section 4 for simplified decoder-side ill-conditioning settings, before presenting GRILL in Section 5 for general ill-conditioned encoder–decoder architectures. Section 6 reports experimental results and ablation studies, and Section 7 concludes the paper. 2. Related Work Related work spans four main areas: AE architectures, white-box adversarial attacks on autoencoders, adversarial attacks on broader encoder–decoder architectures, and optimization challenges arising from ill-conditioned networks. Architectures. Modern AEs extend the vanilla AE ( Hinton and Salakhutdinov, 2006 ) through structural and regularization enhancements. \beta -VAE ( Higgins et al., 2017 ) and TC-VAE ( Chen et al., 2018 ) encourage disentangled latent representations via KL regularization and total correlation penalties, respectively. NVAE ( Vahdat and Kautz, 2020 ) introduces hierarchical latent variables for multi-scale representations, while DiffAE ( Preechakul et al., 2022 ) integrates diffusion-based decoding to improve fidelity and robustness. Masked autoencoders (MAE) ( He et al., 2022 ) employ self-supervised reconstruction via random masking without explicit latent regularization. While discrete-latent models exist ( Van Den Oord et al., 2017 ) , we focus on state-of-the-art AEs with continuous latent spaces. To evaluate the broader applicability of GRILL beyond classical AEs, we additionally consider large-scale vision–language encoder–decoder models, including Gemma 3 ( Team et al., 2025 ) and Qwen 2.5 ( Hui et al., 2024 ) . White-box Attacks on Autoencoders. White-box adversarial attacks optimize norm-bounded perturbations with full access to model gradients and may be targeted or untargeted, we focus on the latter. Unlike targeted attacks such as C&W ( Carlini and Wagner, 2017 ) , which induce misclassification, untargeted attacks on AEs maximize latent or output distortion under a fixed perturbation budget