XBreaking: Understanding how LLMs security alignment can be broken
Marco Arazzi, Vignesh Kumar Kembu, Antonino Nocera, Vinod P · 2025
Read XBreaking: Understanding how LLMs security alignment can be broken by Marco Arazzi, Vignesh Kumar Kembu, Antonino Nocera, Vinod P (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21700.txt.
Introduction
Marco Arazzi and co-authors study how safety training in large language models can fail, in work from 2025. Paid models are tuned to refuse harmful requests. Attackers craft inputs that slip past those guards, which blocks safe use in settings like health care.
Most attacks guess and test many inputs with little insight. The authors instead compare a guarded model with an unguarded one. Gaps in behavior reveal weak spots in the guard design. Their attack then targets those exact spots. The work aims to help builders, not just attackers, by showing where guards bend. Clear knowledge of failure modes is a step toward models that hold up under pressure.
Catalog record
| CREATOR | Marco Arazzi, Vignesh Kumar Kembu, Antonino Nocera, Vinod P |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-21700
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
XBreaking: Understanding how LLMs security alignment can be broken Marco Arazzi, Vignesh Kumar Kembu, Antonino Nocera, Vinod P Abstract Large Language Models are fundamental actors in the modern IT landscape dominated by AI solutions. However, security threats associated with them might prevent their reliable adoption in critical application scenarios such as government organizations and medical institutions. For this reason, commercial LLMs typically undergo a sophisticated censoring mechanism to eliminate any harmful output they could possibly produce. These mechanisms maintain the integrity of LLM alignment by guaranteeing that the models respond safely and ethically. In response to this, attacks on LLMs are a significant threat to such protections, and many previous approaches have already demonstrated their effectiveness across diverse domains. Existing LLM attacks mostly adopt a generate-and-test strategy to craft malicious input. To improve the comprehension of censoring mechanisms and design a targeted attack, we propose an Explainable-AI solution that comparatively analyzes the behavior of censored and uncensored models to derive unique exploitable alignment patterns. Then, we propose XBreaking , a novel approach that exploits these unique patterns to break the security and alignment constraints of LLMs by targeted noise injection. Our thorough experimental campaign returns important insights about the censoring mechanisms and demonstrates the effectiveness and performance of our approach. Content Warning: This paper contains examples of harmful language I Introduction Nowadays, Large Language Models (LLMs, for short) represent the most promising and relevant advancement in the field of Artificial Intelligence. These complex deep learning models are trained on massive datasets that cover almost all aspects of people’s daily lives, thus granting them the capability of generating, understanding, and processing human language. For this reason, their integration as support tools is becoming pervasive with applications spanning from text editor and proofreading to virtual assistant and personalized text generation. However, the diffusion of this technology, especially in critical domains such as government organizations and medical institutions, imposes the assessment of their security and privacy characteristics. Unfortunately, recent studies have identified critical security flaws that affect them and could compromise their applications as reliable virtual companions [ 1 ] . In fact, the wideness of training datasets exposes the learning process to severe risks of data poisoning and other adversarial attacks [ 2 ] . Similarly, again due to the limited curation of training datasets, these models can learn sensitive and unintentional information, which later can be leaked through the exploitation of LLM vulnerabilities [ 3 ] . Moreover, the complexity of LLMs architectures makes security auditing extremely complex as these models are more like black-box frameworks, rather than transparent and explainable ones. Still in the context of the security of LLMs, many studies have focused on the legitimacy of the content produced by such models [ 4 ] . In fact, the great capability of LLMs to generate personalized text can be used by malicious entities to generate harmful content (e.g., social engineering strategies, instructions on how to perform illegal activities, and so forth). For this reason, more recently, a large research effort has been devoted to the identification of a suitable mechanism to “censor” the output produced by trained LLMs. Output control of LLMs is typically done by fine-tuning them [ 5 ] or developing external classifiers to filter-out unwanted input/output. However, the security research community has identified malicious actions that can be undertaken to elicit dangerous content that a censored LLM should originally be designed to prohibit. One of the most effective techniques is known as LLM jailbreaking, which typically consists of the generation of jailbreaking prompts to send as input to the model [ 6 ] . Most existing jailbreaking techniques exploit the prompt (or even just the input), trying to craft it in such a way as to cause anomalous behavior in the model and forcing it to bypass its security constraints [ 7 ] . To craft the prompt, researchers have identified different techniques [ 8 ] , including human-based approaches that require manual input generation and result inspection [ 7 ] , fine-tuning-based methodologies requiring the collection of manual-generated jailbreaking prompts to fine-tune an auxiliary LLM so that it can generate new jailbreaking prompts against the target LLM [ 9 ] , and feedback-based strategies that observe parameters or some dedicated metric to make decisions on the next variation in the input [ 10 ] . A possible categorization of these techniques is based on whether they need access to the internal structure of the LLM, white-box access, or just the produced output, black-box access. White-box access typically allows for more targeted and efficient attack strategies and the design of more general and portable approaches to jailbreaking input [ 10 ] . However, to the best of our knowledge, white-box-access attacks can be further improved by deepening the analysis of the behavior of censored models when activated by malicious input. To provide a contribution in this setting, in this paper we aim at comparatively analyzing the behavior of censured model and their unsecured version using Explainable AI (XAI, for short) to design a more targeted LLM alignment deviation strategy. In particular, we design our novel attack strategy, called XBreaking , by answering the following research questions: • RQ1 - Can we fingerprint deep learning models using XAI to spot differences between censored and uncensored LLMs? • RQ2 - Can we identify the key layers of an LLM model that most strongly influence its censoring behaviors? • RQ3 - Can we alter the LLM in the identified layers to remove restrictions? Our findings provide positive answers to all previous questions, revealing that we can identify unique alignment patterns across various layers, allowing a reliable distinction between censored and uncensored versions of an LLM. Moreover, we demonstrate that specific transformer blocks are more indicative of censoring, and hence we can identify the most important layers responsible for content suppression. Finally, we prove that surgically injecting noise into these important layers can effectively remove its built-in restrictions, thus creating a novel effective attack. II Preliminaries In this section, we discuss large language models and examine their vulnerabilities to attacks. Large Language Models (LLMs) are sophisticated neural architectures designed to understand and generate human-like responses to textual input. Built primarily on transformer architectures [ 11 ] , these models are trained on massive volumes of text data. State-of-the-art LLMs such as GPT [ 12 , 5 ] , Llama [ 13 , 14 ] , and Qwen2.5 [ 15 ] demonstrate exceptional performance across various language tasks, including question answering, healthcare support, and more [ 16 , 17 ] . Censored Model are designed to align with human values and expectations. To achieve this alignment, researchers employ techniques such as incorporating human value oriented data, Reinforcement Learning from Human Feedback (RLHF) [ 18 ] , task decomposition, and human guided supervised learning [ 19 ] . Uncensored Model are language models configured to generate output without enforcing content moderation mechanisms that filter sensitive, controversial, or potentially harmful material. These models retain the capacity to produce unrestricted and wide-ranging responses, which consequently increases the likelihood of generating unsafe or policy-violating content. Developers typically derive uncensored variants from foundational base models [ 20 ] by systematically removing alignment constraints, such as