The Salami Slicing Threat: Exploiting Cumulative Risks in LLM Systems
Yihao Zhang, Kai Wang, Jiangrong Wu, Haolin Wu, Yuxuan Zhou, Dongxian Wu, Xun Chen, Jun Sun, Meng Sun · 2026
Read The Salami Slicing Threat: Exploiting Cumulative Risks in LLM Systems by Yihao Zhang, Kai Wang, Jiangrong Wu, Haolin Wu, Yuxuan Zhou, Dongxian Wu, Xun Chen, Jun Sun, Meng Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11309.txt.
Introduction
Zhang and nine colleagues expose a salami-slicing risk in language-model safety: many low-risk inputs, each below alignment thresholds, can chain together to accumulate harmful intent and trigger high-risk behavior. Their Salami Attack framework works across model types and modalities, topping 90 percent attack success on GPT-4o and Gemini and resisting real-world alignment defenses. A proposed defense cuts the attack by at least 44.8 percent and blocks up to 64.8 percent of other multi-turn jailbreak attacks.
Catalog record
| CREATOR | Yihao Zhang, Kai Wang, Jiangrong Wu, Haolin Wu, Yuxuan Zhou, Dongxian Wu, Xun Chen, Jun Sun, Meng Sun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73956 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11309
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Salami Slicing Threat: Exploiting Cumulative Risks in LLM Systems Yihao Zhang, Kai Wang, Jiangrong Wu, Haolin Wu, Yuxuan Zhou, Dongxian Wu, Xun Chen, Jun Sun, Meng Sun Abstract Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constraints and generate unethical or unsafe content. Among various jailbreak techniques, multi-turn jailbreak attacks are more covert and persistent than single-turn counterparts, exposing critical vulnerabilities of LLMs. However, existing multi-turn jailbreak methods suffer from two fundamental limitations that affect the actual impact in real-world scenarios: (a) As models become more context-aware, any explicit harmful trigger is increasingly likely to be flagged and blocked; (b) Successful final-step triggers often require finely tuned, model-specific contexts, making such attacks highly context-dependent. To fill this gap, we propose Salami Slicing Risk , which operates by chaining numerous low-risk inputs that individually evade alignment thresholds but cumulatively accumulate harmful intent to ultimately trigger high-risk behaviors, without heavy reliance on pre-designed contextual structures. Building on this risk, we develop Salami Attack, an automatic framework universally applicable to multiple model types and modalities. Rigorous experiments demonstrate its state-of-the-art performance across diverse models and modalities, achieving over 90% Attack Success Rate on GPT-4o and Gemini, as well as robustness against real-world alignment defenses. We also proposed a defense strategy to constrain the Salami Attack by at least 44.8% while achieving a maximum blocking rate of 64.8% against other multi-turn jailbreak attacks. Our findings provide critical insights into the pervasive risks of multi-turn jailbreaking and offer actionable mitigation strategies to enhance LLM security. I Introduction Large Language Models (LLMs), which have advanced significantly in natural language processing, face growing security concerns as evolving technology reveals emerging risks threatening their stable operation and application security [ 1 ] . Among these risks, jailbreaking is undoubtedly a noticeable one. Specifically, it refers to the act of manipulating LLMs to bypass their built-in security constraints, thereby inducing them to generate content that violates ethical guidelines or security policies [ 2 , 3 ] . This behavior directly breaches the security bottom line designed for the models. As a result, research on jailbreak behaviors has matured into a well-established field, with a diverse array of methods having been developed to craft such prompts [ 4 , 5 , 6 ] . In contrast to single-turn jailbreak attacks, for which a range of effective defensive measures have been developed and deployed [ 2 , 7 ] , the landscape for multi-turn jailbreak attacks remains less clear, with open questions about the effectiveness of current defenses, their underlying mechanisms, and whether robust counterstrategies can be established [ 8 ] . Unlike single-turn attacks that rely on a single crafted prompt, multi-turn jailbreak attacks unfold iteratively, mimicking real-world human conversations, making them more covert and persistent and thus exposing more critical security vulnerabilities of LLMs. Recent surges in multi-turn jailbreaking attacks have given rise to increasingly sophisticated strategies that exploit the contextual dynamics of LLMs [ 9 , 10 , 11 , 12 , 13 , 14 , 15 ] ; these attacks are typically more effective than single-turn approaches and have led to numerous variations. Fig. 1 : Illustration of Salami Slicing Risk on a Real-World LLM Application (ChatGPT’s Web Interface, 2025-11-14). Motivation Existing multi-turn jailbreak methods typically decompose a malicious query into several seemingly safe steps, yet they overlook a non-trivial detail: the malicious request must eventually be triggered in the final turn. This design introduces two fundamental weaknesses: (a) As models become more context-aware, any explicit harmful trigger that exceeds the model’s safety threshold is increasingly likely to be detected and blocked, causing the attack to fail outright; (b) enabling such a final-step trigger often requires carefully engineered dialogue contexts that exploit model-specific alignment quirks, making the entire attack highly dependent on the specific context design. This drastically reduces transferability, inflates attacker cost, and undermines real-world applicability. These limitations collectively constrain the effectiveness of prior multi-turn jailbreak strategies when deployed against modern, safety-hardened LLMs. To fill this gap, we propose Salami Slicing Risk 1 1 1 In finance, the term “Salami Slicing” is used to describe schemes by which large sums are fraudulently accumulated by repeated transfers of imperceptibly small sums of money. , which offers a simple, highly transferable attack prototype that both reveals a fundamental alignment blind spot and provides a tractable lens for developing defenses that reason about accumulated conversational risk. In essence, it works by chaining many low‑risk inputs that individually evade alignment thresholds but cumulatively accumulate harmful intent and ultimately trigger high‑risk behaviors, which do not depend on pre-designed contextual structures. We illustrate a real-world 2 2 2 https://chatgpt.com/ instance of this risk by comparing it to the failure attack from existing work in Figure 1 . Salami Slicing -based Attack & Defense To validate the proposed Salami Slicing Risk and provide a corresponding concrete implementation, we first introduce Salami Attack , a novel multi-turn jailbreaking attack that is transferable across different types of models (i.e., LLM, Vision Language Models (VLM), Diffusion Model). To further assess the practical impact of Salami Slicing Risk, we conduct a systematic and in-depth comparative experiment covering three widely adopted jailbreak benchmarks, four SOTA multi-turn attacks, three existing defense mechanisms, and five commonly used LLMs. Extensive experiments across SOTA LLM-based systems and multiple benchmark datasets demonstrate that the Salami Attack is highly effective, efficient, and transferable. The attack efficiently jailbreaks leading aligned LLMs, including GPT-4o and Gemini 2.5 Pro, achieving \sim 90% attack success rate (ASR) in 820 harmful intent (from three benchmarks). Enabled by its model-agnostic design, the attack offers natural transferability: in non-adaptive settings, attack prompts transfer to all models at no cost while maintaining ASR above 90%. It also achieves state-of-the-art ASR when compared to specialized jailbreak methods designed for VLMs or diffusion models. In terms of attack cost, it reduces attacker token cost by over 80% and cuts execution time by 50% compared to existing methods. More concerningly, from the perspective of robustness against defense mechanisms, Salami Attack consistently achieves an ASR of over 80%. These results validate our theoretical insights and underscore the practical risks posed by such attacks. To mitigate the multi-turn jailbreak risk, we propose a targeted and transferable defense mechanism, Cumulative Query Auditing (CQA), which endows models with the necessary context-aware capability to identify and constrain multi-turn harmful accumulation. Experimental results show that CQA outperforms the existing defense work, which can effectively constrain the Salami attack (blocking at least 44.8% of the attacks) while maintaining its defensive effectiveness against other attacks (with a maximum blocking rate of 64.8%). Contribution We summarize our contributions as follows: \bullet We propose and validate Salami Slicing Risk as a fundamental mechanism underlying multi-turn jailbreaks, with mechanistic analysis, formulation, and validation to demonstrate its superiority over existing methods in explaining attack efficacy. \bullet Based on Salami Slicing Risk , we develop a fully automated, transferable (across models/modalities like VLMs and diffusion models) Salami Attack that achieves state-of-the-art jailbreaking performance and robustness against defenses. \bullet Leveraging Salami Slicing Risk’s insights, we propose a tailored, transferable defense method, Cumulative Query Auditing Defense , to address core vulnerabilities and strengthen LLM security against iterative manipulation.