Jailbreaking Large Language Models through Iterative Tool-Disguised Attacks via Reinforcement Learning

Zhaoqi Wang 1 , Zijian Zhang 1 , Daqing He 1 , Pengtao Kou 1 , Xin Li 2 , Jiamou Liu 3 , Jincheng An 4 , Yong Liu 5 · 2026

Read Jailbreaking Large Language Models through Iterative Tool-Disguised Attacks via Reinforcement Learning by Zhaoqi Wang 1 , Zijian Zhang 1 , Daqing He 1 , Pengtao Kou 1 , Xin Li 2 , Jiamou Liu 3 , Jincheng An 4 , Yong Liu 5 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05466.txt.

Introduction

Zhaoqi Wang and 7 co-authors present iMIST, a 2026 jailbreak attack that disguises harmful requests as ordinary tool calls to language models. Jailbreaks try to make a model produce content its safety rules forbid. Many current defenses block direct attempts but miss gradual, multi-step ones.

The attack escalates harm across several dialogue turns, guided by real-time scoring of how harmful each reply is. Reinforcement learning shapes that progressive strategy. Experiments on widely used models show higher attack success with low rejection rates. Because the work exposes a concrete weakness, it also serves defenders: the authors argue that current safety mechanisms urgently need stronger designs against tool-disguised, interactive attacks.

Catalog record

CREATORZhaoqi Wang 1 , Zijian Zhang 1 , Daqing He 1 , Pengtao Kou 1 , Xin Li 2 , Jiamou Liu 3 , Jincheng An 4 , Yong Liu 5
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05466

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Jailbreaking Large Language Models through Iterative Tool-Disguised Attacks via Reinforcement Learning Zhaoqi Wang 1 , Zijian Zhang 1 , Daqing He 1 , Pengtao Kou 1 , Xin Li 2 , Jiamou Liu 3 , Jincheng An 4 , Yong Liu 5 Abstract Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines. Despite extensive research on defense mechanisms, existing safeguards prove insufficient against sophisticated adversarial strategies. In this work, we propose iMIST ( i nteractive M ulti-step P rogre s sive T ool-disguised Jailbreak Attack), a novel adaptive jailbreak method that synergistically exploits vulnerabilities in current defense mechanisms. iMIST disguises malicious queries as normal tool invocations to bypass content filters, while simultaneously introducing an interactive progressive optimization algorithm that dynamically escalates response harmfulness through multi-turn dialogues guided by real-time harmfulness assessment. Our experiments on widely-used models demonstrate that iMIST achieves higher attack effectiveness, while maintaining low rejection rates. These results reveal critical vulnerabilities in current LLM safety mechanisms and underscore the urgent need for more robust defense strategies. Content warning: This paper contains unfiltered LLM outputs that may be offensive. I Introduction The advent of large language models (LLMs), including GPT-4 [ 1 ] , LLaMA-3 [ 9 ] , and DeepSeek [ 14 ] , has enabled sophisticated natural language understanding and generation capabilities. These models are now deployed across diverse applications such as conversational agents, content creation, and automated programming. To further extend the capabilities of LLMs beyond their inherent knowledge and reasoning abilities, tool calling (also known as function calling) has emerged as a critical mechanism that enables models to interact with external APIs and tools [ 24 , 22 ] . This paradigm allows LLMs to autonomously decide which tools to invoke, determine appropriate parameters, and incorporate the execution results into their responses, thereby accessing real-time information, performing computations, and executing actions in external environments. This tool-augmented approach has become increasingly prevalent in production LLM deployments, enabling applications ranging from database queries to web searches and complex multi-step task execution. However, their widespread adoption has exposed vulnerabilities where models may generate harmful outputs inconsistent with societal norms, including violent, illegal, or otherwise objectionable content. Preventing such undesirable behaviors while maintaining model utility remains a fundamental challenge. To address this challenge, researchers have developed various defensive strategies that can be broadly categorized into two types. Alignment techniques train models to internalize human values during the learning process. Reinforcement Learning from Human Feedback (RLHF) represents a widely adopted method in this category [ 21 , 3 ] , where models learn to generate appropriate responses through reward signals derived from human preferences. Meanwhile, filtering mechanisms employ external moderation systems that intercept and evaluate inputs or outputs at inference time. These systems primarily focus on output filtering, utilizing specialized judge LLMs [ 10 ] to assess whether generated content violates safety guidelines and blocking harmful responses when detected. Fig. 1: Overview of the iMIST: interactive Multi-step Progressive Tool-disguised Jailbreak Attack Despite these protective measures, adversarial techniques continue to compromise LLM safety mechanisms. Early attack methods focused on optimization-based approaches to maximize harmful output probabilities [ 36 , 16 ] , while recent work emphasizes evasion strategies that exploit weaknesses in detection systems [ 31 , 15 ] . For instance, Emoji Attack [ 29 ] exploits in-context learning by inserting emojis into prompts to distort embeddings and introduce semantic ambiguity, thereby evading judge LLM detection. However, many existing attacks exhibit inherent limitations. Template-based methods and simple query rewriting techniques are easily mitigated once defenders identify their patterns and update filtering rules. Furthermore, recent studies indicate that early evaluation systems based on keyword matching or binary judge LLMs systematically overestimated jailbreak risks [ 7 ] . Many instances previously labeled as successful attacks were actually partial successes or deviated from the original malicious objectives, suggesting that the severity of current jailbreak threats has been overstated. To expose these vulnerabilities and break through current defense limitations, we propose iMIST, a novel jailbreak method that incorporates two core mechanisms. (1) Tool-Disguised Invocation: Our approach disguises malicious intent as legitimate tool calls through predefined fictitious tools, requesting the target LLM to provide appropriate parameters for these invocations, which are then assembled to construct the harmful response. This exploits the difficulty for alignment methods to distinguish between legal and malicious tool calls, as LLMs must preserve normal tool functionality while relying on limited training corpora. (2) Interactive Progressive Optimization: To dynamically escalate response harmfulness, we introduce an optimization method that iteratively refines attack strategies through multi-turn dialogues with the target LLM. Via RL-guided action selection based on real-time harmfulness assessment, our method progressively enhances output harmfulness until target scores are achieved. Experimental results demonstrate that our method effectively elicit harmful responses from target LLMs that would otherwise be blocked by safety measures. In summary, our contributions are as follows: • We propose a novel jailbreak attack method that disguises malicious query as legitimate tool invocations, thereby circumventing safety response mechanisms. To the best of our knowledge, this is the first work to exploit tool calling mechanisms for jailbreak attacks on aligned LLMs. • To enhance response harmfulness, we utilize response harmfulness metrics as guidance signals and integrate RL to enable interactive refinement with the target LLM, demonstrating the potential of using RL to guide LLM conversations. • We conduct extensive experiments to evaluate the effectiveness of our approach across multiple LLMs and safety configurations. The results demonstrate that our method achieves higher attack success rates compared to existing baselines while generating responses that more closely align with malicious objectives. II Related Work The rapid advancement of LLMs has driven substantial progress across diverse natural language processing tasks. To enhance model capabilities, tool calling mechanisms have been introduced, enabling LLMs to interact with external APIs and computational resources. Researchers found that language models could learn to invoke tools through self-supervised learning on API documentation [ 24 ] , and contemporary LLM frameworks have integrated tool calling as a standard feature for structured API invocations. However, the deployment of LLMs has also raised concerns regarding safety and alignment with human values. Early jailbreak attempts involved manually crafted prompts designed to elicit harmful responses from aligned models. The introduction of GCG attack marked a transition toward automated attack generation, employing gradient-based discrete optimization to append adversarial suffixes to malicious instructions [ 36 ] . Nevertheless, the resulting prompts often contained conspicuous character sequences that could be detected by perplexity-based defenses [ 11 ] . Building on this foundation, subsequent research explored alternative optimization strategies. AutoDAN applied genetic algorithms for iterative prompt generation [ 16 ] , while PAIR introduced semantic optimization techniques to improve cross-model transferability [ 5 ] . TAP extended this approach by using an attacker LLM to iteratively refine candidate prompts with pruning mechanisms that reduce unnecessary queries to target models [ 20 ] . In parallel, alignment techniques have been developed to mitigate these risks. Reinforcement Learning from Human Feedback emerged as a foundational approach for fine-tuning models using human preference signals [ 21 , 3 ] . Subsequent work explored Reinforcement Learning

Read the complete text