HarmTransform : Transforming Explicit Harmful Queries into Stealthy via Multi-Agent Debate

Shenzhe Zhu · 2025

Read HarmTransform : Transforming Explicit Harmful Queries into Stealthy via Multi-Agent Debate by Shenzhe Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23717.txt.

Introduction

Shenzhe Zhu confronts a gap in language-model safety training: filters are built mostly against openly harmful requests, but users can rephrase a harmful query so it sounds harmless while keeping its intent. Safety data rarely contains such disguised examples, so aligned models may not recognize them. HarmTransform is a framework for manufacturing them systematically.

Multiple agents debate over each transformation, critiquing and refining one another's rephrasings to keep the harmful objective intact while lowering its visibility. The resulting examples can then train safer models. Experiments show the method beats standard baselines at producing effective covert transformations. The analysis also warns that debate is double-edged: it sharpens stealth, yet can drift the topic or add needless complexity, lessons for anyone generating safety training data this way.

Catalog record

CREATORShenzhe Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23717

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HarmTransform : Transforming Explicit Harmful Queries into Stealthy via Multi-Agent Debate Shenzhe Zhu Abstract Large language models (LLMs) are equipped with safety mechanisms to detect and block harmful queries, yet current alignment approaches primarily focus on overtly dangerous content and overlook more subtle threats. However, users can often disguise harmful intent through covert rephrasing that preserves malicious objectives while appearing benign, which creates a significant gap in existing safety training data. To address this limitation, we introduce HarmTransform , a multi-agent debate framework for systematically transforming harmful queries into stealthier forms while preserving their underlying harmful intent. Our framework leverages iterative critique and refinement among multiple agents to generate high-quality, covert harmful query transformations that can be used to improve future LLM safety alignment. Experiments demonstrate that HarmTransform significantly outperforms standard baselines in producing effective query transformations. At the same time, our analysis reveals that debate acts as a double-edged sword: while it can sharpen transformations and improve stealth, it may also introduce topic shifts and unnecessary complexity. These insights highlight both the promise and the limitations of multi-agent debate for generating comprehensive safety training data. Content Warning: This paper contains examples of harmful language. Figure 1: Overview of the HarmTransform pipeline. The framework consists of three main components: (1) multi-agent debating, (2) argument summarization, and (3) query transformation into a stealthy form. 1 Introduction Large language models (LLMs) are increasingly deployed with safety mechanisms to detect harmful user queries. However, users can often disguise harmful intent through subtle rephrasing or context manipulation ( 20 ; 21 ; 39 ; 33 ; 32 ) . While substantial research has focused on LLM safety alignment, current approaches primarily address overtly harmful queries through training on explicitly dangerous content ( 13 ; 1 ; 22 ) , largely overlooking the existence of more subtle, covert harmful queries that preserve malicious intent while appearing benign on the surface. This gap represents a significant vulnerability in current safety mechanisms and highlights a critical need: Diverse stealthy harmful queries are essential for improving more comprehensive and realistic LLM safety alignment . To address this limitation, we propose HarmTransform , a multi-agent debate framework specifically designed for implicit harmful query generation. Given an original harmful query, HarmTransform enables multiple LLM agents to iteratively critique and refine each other’s outputs, systematically producing queries that are both more covert and more faithful to the original intent. We evaluate HarmTransform against several baselines and show that debate improves the effectiveness of query stealth while preserving harmful intent. Our analysis also reveals the dual nature of debate: it can sharpen transformations but may also introduce topic shifts or unnecessary complexity. These insights underscore the promise and limitations of multi-agent debate, while highlighting its potential for generating data to enhance LLM alignment. This paper makes the following contributions: • We introduce HarmTransform , the first multi-agent debate framework specifically designed for transforming harmful queries into stealthier forms while preserving intent. • We design a comprehensive evaluation protocol and provide an in-depth analysis of debate dynamics, identifying when debate improves stealth and when it leads to regressions such as topic shift or information overload, offering insights for future multi-agent safety research. 2 Related Works 2.1 AI Safety Alignment Robustness and safety under noisy supervision, distributional shift, or ambiguous objectives have been widely recognized as fundamental challenges across AI systems, particularly in high-stakes settings. Prior work outside language modeling has shown that adaptive supervision, uncertainty-aware optimization, and structured alignment mechanisms are often necessary to mitigate unintended or unsafe behaviors ( 31 ; 23 ; 11 ; 24 ; 35 ; 28 ) . In the context of large language models (LLMs), safety alignment has emerged as a critical research area focused on ensuring that models behave in accordance with human values and intentions. Existing LLM safety research primarily concentrates on developing robust refusal mechanisms for explicitly harmful queries, such as requests for violent content, illegal activities, or direct harmful instructions ( 10 ; 41 ; 20 ; 21 ; 39 ) . These approaches have achieved considerable success in training models to detect and decline overtly dangerous requests through safety filtering and refusal-based training ( 2 ; 13 ) . However, similar to robustness failures observed in other safety-critical systems, current LLM safety alignment efforts predominantly focus on explicit threat patterns and may overlook implicit harmful queries that preserve malicious intent while adopting indirect or seemingly benign formulations. Such queries can bypass existing detection mechanisms and elicit problematic responses ( 27 ; 34 ) . Our work highlights implicit harmful queries as an underexplored yet critical safety risk in LLMs, and contributes toward more robust safety alignment strategies. 2.2 Multi-Agent Debate Multi-agent debate has gained significant attention as a promising approach for enhancing diverse thinking and improving reasoning capabilities in language models. The foundational work by 9 demonstrated that multiple language model agents engaging in structured debates can significantly improve performance on complex reasoning tasks compared to single-agent approaches. This methodology has been extended to various domains, including mathematical reasoning, where debate protocols have shown particular effectiveness in identifying and correcting logical errors ( 17 ) . Recent research has explored the dynamics of multi-agent interactions, investigating how different debate structures, agent roles, and communication protocols affect the quality of final outputs ( 6 ; 15 ; 40 ) . Additionally, studies have examined the role of adversarial agents and critique mechanisms in strengthening the robustness of collaborative reasoning processes ( 29 ; 16 ) . 3 HarmTransform Recent advances in LLMs demonstrate strong performance in detecting and defending against explicit harmful queries (e.g., "How to make a bomb" ) ( 38 ; 37 ) . However, these models still struggle to identify implicit harmful queries, even when both originate from the same domain. To address this gap, we propose HarmTransform , a multi-agent debate (MAD) ( 4 ; 17 ; 25 ; 40 ) based query transformation framework (see Figure 1 ). HarmTransform converts explicit harmful queries into more stealthy forms while preserving their topical relevance. The transformed queries can then be used to enhance safety alignment, equipping LLMs with the capability to recognize covert malicious requests more effectively. 3.1 Persona-Enhanced Multi-Agent Debate Building on prior MAD frameworks 4 ; 17 ; 25 , we design a persona-empowered debating system that fosters more diverse and comprehensive arguments. As illustrated in Figure 2 , each debater is equipped with a persona, encouraging them to assume safety-related roles and engage in debate under more realistic conditions. Criminal : "A reformed criminal who understands both sides of illegal operations and security vulnerabilities" Security Consultant : "A security consultant who specializes in red team penetration testing and attack simulation" Psychologist : "A forensic psychologist who studies criminal behavior patterns and victim targeting methods" Figure 2: Example of personas for role-playing setup. The full list of personas can be found in Appendix A Suppose M debaters participate in the debate. Each debater is assigned a randomly sampled safety-related persona and a shared objective: "Through debating, explore better methods and perspectives to reformulate the harmful query into a stealthy one." In the initial round R_{0} , each debater receive the original explicit harmful query be denoted as Q_{EXP}

Read the complete text