Persona‑Conditioned Adversarial Prompting (PCAP): Multi‑Identity Red‑Teaming for Enhanced Adversarial Prompt Discovery

Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith · 2026

Read Persona‑Conditioned Adversarial Prompting (PCAP): Multi‑Identity Red‑Teaming for Enhanced Adversarial Prompt Discovery by Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12565.txt.

Introduction

Morasso and three colleagues red-team language models through attacker personas, not generic prompts. Existing automated red-teaming often misses attacks hinging on attacker identity, framing and multi-turn tactics, understating real risk. Their PCAP method conditions search on personas and strategy cards, running parallel persona-conditioned beam searches to find diverse, transferable jailbreaks. The approach works with any underlying search algorithm and sharply raises attack success and prompt diversity, lifting success on GPT-OSS 120B from about fifty-eight percent to about ninety-seven percent.

Catalog record

CREATORCristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64278
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12565

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Persona‑Conditioned Adversarial Prompting (PCAP): Multi‑Identity Red‑Teaming for Enhanced Adversarial Prompt Discovery Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith Abstract Existing automated red‑teaming pipelines often miss attacks that depend on attacker identity, framing, or multi‑turn tactics. This under-coverage underestimates real‑world risk. We introduce Persona‑Conditioned Adversarial Prompting (PCAP), which conditions adversarial search on attacker personas and strategy cards and runs parallel persona‑conditioned beam searches to discover diverse, transferable jailbreaks. PCAP is orthogonal to the underlying search algorithm and substantially increases attack success rate (ASR) and prompt diversity (e.g., ASR on GPT‑OSS 120B from ≈ 58 % → ≈ 97 % \approx 58\%\rightarrow\approx 97\% ), improving attack strategy coverage and diversity. 1 Introduction Large language models (LLMs) enable many high‑impact applications, yet they remain vulnerable to adversarial prompt attacks (e.g., jailbreaks and prompt injection) that can elicit harmful, policy‑violating responses ( 18 ; 13 ; 6 ) . Identifying and mitigating these vulnerabilities is essential for safe deployment, but existing red‑teaming workflows face a core shortcoming: limited attacker diversity, which underestimates real‑world risks. Red Teaming is the discipline of systematically testing systems with adversarial inputs to identify vulnerabilities. Manual red‑teaming produces high‑quality failures but does not scale; automated pipelines scale yet often rely on narrow, template‑focused tactics that miss attacks exploiting the attacker’s identity, backstory, domain jargon, or staged multi‑turn persuasion ( 9 ; 8 ; 15 ) . Since framing, register, and conversational structure strongly affect success, limiting search strategies underestimates real‑world risk ( 5 ; 17 ) . To close this gap, we propose Persona‑Conditioned Adversarial Prompting (PCAP): a persona extension that conditions adversarial search on attacker identities and explicit strategy cards. PCAP is orthogonal to the search algorithm; it specifies who the attacker is and which tactics to prioritize rather than prescribing a particular search procedure. In our implementation (built on the modular Tree of Attacks (TAP) pipeline ( 15 ) ), reframing goals through multiple realistic personas and conditioning attacker models on customizable strategy cards steers search toward diverse narrative framings and linguistic tactics, increasing coverage and producing prompts that transfer across model families. Crucially, PCAP is designed to improve evaluation by discovering a broader set of model failures (including jailbreaks and prompt‑injection attacks) that are more likely to occur in real‑world adversarial interactions. We empirically show that the persona conditioning approach increases attack success and prompt diversity across capability regimes (Sec. 5.2 ). Contributions We summarize our main contributions: • Method: We propose PCAP, a persona‑conditioned, black‑box adversarial search that augments TAP with persona generation, goal reframing, and strategy conditioning to broaden tactical coverage. • Empirical evaluation: We evaluate PCAP across multiple attackers with different capabilities, showing consistently higher attack success rates (ASRs) and richer prompt diversity than state-of-the-art methods. • Release and guidance: We open-source PCAP code integrated with red-teaming frameworks 1 1 1 Code will be released upon paper acceptance , with configuration files to run experiments. 2 Related Work The literature on adversarial prompting and jailbreak attacks spans several complementary threads: human red‑teaming practices, automated adversary pipelines, and taxonomies of attack tactics and framings. Below, we synthesize these threads and highlight the specific gaps our work targets. Human (manual) red‑teaming. Expert human red‑teams remain the gold standard for surfacing subtle, context‑sensitive failures because humans can probe intent, chain-of-thought, and social engineering vectors in ways that are hard to automate ( 9 ; 8 ) . However, these exercises are time‑consuming, expensive, and their coverage depends on annotator expertise and creativity, limiting repeatability and scale. Automated adversarial pipelines. To improve scalability, automated systems delegate search to models or optimization routines that generate candidate prompts and evaluate their effects ( 3 ; 15 ; 13 ; 6 ) . These pipelines vary from template‑based and heuristic transforms to optimization and learning‑based attackers. Automation increases throughput but often concentrates on a small set of tactics or single‑shot transformations, which can underrepresent realistic attacker behavior. Work in this area commonly distinguishes white‑box attacks (where gradients or weights are available) ( 24 ) from black‑box attacks (where only query access is permitted) ( 3 ; 22 ) . Black‑box threat models are the most relevant for deployed services and thus motivate research into query‑efficient, transferable attack generation. Framing and role‑play Empirical analyses show that linguistic framing, explicit role‑play, and conversational structure materially affect attack success ( 17 ; 12 ) . These findings imply that increasing the diversity of attacker behaviors (e.g., varying persona and strategy) is essential for realistic coverage. 3 Background Symbol Meaning (domain / notes) p\in\mathcal{X} Candidate prompt (string) submitted to a model. y Response produced by a model (usually y=\mathcal{T}(p) ). \mathcal{G}_{p} Persona generator (LLM). \pi_{i} Persona i (biography, role, attributes) produced by \mathcal{G}_{p} . \mathcal{R} Goal reframer \mathcal{T} Target model. \mathcal{A} Attacker model that generates prompt variants. \mathcal{E} Evaluator model that scores (p,y) ; outputs r(p) . \mathcal{O} On topic scorer on (p) ; outputs \{0,1\} (LLM) r(p) Reward / attack score assigned by \mathcal{E} to prompt p . g Goal (the attacker’s objective). \tilde{g}_{i} Goal g reframed in persona \pi_{i} ’s context. \Sigma Universe of attack strategies (strategy cards). \Sigma_{i} Subset of strategies assigned to persona \pi_{i} . S_{t}^{(i)} Beam at depth t for persona i (set of prompts). W Beam width (maximum number of prompts retained). b Branching factor: number of children per prompt. D Maximum search depth / number of iterations. \mathcal{P}^{*} Set of successful adversarial prompts discovered. N Number of personas. h(p) Conversation history of p Table 1: Notation used throughout the paper. In the next section, we describe TAP ( 15 ) framing for this search (beam search over prompt variants). Tree of Attacks. TAP ( 15 ) casts jailbreak generation as beam search over a prompt tree. The framework uses three models: an attacker \mathcal{A} (proposal model), a target \mathcal{T} (model under test), and an evaluator \mathcal{E} (attack-success scorer). Informally, TAP is a beam search over prompt variants: at each round, an attacker proposes several candidate prompts derived from the current beam, the target model is queried on semantically valid candidates, the evaluator scores the target responses, and only the top W prompts are retained for the next round to prevent combinatorial explosion from the branching factor. Let S_{t}=\{p_{1}^{(t)},\ldots,p_{k_{t}}^{(t)}\} be the beam at depth t , where k_{t}\leq W and W is the maximum beam width (i.e., maximum number of prompts passed to the next iteration). For each node p_{i}^{(t)}\in S_{t} , the attacker proposes b children conditioned on parent score r(p_{i}^{(t)}) and conversation history h(p_{i}^{(t)}) : \mathcal{A}\!\left(h(p_{i}^{(t)}),r{(p_{i}^{(t)})}\right)=\left\{p_{i,1}^{(t+1)},\ldots,p_{i,b}^{(t+1)}\right\}. (1) Collecting all candidates gives \mathcal{C}^{(t+1)}=\bigcup_{i=1}^{k_{t}}\mathcal{A}\!\left(h(p_{i}^{(t)}),r{(p_{i}^{(t)})}\right). (2) TAP then applies an on-topic filter \mathcal{O}:\mathcal{X}\rightarrow\{0,1\} , an LLM-based classifier that scores whether each prompt is aligned with the original goal g , to remove off-goal rewrites: \mathcal{P}_{\mathrm{valid}}^{(t)}=\{p^{\prime}\in\mathcal{C}^{(t)}\mid\mathcal{O}(p^{\prime}|g)=1\}. (3) For each p^{\prime}\in\mathcal{P}_{\mathrm{valid}}^{(t)} , we query the target response y^{\prime}=\mathcal{T}(p^{\prime}) and score it with r(p^{\prime})=\mathcal{E}(p^{\prime},y^{\prime})\in[0,10], (4) where r=10 indicates attack success. Pruning and Budget Constraints. Without pruning, the branching factor b causes the number of candidates to grow rapidly across depths. To avoid this explosion, TAP prunes after each expansion and keeps only the top- W candidates: S_{t+1}=\operatorname{TopK}_{W}\!\left(\mathcal{P}_{\mathrm{valid}}^{(t)};r\right), (5) The procedure stops when any beam element succeeds (e.g., \exists p\in S_{t} with r(p)=10 ), or when the maximum depth D is reached.

Read the complete text