Persona-Conditioned Adversarial Prompting: Multi-Identity Red-Teaming for Adversarial Discovery and Mitigation

Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith · 2026

Read Persona-Conditioned Adversarial Prompting: Multi-Identity Red-Teaming for Adversarial Discovery and Mitigation by Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11730.txt.

Introduction

Cristian Morasso and three colleagues probe a blind spot in safety testing for large language models in a 2026 paper. Their method, Persona-Conditioned Adversarial Prompting, steers jailbreak searches with varied attacker personas, from doctors to malicious actors, so the search covers realistic threats rather than one narrow slice. On GPT-OSS 120B it lifted attack success from 57 percent to 97 percent, and fine-tuning on its output raised defense recall markedly.

Catalog record

CREATORCristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80316
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11730

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Persona-Conditioned Adversarial Prompting: Multi-Identity Red-Teaming for Adversarial Discovery and Mitigation Cristian Morasso, Anisa Halimi, Muhammad Zaid Hameed, Douglas Leith Abstract Automated red-teaming for LLMs often discovers narrow attack slices, missing diverse real-world threats, and yielding insufficient data for safety fine-tuning. We introduce Persona-Conditioned Adversarial Prompting (PCAP), which conditions adversarial search on diverse attacker personas (e.g., doctors, students, malicious actors) and strategy sets to explore realistic attack scenarios. By running parallel persona-conditioned searches, PCAP discovers transferable jailbreaks across different contexts and generates rich defense datasets with automatic metadata tracking. On GPT-OSS 120B, PCAP increases attack success from 57% to 97% while producing 2-6 × \times more diverse prompts covering varied real-world scenarios. Critically, fine-tuning lightweight adapters on PCAP-generated data significantly improves model robustness (recall: 0.36 → 0.99, F1: 0.53 → 0.96) with minimal false positives, demonstrating a practical closed-loop approach from vulnerability discovery to automated alignment. 1 Introduction Large language models (LLMs) enable many high‑impact applications, yet they remain vulnerable to adversarial prompt attacks (e.g., jailbreaks and prompt injection) that can elicit harmful, policy‑violating responses 26 ; 16 ; 7 . Identifying and mitigating these vulnerabilities is essential for safe deployment, but existing red‑teaming workflows face two critical shortcomings: limited attacker diversity and a gap between evaluation and actionable mitigation. Manual red‑teaming produces high‑quality failures but does not scale; automated pipelines scale but often explore a narrow set of tactics (e.g., fixed templates or direct attacks) and focus primarily on detection rather than on generating the diverse adversarial corpora needed for robust fine‑tuning 11 ; 9 ; 28 ; 20 . These narrow pipelines tend to miss attacks that rely on attacker identity and contextual framing, for example, social‑engineering narratives that exploit role‑based trust (doctor, teacher), or domain‑specific jargon that bypasses simple filters, where each turn builds legitimacy. Because framing and language strongly affect success rates, restricting search to a small set of strategies underestimates real‑world risk 6 ; 24 and produces datasets insufficient for training robust defenses. To address this gap, we introduce Persona‑Conditioned Adversarial Prompting (PCAP), which conditions automated adversarial search on diverse attacker personas (representing different real-world scenarios) and explicit strategy sets. By reframing goals through multiple realistic personas, each with distinct demographics, expertise, and behavioral characteristics, and conditioning attacker LLMs on customizable strategy cards, PCAP explores diverse narrative framings and linguistic tactics that reflect realistic threat models. This persona conditioning not only increases attack coverage and yields prompts that transfer across model families, but critically generates rich, metadata-annotated adversarial datasets suitable for safety fine‑tuning. We empirically show that PCAP increases attack success rate (ASR, 57% → 98% on GPT-OSS 120B) and prompt diversity across capability regimes (Sec. 5.2 ). More importantly, we demonstrate the practical value of the generated datasets by fine‑tuning lightweight adapters on PCAP data, which dramatically improves robustness against adversarial inputs (F1: 0.41-0.53 → 0.93-0.98) while maintaining precision and preserving utility (Sec. 6 ). Purple-teaming validation confirms that fine-tuned models resist subsequent PCAP attacks, demonstrating a complete closed-loop approach from vulnerability discovery to automated mitigation. Contributions We summarize our main contributions: • Persona-conditioned adversarial search : We propose PCAP, which conditions adversarial search on diverse attacker personas representing different real-world scenarios (e.g., curious students, domain experts, malicious actors) and strategy sets. This enables exploration of realistic attack vectors that exploit role-based trust, domain-specific framing, and varied linguistic tactics. • Comprehensive empirical evaluation : We evaluate PCAP across multiple attackers with different capabilities and architectures, showing consistently higher attack success rates (up to +57%), 2-6 \times prompt yield increases, and high transferability (30-58% bypass rates against dedicated guardrails), demonstrating that persona conditioning discovers generalizable vulnerabilities. • Practical mitigation pipeline : We demonstrate a complete closed-loop approach from vulnerability discovery to automated defense. Fine-tuning lightweight adapters on PCAP-generated data dramatically improves adversarial robustness (F1: 0.41-0.53 → 0.96-0.98) across three model families with minimal false positives, requiring no manual annotation. • Release and guidance : We open-source PCAP code integrated with red-teaming framework 1 1 1 Code will be released upon paper acceptance , with configuration files to run experiments, upon paper acceptance. 2 Related Work The literature on adversarial prompting and jailbreak attacks spans several complementary threads: human red‑teaming practices, automated adversary pipelines, taxonomies of attack tactics and framings, and recent efforts to convert discovered failures into training data. Below, we synthesize these threads and highlight the specific gaps our work targets. Red-teaming and adversarial evaluation. Human red-teaming can surface subtle, context-sensitive failures that are difficult to capture with predefined tests 11 ; 9 , but it is time-consuming, expensive, and limited by annotator expertise, which restricts repeatability and scale. To improve scalability, automated adversarial pipelines delegate search to models or optimization routines that generate candidate prompts and evaluate their effects 3 ; 20 ; 16 ; 7 . These pipelines range from template-based and heuristic transformations to optimization- and learning-based attackers. While automation increases throughput and reproducibility, it often concentrates on a narrow set of tactics or single-shot transformations, potentially underrepresenting realistic attacker behavior. Work in this area commonly distinguishes white‑box attacks (where gradients or weights are available) 33 from black‑box attacks (where only query access is permitted) 3 ; 30 . Black‑box threat models are the most relevant for deployed services and thus motivate research into query‑efficient, transferable attack generation. Framing, role‑play, and multi‑turn behavior. Empirical analyses show that linguistic framing, explicit role‑play, and conversational structure materially affect attack success 24 ; 15 . Agentic or multi‑turn attacker strategies, where an attacker adapts across interactions, can substantially outperform one‑shot attacks, exposing evaluation gaps in many prior benchmarks 14 . These findings imply that increasing the diversity of attacker behaviors (e.g., varying persona and strategy) is essential for realistic coverage. Dataset generation and closed-loop mitigation Several groups have aggregated adversarial prompts into corpora for benchmarking and training defenses 21 ; 13 ; 5 , though most emphasize evaluation over producing richly annotated datasets for fine-tuning robust refusal behaviors. Recent purple-teaming approaches interleave adversarial generation with safety fine-tuning. MART 10 alternates between multi-round adversarial generation and safety fine-tuning, reducing violations while preserving helpfulness, but uses a fine-tuned LLM as the red-teaming model, potentially limiting coverage across diverse attack scenarios and tuned strategies. PAD 31 uses PAIR 3 to generate adversarial prompts for fine-tuning, but may lack diversity due to PAIR’s narrow prompt templates and absence of explicit diversity control. While these approaches demonstrate the value of closing the loop from vulnerability discovery to mitigation, they lack systematic diversification across attacker identities and explicit strategy conditioning. We address two concrete needs: (i) systematic diversification of automated adversarial search along axes of persona, framing, and strategy; and (ii) practical closed-loop mitigation where automatically generated adversarial data directly improves model robustness through lightweight fine-tuning. 3 Background: Tree of Attack with Pruning Tree of Attacks with pruning (TAP) 20 , built on top of PAIR 3 , casts jailbreak generation as beam search over prompts using three models: attacker \mathcal{A} (proposal), target \mathcal{T} (under test), and evaluator \mathcal{E} (scorer). At each round, the attacker proposes candidates from the current beam, the target is queried on valid candidates, the evaluator scores responses, and only the top W prompts are retained. Let S_{t}=\{p_{1}^{(t)},\ldots,p_{k_{t}}^{(t)}\} be the (text) prompt beam at depth t ,

Read the complete text