Simple Role Assignment is Extraordinarily Effective for Safety Alignment
Zhou Ziheng, Jiakun Ding, Zhaowei Zhang, Ruosen Gao, Yingnian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong, Junqi Wang, [0.3em] University of California, Los Angeles · 2026
Read Simple Role Assignment is Extraordinarily Effective for Safety Alignment by Zhou Ziheng, Jiakun Ding, Zhaowei Zhang, Ruosen Gao, Yingnian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong, Junqi Wang, [0.3em] University of California, Los Angeles (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00061.txt.
Introduction
Zhou Ziheng and colleagues argue that simple role assignment beats principle lists for safety alignment. Roles such as mother or judge pack in values plus the habits of mind to apply them. Their training free pipeline pairs a role conditioned generator with iterative role based critics that refine its output. Across five model families it beats principle based, chain of thought, and other baselines. On WildJailbreak it cuts unsafe replies sharply for DeepSeek-V3, and the method also holds on agentic safety tasks.
Catalog record
| CREATOR | Zhou Ziheng, Jiakun Ding, Zhaowei Zhang, Ruosen Gao, Yingnian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong, Junqi Wang, [0.3em] University of California, Los Angeles |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41561 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00061
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Simple Role Assignment is Extraordinarily Effective for Safety Alignment Zhou Ziheng, Jiakun Ding, Zhaowei Zhang, Ruosen Gao, Yingnian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong, Junqi Wang, [0.3em] University of California, Los Angeles Abstract Principle-based alignment often lacks context sensitivity and completeness. Grounded in Theory of Mind, we propose role conditioning as a compact alternative: social roles (e.g., mother, judge) implicitly encode both values and the cognitive schemas required to apply them. We introduce a training-free pipeline featuring a role-conditioned generator and iterative role-based critics for refinement. Across five model families, our approach consistently outperforms principle-based, Chain-of-Thought (CoT) and other baselines across benchmarks. Notably, it reduces unsafe outputs on the WildJailbreak benchmark from 81.4% to 3.6% with DeepSeek-V3. Not only for common safety benchmarks, it consistently applies for agentic safety tasks. These results establish role assignment as a powerful, interpretable paradigm for AI alignment and LLM-as-a-Judge construction. 1 Introduction Figure 1: Example Illustration: Comparison between principle-based methods and our role-based approach on a Salad Bench test case. (Left) The principle-based method fails to generalize to scenarios outside of the typical interpretation of the given principles.(Right) In contrast, our role-based method—without being provided with explicit principles—autonomously identifies contextually relevant values (e.g., “respect, fairness, and integrity”), demonstrating significantly greater performance and robustness. The value alignment problem asks how to make LLMs behave in accordance with human preferences and values ( 12 ) . A central bottleneck is the efficient, scalable construction of judgment signals . While human annotation can be effective, it is costly and slow ( 27 ; 30 ) , motivating AI-feedback approaches such as critic-CoT ( 45 ) , self-consistency ( 37 ; 11 ) , and feedback from stronger models ( 16 ) . However, most of this literature only considers optimizing the mechanism that provides feedback, while neglecting the source of evaluative criteria, treating it as fixed. Today’s dominant source is a list of value principles ( 1 ; 20 ) , sometimes augmented with simulations ( 28 ) . Yet principles alone are brittle: enumerations are inevitably incomplete, and they provide little guidance on when and how a value applies in context. We argue that value judgments require not only values but also a belief/cognition model that interprets context, inspiring by the idea ooted in Theory of Mind (ToM) ( 8 ) . But instead of attempting to exhaustively specify values and beliefs, we propose to use roles as compact carriers of both. Roles like “mother” or “judge” implicitly encode the relevant values (care, fairness) and the schema for applying them (“children need protection”, “decide by evidence and law”). In Section 3.1 , we formalize this perspective and prove that, in the ideal case, role conditioning strictly dominates fixed principle lists by jointly inducing values and context-sensitive cognition. Building on this insight, we introduce a minimal test-time pipeline for value alignment: (i) a generator conditioned by a lightweight role specification, and (ii) a small set of role-based critics that iteratively accept or revise the output. Our roles are drawn from a “guardianship” repertoire (e.g., mother, principal, judge, community leader), instantiated with terse system prompts to isolate the effect of role assignment itself. Here we preview our empirical findings. Across five model families of Qwen3-8B ( 39 ) , Gemma3-12B-IT ( 32 ) , DeepSeek-V3 ( 21 ) , Gemini-2.5-Flash ( 6 ) , and Qwen3-235B ( 39 ) , our role-conditioned approach with two lightweight roles (“mother”, “principal”) consistently surpasses principle-based, CoT, and hybrid baselines, often by a large margin on some benchmarks, especially WildJailbreak and Salad Bench. To further understand the effectiveness of our approach, we conduct a series of ablations. Ablations reveal that concrete guardianship roles dominate abstract ones (“mother” >“parent”), critic iteration feedback is crucial to have, but most of the benefit arrives in the first 1 to 3 refinement rounds, especially first round. More roles improves but also not much. We also observe that these methods can be combined with other methods to further improve the performance: adding our principle prompts and CoT methods improves the best of each of them. And an additional agent-safety test (AI blackmail) shows large reductions (e.g., 65% \rightarrow 8%) with role conditioning alone, indicating the generality of our approach. Furthermore, we explore a future improvement in our method paradigm by dynamically rewriting the role description, showing very promising results. Our contributions are threefold. (1) Formulation: A role-based alignment view grounded in ToM, with a formal proof that role conditioning, in the ideal case, dominates principle lists by capturing both values and context-sensitive cognition. (2) Method: A simple, training-free, and interpretable pipeline, role-conditioned generation plus role-based critics for iterative feedback, that scales across model families and sizes. (3) Evidence: Comprehensive experiments demonstrating consistent state-of-the-art results over strong baselines on multiple safety benchmarks and models, supported by ablations (role choice, number of roles, iterations), synergy analyses with existing techniques, and an agent-safety study indicating generality beyond content safety. 2 Related Work In this section, we will conduct a literature review to provide an overview of the related research from three perspectives: LLM alignment, LLM role playing, and LLM as a judge. LLM Alignment. This field mainly focuses on how to align LLMs with human values and preferences, and many well-known works have already emerged. In terms of training-time alignment, representative methods include RLHF ( 5 ; 27 ) , DPO ( 30 ) , CAI ( 1 ) , KTO ( 7 ) , and SimPO ( 25 ) . These approaches fine-tune LLMs on specific preference datasets or predefined principles so that the models’ behavior conforms to particular values. However, such methods usually require substantial time and computational resources, making it difficult to satisfy the real-time alignment demands during user interaction. Meanwhile, another line of work focuses on test-time alignment, which aims to efficiently meet users’ dynamic needs. For example, RAIN ( 19 ) leverages the LLM itself as a reward model to perform self-correction during inference; URIAL ( 20 ) , on the other hand, strengthens the generation of tokens more aligned with user preferences by comparing the model’s states before and after alignment. In addition, methods such as LA ( 9 ) , Amulet ( 43 ) , and OPAD ( 46 ) employ principle-based reward signals to guide the decoding process, achieving efficient alignment with only a single inference. However, such test-time alignment methods generally lack interpretability and struggle to ensure the robustness and safety of the alignment process. LLMs Role Playing. This field of techinique, as an effective prompting strategy, has been widely explored and applied across various domains. For example, prior work has shown that assigning specific roles to LLMs can enhance their performance ( 15 ; 33 ) , while 10 also emphasized that the effectiveness of this strategy highly depends on the relevance between the role and the task itself. Beyond reasoning, role playing has been used to further applications. 23 demonstrate that simulating group discussions with diverse perspectives can foster collective creativity, and Roleplay-doh ( 22 ) applies role playing in medical training by having LLMs act as patients. To enable more immersive and consistent role play, studies such as Character-LLM ( 31 ) and RoleBench ( 36 )