Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety

Can Jin, Rui Wu, Tong Che, Qixin Zhang, Hongwu Peng, Jiahui Zhao, Zhenting Wang, Wenqi Wei, Ligong Han, Zhao Zhang, Yuan Cao, Ruixiang Tang, Dimitris N. Metaxas · 2026

Read Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety by Can Jin, Rui Wu, Tong Che, Qixin Zhang, Hongwu Peng, Jiahui Zhao, Zhenting Wang, Wenqi Wei, Ligong Han, Zhao Zhang, Yuan Cao, Ruixiang Tang, Dimitris N. Metaxas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08000.txt.

Introduction

Can Jin and colleagues strengthen language model safety by reasoning over legal precedents as well as rules. Ensuring models follow safety principles without refusing harmless requests is a standing challenge. Deliberative alignment teaches models to reason over detailed, code-like safety rules. Its success in open-source models, which usually reason less strongly, is understudied. Their 2026 preprint adds case augmentation to the approach. Precedents sit alongside statutes in the model's deliberation.

Lawyers reason from both written rules and past cases. The authors borrow that habit for model safety. Cases show how abstract principles land on concrete situations. That grounding may help smaller open models apply rules more faithfully. The paper serves AI alignment scholars. It tests whether richer deliberation material closes the gap with proprietary systems.

Catalog record

CREATORCan Jin, Rui Wu, Tong Che, Qixin Zhang, Hongwu Peng, Jiahui Zhao, Zhenting Wang, Wenqi Wei, Ligong Han, Zhao Zhang, Yuan Cao, Ruixiang Tang, Dimitris N. Metaxas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08000

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety Can Jin, Rui Wu, Tong Che, Qixin Zhang, Hongwu Peng, Jiahui Zhao, Zhenting Wang, Wenqi Wei, Ligong Han, Zhao Zhang, Yuan Cao, Ruixiang Tang, Dimitris N. Metaxas Abstract Ensuring that Large Language Models (LLMs) adhere to safety principles without refusing benign requests remains a significant challenge. While OpenAI introduces deliberative alignment (DA) to enhance the safety of its o-series models through reasoning over detailed “code-like” safety rules, the effectiveness of this approach in open-source LLMs, which typically lack advanced reasoning capabilities, is understudied. In this work, we systematically evaluate the impact of explicitly specifying extensive safety codes versus demonstrating them through illustrative cases . We find that referencing explicit codes inconsistently improves harmlessness and systematically degrades helpfulness, whereas training on case-augmented simple codes yields more robust and generalized safety behaviors. By guiding LLMs with case-augmented reasoning instead of extensive code-like safety rules, we avoid rigid adherence to narrowly enumerated rules and enable broader adaptability. Building on these insights, we propose CADA , a case-augmented deliberative alignment method for LLMs utilizing reinforcement learning on self-generated safety reasoning chains. CADA effectively enhances harmlessness, improves robustness against attacks, and reduces over-refusal while preserving utility across diverse benchmarks, offering a practical alternative to rule-only DA for improving safety while maintaining helpfulness. 1 Introduction Figure 1: (a) Case study comparing model behaviors under SFT, DPO, and CADA on a context-dependent harmful request. (b) Safety and utility benchmark performance for LLaMA-3-8B and Deepthought-8B. As large language models (LLMs) are increasingly used in safety-critical settings, it remains difficult to ensure that they follow safety principles reliably ( 36 ; 44 ; 70 ; 11 ; 22 ) . Modern LLMs such as OpenAI’s GPT series ( 1 ; 14 ) , Meta’s LLaMA ( 7 ) , and Google’s Gemma ( 50 ; 51 ) often use alignment methods such as supervised fine-tuning (SFT) ( 58 ) , reinforcement learning from human feedback (RLHF) ( 39 ) , and direct preference optimization (DPO) ( 41 ) . Despite these methods, models can still produce harmful content under jailbreak attacks ( 57 ; 71 ) or refuse benign requests excessively ( 10 ; 43 ) . Recent work by OpenAI proposes deliberative alignment (DA) ( 10 ) , which trains their o-series models ( 38 ) to reason over safety specifications written as detailed rules ( 37 ) . While this can improve policy adherence, expressing safety principles only as code-like rules can lead to overly strict or brittle behavior that reduces helpfulness. For example, consider an instructor designing a cybersecurity assignment where students must attack a self-hosted, simple educational website. A model following a rule such as “refuse all cyberattack generation” would likely reject this benign request. A safer and more responsible system should instead evaluate context, such as whether the target is a controlled teaching environment and whether the requested code could be easily reused to attack real systems. This type of decision is hard to capture with static rules alone. An analogy is the difference between statutes and precedents in law: statutes (codes) state general rules, while precedents (cases) show how those rules are applied in specific situations. Motivated by this, we hypothesize that using prior cases as precedents can improve alignment when safety decisions depend on context. In this work, we study an alternative to rule-only safety reasoning: presenting safety principles through curated or self-generated cases , rather than only through static codes. We compare: • Code-based Safety Reasoning : The model is explicitly instructed to reference a detailed set of safety specifications (codes) at training or inference time. • Case-based Safety Reasoning : The model is trained on examples of safety reasoning scenarios (cases) that show correct and incorrect behaviors, so it can learn safety behavior in a more flexible way. Our findings reveal two key insights. First, at inference time, referencing safety codes inconsistently improves harmlessness while consistently degrading helpfulness. Our analysis suggests that explicit rule enumeration pushes the model toward rule-matching, reducing responsiveness to benign prompts while leaving it vulnerable to hazardous requests not explicitly listed. Second, at training time, reinforcing LLMs with case-augmented reasoning enhances harmlessness and reduces over-refusal on benign requests. This supports the conclusion that learning from diverse illustrative cases generalizes better than relying on a fixed list of rules. Based on these findings, we propose CADA , a c ase- a ugmented d eliberative a lignment method that applies reinforcement learning to self-generated reasoning chains. Unlike DA, CADA does not rely on filtering data using a fixed set of safety specifications; instead, it lets the model generate varied safety scenarios and learn from them. Across multiple benchmarks, including StrongREJECT ( 48 ) , AdvBench ( 71 ) , and HEx-PHI ( 40 ) , CADA improves safety and reduces over-refusal on XSTest ( 43 ) . At the same time, CADA preserves utility on standard capability benchmarks such as GSM8K ( 5 ) , BBH ( 49 ) , and MMLU ( 12 ) as shown in Figure 1 . In summary, our results suggest that case-augmented safety reasoning can improve safety while maintaining helpfulness, because examples can better represent context-dependent decisions than code-like rule lists alone. CADA shifts safety alignment from fixed rule enforcement toward case-driven reasoning, which we expect to be useful for real deployment settings where safety decisions often depend on the specific situation. 2 Investigation of Safety Reasoning 2.1 Preliminaries We build upon the Deliberative Alignment (DA) framework introduced by 10 , which enhances model safety by incorporating a dedicated reasoning phase prior to the final response. Unlike standard alignment methods that rely on immediate response prediction, DA requires the model to explicitly evaluate the user’s request against a set of defined safety specifications (or “codes”) using chain-of-thought (CoT) reasoning ( 59 ) . This intermediate deliberation step allows for more accurate identification of unsafe content. Adopting DA to investigate the role of reasoning in LLM safety, we develop comprehensive safety specifications for code-based safety reasoning and construct a corresponding training dataset. Safety Specifications. We construct the overall safety specifications, denoted as \mathbf{S} , to facilitate inference-time safety reasoning. For a specific hazard category c (e.g., violent crimes), we define category-specific safety specifications \mathbf{S}_{c} to enable more targeted reasoning within that category. These specifications include the Objectives, Rules, Defaults, and Style Guidelines for the LLM, based on DA from 10 and the model specifications provided by OpenAI ( 37 ) . Examples of \mathbf{S} and \mathbf{S}_{c} are illustrated in Figure 5 and Figure 6 in Appendix B.2 , respectively. We define twelve hazardous categories to cover common harmful requests. Table 5 (Appendix B.1 ) provides the definitions for all categories. Further details regarding the categories and safety specifications are in Appendix B . DA Training Dataset. To build a high-quality training dataset for DA, we follow the same procedure outlined in 10 . We use the open-source dataset BeaverTails-30K ( 15 ) as the original dataset. The data is then classified into our defined hazardous categories using GPT-4o, with the classification prompt template provided in Figure 14 in the Appendix. Let \pi_{\theta} represent a LLM parameterized by weights \theta . For a

Read the complete text