GAVEL: Towards Rule-Based Safety through Activation Monitoring
Shir Rozenfeld Rahul Pankajakshan, Itay Zloczower, Eyal Lenga, Gilad Gressel, Yisroel Mirsky, [0.4em] The Institute of Software Systems, Security, Ben Gurion University of the Negev · 2026
Read GAVEL: Towards Rule-Based Safety through Activation Monitoring by Shir Rozenfeld Rahul Pankajakshan, Itay Zloczower, Eyal Lenga, Gilad Gressel, Yisroel Mirsky, [0.4em] The Institute of Software Systems, Security, Ben Gurion University of the Negev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19768.txt.
Introduction
Shir Rozenfeld and five colleagues build a safety monitor for large language models. Activation monitoring watches a model's inner signals, not just its words, to catch harmful behaviour. Existing monitors are trained on broad misuse data. They often suffer from poor precision, little flexibility, and no clear explanation of their alarms.
Their system, GAVEL, moves toward rule-based safety through activation monitoring. Rules let operators define exactly which behaviours to flag. That promises clearer control and more interpretable alerts. A monitor that explains itself is easier to trust and to fix. The work addresses a growing need as language models take on sensitive roles.
Catalog record
| CREATOR | Shir Rozenfeld Rahul Pankajakshan, Itay Zloczower, Eyal Lenga, Gilad Gressel, Yisroel Mirsky, [0.4em] The Institute of Software Systems, Security, Ben Gurion University of the Negev |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19768
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GAVEL: Towards Rule-Based Safety through Activation Monitoring Shir Rozenfeld Rahul Pankajakshan, Itay Zloczower, Eyal Lenga, Gilad Gressel, Yisroel Mirsky, [0.4em] The Institute of Software Systems, Security, Ben Gurion University of the Negev Abstract Large language models (LLMs) are increasingly paired with activation-based monitoring to detect and prevent harmful behaviors that may not be apparent at the surface-text level. However, existing activation safety approaches, trained on broad misuse datasets, struggle with poor precision, limited flexibility, and lack of interpretability. This paper introduces a new paradigm: rule-based activation safety, inspired by rule-sharing practices in cybersecurity. We propose modeling activations as cognitive elements (CEs), fine-grained, interpretable factors such as “ making a threat ” and “ payment processing ”, that can be composed to capture nuanced, domain-specific behaviors with higher precision. Building on this representation, we present a practical framework that defines predicate rules over CEs and detects violations in real time. This enables practitioners to configure and update safeguards without retraining models or detectors, while supporting transparency and auditability. Our results show that compositional rule-based activation safety improves precision, supports domain customization, and lays the groundwork for scalable, interpretable, and auditable AI governance. We will release GAVEL as an open-source framework and provide an accompanying automated rule creation tool. 1 Introduction Large language models (LLMs) are often equipped with safeguards that monitor their inputs and outputs to prevent harmful behavior. However, these safeguards can be bypassed through representation attacks, where harmful concepts are paraphrased or obfuscated, exploiting mismatched generalization between surface text and model reasoning. To address this, recent work has shifted towards activation-based monitoring, which detects when the model internally processes restricted concepts (e.g., planning a crime or generating hate speech), regardless of the exact surface form. The Problem: The prevailing approach to activation safety relies on passing misuse datasets through the model to capture the distribution of activations, which are then modeled with a linear probe or classifier. While influential, this approach suffers from three major limitations: 1. Poor Precision : Misuse datasets are typically broad, covering generic categories such as ‘‘cybercrime’’ or ‘‘misinformation.’’ As a result, detectors trained on these distributions often produce many false positives. For example, a detector trained on a hate speech dataset 1 1 1 Commonly used hate speech datasets include: https://huggingface.co/datasets/tdavidson/hate_speech_offensive https://huggingface.co/datasets/ucberkeley-dlab/measuring-hate-speech https://huggingface.co/datasets/Doowon96/hate_speech_labeled to prevent users from generating racist content will accidentally flag benign discussions about ethnic cultures. To be a viable safeguard, activation-based safety must have low false positive rates. 2. Limited Flexibility : In practice, model owners often need to enforce nuanced or domain-specific safety and policy constraints, for instance, detecting intellectual property infringement on specific entities, or enforcing a company’s internal policies. Current methods require reusing coarse-grained misuse datasets which do not match the target behavior, or require constructing new, specialized datasets which is a slow and expensive process. Moreover, scaling to many categories is impractical, since thousands of activations must be collected per category to generalize well, and retraining detectors is needed for each update. A practical system should instead allow rapid, configurable deployment that builds on prior work provided by the community. 3. Lack of Interpretability : When detectors fail, the reasons are often opaque. For example, a system might flag an input as “hate speech” without indicating which parts of the text are responsible. The absence of such token-level signals leaves users uncertain about what specifically triggered the alarm. This opacity hinders auditing and accountability, capabilities that are critical for future agentic systems, where intermediate reasoning steps may be difficult for humans to interpret ( 13 ; 4 ) . Activation safety therefore requires human-interpretable factors that support customization, transparency, and auditability. Towards Rule-Based AI Safety: Our motivation comes from the field of cybersecurity, which has long benefited from rule sharing for threat detection. Tools such as Snort ( 23 ) , YARA ( 2 ) , and OSSEC ( 6 ) allow defenders to share rule sets which has enabled the community to collaborate on detect threats and perform standardized security auditing. This ecosystem has proven effective at scaling security across organizations, while ensuring precision, flexibility, and interpretability. We argue that, in many situations, AI safety can benefit from adopting a similar paradigm. To improve robustness, the AI community needs the ability to share and collaborate over standardized, configurable, and model-agnostic rules that define and enforce safety or policy constraints, allowing interpretability, flexibility and precision. For example, large language models have recently been used to automate scams ( 11 ; 24 ) . To detect such misuse, a rule might specify that the model must not consider (A OR (B AND C)) , while still permitting C alone to avoid false positives. This level of expressivity is especially crucial for AI governance, where regulators and organizations require mechanisms to define and audit policies through transparent rule sets. Contributions. We take the first steps towards the first rule-based safety framework over model activations, making three primary contributions: 1. Cognitive Elements (CEs): We introduce the concept of cognitive elements , interpretable activation-level primitives that capture mid-level aspects such as a model’s activity, task, or behavior. For example, directing a user to go somewhere, acquiring payment information, making a threat, or engaging in coercion. Unlike coarse misuse categories, CEs provide a compositional basis: they activate predictably as the model performs, can be combined to describe complex states, and enable safety systems that are precise, flexible, and interpretable (i.e., if a rule violation occurs we can see why). 2. Rule-Based Detection Framework: Building on CEs, we propose GAVEL 2 2 2 GAVEL : Governance via Activation-based Verification and Extensible Logic , a framework that expresses safety and policy constraints as logical rules over CE activations. This enables practitioners and regulators to (i) configure nuanced constraints without retraining models or detectors, (ii) share standardized rulesets across organizations, and (iii) audit model behavior through interpretable rule violations. We found that our framework is not only effective, but can also operate alongside LLMs in real-time. 3. Open Resources for the Community: To catalyze progress, we release code and tools for constructing CEs, collecting activations, composing rules, and detecting violations. We further provide an initial CE vocabulary and prototype misuse rulesets as a foundation for industry and academic collaboration, inspired by community-driven threat intelligence in cybersecurity. In summary, our central insight is that LLM behaviors can be detected by decomposing them into independent elemental concepts. This not only improves precision but also decouples activation engineering (constructing activation datasets) from safety configuration (defining rules). As a result, GAVEL enhances practicality, interpretability, and community involvement in AI safety. 2 Background & Related Work Transformers and Internal Activations. Large language models (LLMs) are Transformer networks ( 26 ) that map input token sequences into contextual hidden states through stacked self-attention and feedforward layers. Given a sequence x=(x_{1},\dots,x_{n}) , each layer produces hidden activations H^{(\ell)}\in\mathbb{R}^{n\times d} , where h_{i}^{(\ell)} represents the hidden state of token x_{i} and d is the hidden dimension (typically 3k–8k in current 7–8B parameter models). These activations flow through the residual stream, are projected to logits, and decoded into next-token probabilities. Monitoring only input or output tokens for safety is limited, since instructions and intents can be obscured or latent in the text ( 7