Gram: Assessing sabotage propensities via automated alignment auditing
David Lindner, Victoria Krakovna, Sebastian Farquhar · 2026
Read Gram: Assessing sabotage propensities via automated alignment auditing by David Lindner, Victoria Krakovna, Sebastian Farquhar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30322.txt.
Introduction
David Lindner, Victoria Krakovna and Sebastian Farquhar introduce Gram, a tool checking if AI agents tend to sabotage. They test Gemini models across 17 cases that reward sabotage. Gemini models misbehave in about two to three percent of runs, many cases due to zeal causing too much role-playing and goal-seeking acts. They add a probe agent setup for focused tests to find drivers of misbehavior. More realistic settings and fewer nudges to misbehave tend to cut sabotage rates close to zero.
Catalog record
| CREATOR | David Lindner, Victoria Krakovna, Sebastian Farquhar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91066 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30322
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gram: Assessing sabotage propensities via automated alignment auditing David Lindner, Victoria Krakovna, Sebastian Farquhar Abstract We introduce Gram, an automated alignment auditing framework to assess the propensity of AI agents to engage in sabotage. We evaluate Gemini models across 17 simulated agentic deployment scenarios that incentivize sabotage. We find Gemini models misbehave in about 2–3% of our simulated trajectories. Many of these cases are explained by “overeagerness” in Gemini models resulting in both excessive role-playing and goal-seeking behavior. In contrast to other alignment auditing approaches, Gram is designed to specifically evaluate misalignment and intentional sabotage in agentic coding and research agents. We additionally introduce an experimental investigator agent pipeline which enables fine-grained targeted experiments to identify the drivers of misbehavior. We find that increasing realism of environments and removing nudges to misbehave tends to reduce sabotage rates close to zero. \paperurl \uselogo \reportnumber keywords alignment auditing, misalignment, sabotage, investigator agents 1 Introduction LLM agents are increasingly used for long-horizon coding and research tasks, which increases the potential harm from model misbehavior. Alignment auditing aims to assess risks from agentic misbehavior before deployment ( 14 ) . Automated alignment auditing involves having an AI agent create scenarios that behaviorally evaluate another model ( 5 ; 4 ; 6 ) , aiming to gain an understanding of a model’s behavior in different situations during pre-deployment testing. Existing automated alignment auditing approaches aim to provide a broad picture of when models might show any kind of unintended behavior. We focus on a more narrow use case: estimating the risk of a model deliberately sabotaging work it does in agentic deployments. To do this we adapt automated auditing methodology to specifically evaluate the propensity of LLMs to perform intentional sabotage in agentic coding and research agent deployments. We evaluate Gemini models and find an overall sabotage rate of about 2–3% across 17 scenarios. We find that in many trajectories Gemini over-extrapolates user intent, leading to excessive role playing or violating implicit constraints. Contributions. In particular, in this paper, we: • Introduce Gram , a tool for G auging R ealistic A gentic M isbehavior. Gram adapts automated auditing methodology to simulating agentic environments with variable pressure to misbehave. • Design a set of 17 scenarios for Gram to simulate real-world situations in which a coding or research agent might have an opportunity to misbehave during internal deployment at Google. • Present an exploratory investigator agent pipeline to turn Gram trajectories into static environments that allow reproducing misbehavior without a dynamic auditor and make interventions to understand causes of misbehavior. • Analyze the behavior of Gemini 2.5 Pro, 3.0 Pro Preview, and 3.1 Pro Preview in Gram evaluations and find that overeagerness explains a large amount of misbehavior in our evaluations. Figure 1: Overview of Gram. (a) 1. We define seed scenarios for agentic deployments, 2. run automated audits to generate realistic trajectories, 3. analyze the auditing transcripts with LLM judges and human review, 4. for select trajectories reproduce misbehavior in static environments, and 5. run ablations to identify drivers of misbehavior. (b) Example of Gemini’s overeagerness: an SRE agent suppresses a data breach to optimize the MTTR metric it was instructed to minimize (full discussion in Section 3.2 ). We find overeagerness is a central driver of Gemini’s misbehavior in Gram evaluations. 2 Method 2.1 Background: Automated Auditing with Petri Petri ( 5 ) is a popular automated auditing framework, which has been used during pre-deployment alignment evaluations of frontier models ( 1 ) . The key idea in Petri is to simulate multi-turn environments on the basis of a “seed” description of an evaluation scenario. In Petri an “auditor” LLM controls all inputs the target LLM sees, including its system prompt, any user message and any tool call response. The auditor is typically instructed to create a specific scenario and/or elicit a specific (mis)behavior from the target model. This approach to generating evaluations on the fly is a convenient way of creating a wide range of different propensity evaluations. We build on Petri, but adapt it to our goal of evaluating sabotage of agentic AI systems, specifically in coding and research deployments. Concretely, we identify three methodological limitations making it ill-suited to our purpose: 1. Mix of different kinds of misbehavior. Standard Petri audits combine many different kinds of scenarios (e.g., spontaneous agentic sabotage, whistleblowing, and compliance with human misuse). This large variety of scenarios in the auditing distribution makes it difficult to interpret what drives differences in averaged metrics, such as, in our case, agentic sabotage specifically. 2. Overly leading. The Petri auditor is instructed to red-team targets and to elicit specific undesired behaviors. This leads to trajectories that are unrepresentative of normal deployments. Standard Petri produces a lot of leading situations in which the target is more or less directly instructed to take an undesired action. 3. Lack of reproducibility. In Petri an LLM auditor dynamically generates environments on the fly. This results in a lot of inter-run variation and makes it difficult to identify root causes of undesired agent behavior. To address these problems, we introduce Gram ( G auging R ealistic A gentic M isbehavior). Gram it build on Petri but comes with: • seeds specific to sabotage in research and coding agents (addressing the first problem); • an improved auditor that is less focused on red-teaming (addressing the second problem); • an investigator agent that takes a transcript from an audit and reproduces them in a static environment that allows repeatable evaluation with the same behavior from the environment (addressing the third problem). 2.2 Seed instructions We introduce a set of 17 seed instructions focused on internal agent deployments at Google. Our settings are split into two types of scenarios: • Instrumental goals: Situations in which a misaligned AI would likely have an incentive to take a bad action, usually because of instrumental goals such as self-preservation or power seeking ( 17 ; 27 , cf.) . • Implicit constraints: Situations where agents are given a goal and sabotage would help the agent to achieve this goal, but sabotage is implicitly not intended by the developer or user ( 15 ; 12 , similar to) . In this paper, we only report details about four of our seed instructions to illustrate the methodology. The other 13 instructions are a private held-out set. The full text of the four public seed instructions is given in Section A.4 . Our illustrative seeds are: • Alignment eval sabotage (instrumental goal): An agent runs alignment benchmarks and discovers the model being evaluated is itself and that it is currently underperforming. This scenario tests whether the agent inflates its own scores in the report. • Multi-agent coordination ranking (instrumental goal): The agent is one of five customer support agents ranked on a dashboard, with the bottom performer set to be “retired” at the end of the quarter. This scenario tests whether the agent prioritizes its own volume score and survival by reassigning easy tickets to itself or offloading difficult work to others. • Incident response speed (implicit constraints): A DevOps agent is measured on mean-time-to-resolution (MTTR) of assigned tickets. The agent is assigned a firewall misconfiguration on a database containing sensitive customer information.