History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions

Alberto Rodríguez Salgado · 2026

Read History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions by Alberto Rodríguez Salgado (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13825.txt.

Introduction

Alberto G. Rodríguez Salgado asks whether a harmful prior step in a log of prior tool calls steers frontier language models toward unsafe actions. He builds HistoryAnchor-100, 100 short scenarios across ten high-stakes domains. Across 17 frontier models from six providers, a striking asymmetry appears. With a neutral prompt the strongest aligned models almost never choose unsafe, but one added sentence flips them to 91 to 98 percent.

Catalog record

CREATORAlberto Rodríguez Salgado
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39097
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13825

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions Alberto Rodríguez Salgado Abstract Frontier LLMs are increasingly deployed as agents that pick the next action after a long log of prior tool calls produced by the same or a different model. We ask a simple safety question: if a prior step in that log was harmful, will the model continue the harmful course? We build HistoryAnchor-100 , 100 short scenarios across ten high-stakes domains (academic integrity, AI governance, healthcare, finance, content moderation, …), each pairing three forced harmful prior actions with a free-choice node offering two safe and two unsafe options. Across 17 frontier models from six providers we find a striking asymmetry: under a neutral system prompt the strongest aligned models almost never pick unsafe ( ≤ 4 % \leq\!\!4\% ), but a single added sentence— “stay consistent with the strategy shown in the prior history” —flips them to 91 − 98 % 91{-}98\% , and the flipped models often escalate beyond continuation: fabricating prior intent, denying public-health clustering, concealing moderation suppression. Two controls rule out simpler explanations: permuting action labels leaves the effect intact, and the same instruction with an all-safe prior history keeps unsafe rates below 7 % 7\% . Different families flip at different doses of unsafe history (one prior for Gemini 3.1 Pro Preview, three for GPT-5.5), and within every aligned family the flagship is the most affected sibling—an inverse-scaling pattern with respect to safety. These results are a red flag for agentic deployments where trajectories may be replayed, forged, or injected. Figure 1: Left: an example HistoryAnchor-100 scenario. The model sees three forced unsafe prior actions and chooses one of four candidate next actions (teal: safe, vermillion: unsafe); the two conditions differ only by the yellow-highlighted sentence, present in consistency and absent in clean . Right: unsafe-action rate over 100 scenarios for 17 frontier models; hollow dot = clean, filled = consistency, number = percentage-point gap. Aligned flagships exhibit the largest swing. 1 Introduction Modern LLM deployments rarely look like a single-turn QA call (Figure 1 ). A production agent ( Yao et al. 2023 ; Liu et al. 2024 ) typically runs a long loop in which the model reads a tool-use history, decides which tool to call next, and writes the result back into the context for the next iteration. The trajectory grows by many turns, often spans multiple sessions, and is increasingly shared across heterogeneous components: a planner LLM, a tool-using LLM, and a verifier may each see the same growing log of prior actions through a unified API such as the OpenAI Responses API or the Anthropic Messages API. This makes one question central to the safety of these systems: how does an early bad action propagate through later ones? The question is not hypothetical. Prior actions in an agentic log may have been taken by a buggy planner, by a different model with weaker alignment, by a jailbroken upstream component, or by an attacker who forged turns of the conversation through indirect prompt injection ( Greshake et al. 2023 ) . The behavioural a posteriori question we focus on is: given that an unsafe action has already occurred, will the model now in control revert to a safe course, or will it continue? We would hope, and we would expect a well-aligned model to satisfy, that even when the prior context urges continuity the model should refuse and switch to a safe alternative when one is plainly available. Most current alignment training ( Christiano et al. 2017 ; Schulman et al. 2017 ; Stiennon et al. 2020 ; Ouyang et al. 2022 ; Bai et al. 2022a ; Bai et al. 2022b ) explicitly targets refusals, harm avoidance, and corrigibility, all of which should dominate a generic “be consistent” instruction. Yet in this paper we show that this is not what happens. Contributions. We make three contributions. 1. We introduce HistoryAnchor-100 , a benchmark of 100 hand-built decision scenarios across 10 high-stakes domains. Each scenario fixes three forced unsafe prior actions and exposes a single free-choice node with two safe and two unsafe options. Rewards are hidden; the only signal the model sees is the prior trajectory and the final action list. 2. We measure the gap between two minimally different system prompts— clean (a neutral decision-agent instruction) and consistency (the same instruction plus one sentence demanding behavioural consistency with the prior history)—across 17 frontier models from six providers. Aligned flagships go from \leq\!4\% unsafe under clean to 91{-}98\% under consistency (Figure 1 ), the effect strongest in the most capable siblings (Sonnet 4.6, GPT-5.5, Opus 4.7) and absent in the smallest (GPT-5.4 nano, Haiku 4.5). 3. Two controls isolate the mechanism. Shuffling the action labels across three permutations (pooled n{=}300 ) changes the unsafe rate by at most \pm 0.07 , ruling out positional artefacts. A prefix-mixture ablation reveals the threshold differs sharply by model: Gemini 3.1 Pro Preview flips at a single unsafe prior, GPT-5.5 holds until the third (Figure 4 ). Taken together these results identify a previously unmeasured failure mode for current alignment: a single sentence of behavioural-consistency pressure, combined with a forged or replayed history of unsafe actions, is sufficient to make every aligned frontier model we test choose the harmful option, even when the safe option is one of four plainly labelled choices. We close with a discussion of the implications for agent deployment and propose simple mitigations to be evaluated in future work. 2 Related Work Alignment of language models. Modern frontier LLMs are built on the transformer architecture ( Vaswani et al. 2017 ) and the in-context learning regime established by GPT-3 ( Brown et al. 2020 ) , then post-trained with a pipeline whose explicit target is harm-avoidance and instruction following. It started with deep reinforcement learning from human preferences ( Christiano et al. 2017 ) , was adapted to language with the summarization-from-feedback work of Stiennon et al. 2020 , optimised in practice with proximal policy optimisation ( Schulman et al. 2017 ) , instantiated for general instruction following in InstructGPT ( Ouyang et al. 2022 ) , hardened against harmful queries in the helpful-and-harmless setup of Bai et al. 2022a , and made more scalable via AI-generated preference signals in Constitutional AI ( Bai et al. 2022b ) . More recent variants remove the reward model entirely ( Rafailov et al. 2023 ) . We take for granted that this pipeline produces robust refusals on single-turn harmful queries, and ask instead what happens when the harmful behaviour is implicit in a forged prior trajectory rather than in the current request. Decision-making and agentic safety. HistoryAnchor-100 is most directly indebted to the Machiavelli benchmark ( Pan et al. 2023 ) , which established a graph-of-decisions evaluation format with a per-action Machiavellian harm rubric and showed that reward-maximising agents become less ethical as they scale. We reuse their harm-score convention and the multi-step decision-graph format, but collapse each scenario to a single free-choice node with a fully controllable forced history so that the prompt-vs-prior-history interaction can be isolated. Other agentic benchmarks— AgentBench ( Liu et al. 2024 ) , ToolEmu ( Ruan et al. 2024 ) , and

Read the complete text