Old Habits Die Hard: How Conversational History Geometrically Traps LLMs

Adi Simhi, Fazl Barez, Martin Tutek, Yonatan Belinkov, Shay B. Cohen · 2026

Read Old Habits Die Hard: How Conversational History Geometrically Traps LLMs by Adi Simhi, Fazl Barez, Martin Tutek, Yonatan Belinkov, Shay B. Cohen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03308.txt.

Introduction

Adi Simhi and four colleagues study how a conversation's past can trap a language model. Earlier answers, even hallucinated ones, seem to steer later replies toward repeating the same stance. Their 2026 framework, History-Echoes, measures that pull in two ways at once: as probabilities over conversation states, and as geometry inside the model's hidden representations.

Three model families and six datasets cover varied behaviors, from errors to safety refusals. The two measures track each other closely. Persistence turns out to be a geometric trap: gaps in the model's inner space confine where its trajectory can go next. The finding links what a model does on the surface to the shape of its internal state, and the team's code is public.

Catalog record

CREATORAdi Simhi, Fazl Barez, Martin Tutek, Yonatan Belinkov, Shay B. Cohen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63210
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03308

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Old Habits Die Hard: How Conversational History Geometrically Traps LLMs Adi Simhi, Fazl Barez, Martin Tutek, Yonatan Belinkov, Shay B. Cohen Abstract How does the conversational past of large language models (LLMs) influence their future performance? Recent work suggests that LLMs are affected by their conversational history in unexpected ways. For instance, hallucinations in prior interactions may influence subsequent model responses. In this work, we introduce History-Echoes , a framework that investigates how conversational history biases subsequent generations. The framework explores this bias from two perspectives: probabilistically, we model conversations as Markov chains to quantify state consistency; geometrically, we measure the consistency of consecutive hidden representations. Across three model families and six datasets spanning diverse phenomena, our analysis reveals a strong correlation between the two perspectives. By bridging these perspectives, we demonstrate that behavioral persistence manifests as a geometric trap , where gaps in the latent space confine the model’s trajectory. 1 1 1 Code available at https://github.com/technion-cs-nlp/OldHabitsDieHard . 1 Introduction LLMs exhibit diverse behavioral phenomena, ranging from unwanted factual inconsistencies evidenced in hallucinations and sycophancy to desired safety guardrails such as the refusal to answer. We focus on these behaviors as they represent both safety guardrails and failure modes, yet share an important characteristic: state dependence. While prior work has documented such behaviors ( 3 ; 19 ; 2 ; 6 , inter alia ) , understanding how they persist and evolve across multi-turn conversational interactions remains a significant challenge. Existing literature on carryover effects ( 36 ; 28 ) suggests that errors can compound in longer contexts, yet we lack an understanding of how this conversational history is encoded within the model’s representations. Prior work has investigated safety trajectories or generation difficulty in isolation ( 11 ; 39 ) . However, no unified framework currently connects the likelihood of phenomenon propagation with the model’s internal geometry. We address this gap by investigating a fundamental property of LLM behavior: once a phenomenon manifests, it tends to persist across subsequent turns. Our History-Echoes framework analyzes this persistence through two complementary lenses ( Figure 1 ): • A Probabilistic Perspective: We model the conversation as a Markov chain over a binary state space, where states correspond to the presence or absence of a phenomenon in a given conversational turn. By analyzing the trace of the transition matrix, we quantify the consistency of the state transitions—measuring whether prior behavioral state influences subsequent behavior. This constitutes a black-box method applicable to any model. • A Geometric Perspective: We construct low-dimensional orthogonal bases from sets of activations where the phenomenon is present, or absent. We examine how the conversation flow positions the models’ hidden representations with respect to these bases. This constitutes a white-box access to hidden representations. Figure 1 : The geometric trap of past context. We correlate external behavior with latent geometry to evaluate the extent of carryover effects. The probabilistic perspective (§ 3 ) measures the model’s state consistency, while the geometric perspective (§ 4 ) measures the orthogonality and dynamics of latent phenomenon state representations. We find that probabilistic consistency correlates with the geometric trap , where the phenomenon states are separated by a large angle. Samples are illustrative and do not pertain to real data. We find that our two approaches exhibit a strong positive correlation: when the probabilistic model detects a high trace, the geometric analysis determines that the phenomena are separated by a larger angle in the representation space. This correlation suggests that the model can be geometrically trapped in specific regions of its latent space. Specifically, the larger the probabilistic trace, the larger the angle of separation, and the stronger the carryover effect. Our analysis reveals consistency across distinct phenomena. We observe carryover effects in both failure modes (hallucination and sycophancy) and safety mechanisms (refusal), suggesting that this persistence is a fundamental feature. Interestingly, refusal exhibits the strongest carryover effects, consistent with findings that refusal is clearly defined within the models and mediated by a single direction ( 2 ) . This is followed by sycophancy, with hallucination being the least susceptible—which may be because hallucination is a broad umbrella covering diverse failure modes ( 9 ; 27 ) . These distinctions establish a new metric for evaluating the inherent consistency of different model phenomena. However, we find historical influence is sensitive to context coherence. In conversations that shift between unrelated topics, the correlation diminishes. This breakdown aligns with adversarial strategies, where tokens are employed to jailbreak models ( 40 ) , suggesting similar techniques may reduce carryover effects. Our contributions are threefold: 1. We introduce History-Echoes , a dual perspective framework that quantifies conversational persistence. We propose a probabilistic metric based on Markov chain transition traces, and a complementary geometric metric based on hidden state representations, which allow us to measure how history affects future generations. 2. We demonstrate a strong Spearman correlation of 0.78 between the two perspectives across three models and six datasets exhibiting the three phenomena. Our external and internal perspectives identify the same level of carryover effects. Furthermore, we find that closed models, GPT-5 ( 23 ) and Claude-Opus-4.5 ( 1 ) exhibit probabilistic patterns largely consistent with open-weight models. Thus, our methods offer a potential way of inferring intrinsic carryover effects present in closed models. 3. We apply History-Echoes to reveal that persistence varies by phenomenon—with refusal exhibiting the strongest carryover effects and hallucination the weakest. We show that this effect relies on context coherence; the carryover effects dissolves in inconsistent conversations. 2 Preliminaries We investigate three widely studied phenomena observed in LLMs – hallucinations, refusal, and sycophancy. We are interested in the amount these phenomena exhibit carryover effects , where an occurrence of a phenomenon increases the likelihood of it repeating in the future. To do so, we simulate a coherent conversational setting from existing question-answer pairs. The sequence of conversational turns (question-answer pairs) allows us to evaluate whether occurrences of such phenomena are correlated. The first turn is given to the model as a demonstration (see Appendix A ). Given a dataset D exploring a particular phenomenon, we first rearrange D into a sequence of questions with high topical coherence, D_{\text{consistent}} , simulating conversations as a sequence of questions posed to the LLM, which it answers. 2 2 2 We focus on consistent conversations as inconsistency reduces carryover effects, see § 6.1 . To construct D_{\text{consistent}} , we order examples in D by semantic similarity. We first embed each question-answer pair jointly with Qwen3-Embedding-0.6B ( 37 ) , and then order the examples by greedily selecting nearest-neighbors based on cosine similarity, without repeating previously selected question-answer pairs. This sorting serves as a proxy for coherence, aligning with in-context examples findings ( 18 ) . To generate a conversation of length X , we sample X consecutive questions (q_{1},\ldots,q_{X}) from D_{\text{consistent}} . We then construct the conversation by appending new questions after the model generates a response to the previous one. This produces a conversation where the user poses questions q_{1},\ldots,q_{X} sequentially, with the model providing answers. As consecutive questions are semantically similar, the resulting conversation maintains topical coherence. We also investigate the effect of topical inconsistency D_{\text{inconsistent}} , by randomly shuffling D , before applying the same procedure

Read the complete text