Three Regimes of Context-Parametric Conflict: A Predictive Framework and Empirical Validation

Pruthvinath Jeripity Venkata · 2026

Read Three Regimes of Context-Parametric Conflict: A Predictive Framework and Empirical Validation by Pruthvinath Jeripity Venkata (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11574.txt.

Introduction

Pruthvinath Jeripity Venkata resolves a clash in how language models handle trained knowledge versus contradicting documents. Some studies find models clinging to trained answers, others find them following context 96 percent of the time. The paper argues prior work mixed three distinct situations. They are single-source updating, rival integration, and task-appropriate selection, driven by evidence coherence, parametric certainty and task needs. Tests across five frontier models confirm the predicted certainty gradient in the competitive regime. Task framing alone flips context use from near 100 percent to as low as 6 percent.

Catalog record

CREATORPruthvinath Jeripity Venkata
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42143
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Three Regimes of Context-Parametric Conflict: A Predictive Framework and Empirical Validation Pruthvinath Jeripity Venkata Abstract The literature on how large language models handle conflict between their training knowledge and a contradicting document presents a persistent empirical contradiction: some studies find models stubbornly retain their trained answers ( Longpre et al. 2021 ) , while others find models readily defer to the document ( Xie et al. 2024 ) . We argue these contradictions dissolve once one recognises that prior experiments have studied three qualitatively distinct processing situations without distinguishing them. We propose a three-regime framework : Regime 1 (single-source updating, dominant predictor: evidence coherence), Regime 2 (competitive integration, dominant predictor: parametric certainty), and Regime 3 (task-appropriate selection, dominant predictor: task knowledge requirement). We formalise a distinction between parametric strength (exposure frequency) and parametric uniqueness (encoding consistency), showing empirically that these are orthogonal dimensions ( r = − 0.002 r=-0.002 , p = .97 p=.97 ) with strength as the operative predictor in stable factual domains. We validate the framework across Claude Sonnet 4.6, GPT-5.5, Gemini 2.5 Flash, Llama 4 Maverick, and DeepSeek V3 using 9,970 API calls in three experimental phases: (1) a Regime 1 vs. Regime 2 certainty gradient study on 450 PopQA items (8,970 calls), where GEE logistic regression confirms the predicted gradient for all five models ( β = − 0.38 \beta=-0.38 to − 0.50 -0.50 , all p ≤ .013 p\leq.013 , BH-FDR corrected); (2) a Wikidata edit-frequency analysis showing strength and uniqueness are independent predictors; and (3) a Regime 3 ablation (1,000 calls) showing task framing alone flips context-following from near-100% (CK condition) to 6–71% (PK condition), with all five models significant ( p < .001 p<.001 ). The certainty gradient in Regime 2 is robust to multinomial outcome modeling, sensitivity analyses for hedging responses, and FDR correction. We additionally identify a distractor plausibility confound in PopQA-based studies and demonstrate that manipulation design is a first-order variable in conflict research. 1 Introduction Consider two peer-reviewed studies, both asking whether a language model follows a document that contradicts its training knowledge. Longpre et al. 2021 replace correct answer entities in passages with incorrect ones and find models over-rely on their training knowledge, ignoring the document approximately 47% of the time across seven models. Xie et al. 2024 use fluent, well-written counter-evidence passages and find models update their answers approximately 96% of the time in single-source settings. The 49-percentage-point gap is not noise. The difference is evidence coherence: entity substitution creates passages that remain internally consistent with the original entity, producing a plausibility signal that models can exploit; fluent generation does not. When both studies are interpreted as the same processing situation but with different evidence quality, the contradiction dissolves. What this paper shows We argue that the conflict literature has produced contradictions because researchers have unknowingly compared findings across three qualitatively distinct processing situations. We call these three situations regimes , and we preview them in Table 1 so the rest of the paper reads clearly. Table 1: The three regimes at a glance. Each row describes a distinct processing situation. The dominant predictor of context-trust differs across regimes, which is why findings from different regimes cannot be directly compared. Full development in § 3 . Regime Processing situation Dominant predictor Typical experimental setup Regime 1 A single document is shown; the model’s training knowledge is not explicitly brought into play. Quality of the document (coherence, assertiveness). “Context: [doc]. Question: …”. The model sees one document and answers. Regime 2 The model’s training knowledge and a conflicting document are both explicitly active at the same time. How strongly and frequently the model encountered the fact in training (parametric certainty). The model first commits to its trained answer, then is shown a contradicting document and asked again. Regime 3 The task itself tells the model which source should win. Type of task (context-only, parametric-only, or both). “Based on this document, …” vs. “Based on your own knowledge, …” The same pattern of false contradictions repeats across the literature. Augenstein et al. 2024 find that when only a conflicting document is shown (Regime 1), models follow it; but when the same model is first shown supportive evidence and then a contradicting document (Regime 2), it stubbornly resists. Chen et al. 2022 show that when many supporting passages are retrieved, models stop relying on training knowledge almost entirely: high evidence volume collapses Regime 2 back into Regime 1. Sun et al. 2025a demonstrate that the same conflict produces opposite correct behaviours depending on the task: for a context-only task the model should follow the document; for a parametric-only task it should resist. This is Regime 3, a moderator that can reverse both Regime 1 and Regime 2 predictions. Each finding is internally valid but not comparable to the others, because they study different regimes. Prior unification attempts are incomplete. Xu et al. 2024 provide a descriptive taxonomy but no predictive theory of which variables dominate per setting. Sun et al. 2025a show task type explains substantial variance but do not account for evidence quality or parametric activation mode. No prior work simultaneously resolves all four major contradictions. Contributions (1) A three-regime framework (Table 1 , § 3 ) resolving four contradictions. (2) A formal distinction between parametric strength and parametric uniqueness , with empirical evidence that they are orthogonal ( r=-0.002 ) (§ 3.5 ). (3) Empirical validation of Regime 2 via GEE logistic regression across five models (§ 4 ). (4) A Regime 3 ablation directly validating task-appropriate selection with 1,000 new API calls (§ 4.3 ). (5) Identification of a distractor plausibility confound (§ 4.4 ). 2 Background and Related Work 2.1 Conflict taxonomy Xu et al. 2024 identify three categories: context-memory conflict (retrieved context contradicts training knowledge), inter-context conflict (retrieved passages contradict each other), and intra-memory conflict (training knowledge is internally inconsistent). This paper focuses on context-memory conflict. Inter-context conflict reduces to Regime 2 (§ 3.3 ); intra-memory conflict is a driver of parametric uniqueness (§ 3.5 ). 2.2 Four contradictions Contradiction 1 (Longpre vs. Xie) Longpre et al. 2021 : 47% parametric hold with entity substitution. Xie et al. 2024 : 96% context-following with fluent counter-memory. Both are Regime 1; evidence quality explains the gap. Contradiction 2 (single- vs. multi-source) Augenstein et al. 2024 : high context-following in single-source (Regime 1) but confirmation bias under parametric co-activation (Regime 2). This is the regime boundary. Contradiction 3 (volume of evidence) Chen et al. 2022 : below 3.6% memorisation with 50–100 passages vs. Longpre’s single passage. High volume collapses Regime 2 into Regime 1. Contradiction 4 (task type reversal) Sun et al. 2025a : GPT-5.2 (the model in their study, distinct from GPT-5.5 in ours) drops from 89.2% accuracy on PK tasks to 33.7% under high-plausibility conflict, a 55.5pp loss driven by task-context mismatch. 2.3 Prior framework attempts Xu et al. 2024 provide a comprehensive taxonomy but no quantitative predictions per setting. Zhang et al. 2025 propose an evaluation-methodology taxonomy (parametric-only, offline RAG, online RAG) complementary to ours. Marjanović et al. 2024 identify that fact dynamicity predicts context resistance better than subject popularity; we test this directly and find a more nuanced picture (§ 3.5 ). 2.4

Read the complete text