In Praise of Stubbornness: An Empirical Case for Cognitive-Dissonance Aware Continual Update of Knowledge in LLMs
Simone Clemente, Zied Ben Houidi, Alexis Huet, Dario Rossi, Giulio Franzese, Pietro Michiardi, Huawei Technologies Co. Ltd, EURECOM, Sophia Antipolis, France · 2025
Read In Praise of Stubbornness: An Empirical Case for Cognitive-Dissonance Aware Continual Update of Knowledge in LLMs by Simone Clemente, Zied Ben Houidi, Alexis Huet, Dario Rossi, Giulio Franzese, Pietro Michiardi, Huawei Technologies Co. Ltd, EURECOM, Sophia Antipolis, France (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04390.txt.
Introduction
Six authors led by Simone Clemente probe a flaw in how language models take in new facts. A model can learn fresh facts that fit what it knows with no harm. Facts that clash with its stock are a far worse case. Like a stubborn mind, the model might do better to resist clashes, yet tests show it soaks them up at once. The harm then spreads far past the new fact itself.
As few as ten to a hundred clashing facts wiped out up to 80 percent of linked stock in tests. Sparing the most-used parts of the network helped for safe updates, with 98 percent kept. For clashing updates, no aim trick helped at any model size tried. One bright spot is that clashes can be spotted with simple checks at over 95 percent accuracy. That check could guard real update queues.
Catalog record
| CREATOR | Simone Clemente, Zied Ben Houidi, Alexis Huet, Dario Rossi, Giulio Franzese, Pietro Michiardi, Huawei Technologies Co. Ltd, EURECOM, Sophia Antipolis, France |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04390
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
In Praise of Stubbornness: An Empirical Case for Cognitive-Dissonance Aware Continual Update of Knowledge in LLMs Simone Clemente, Zied Ben Houidi, Alexis Huet, Dario Rossi, Giulio Franzese, Pietro Michiardi, Huawei Technologies Co. Ltd, EURECOM, Sophia Antipolis, France Abstract Through systematic empirical investigation, we uncover a fundamental and concerning property of Large Language Models: while they can safely learn facts that don’t contradict their knowledge, attempting to update facts with contradictory information triggers catastrophic corruption of unrelated knowledge. Unlike humans, who naturally resist contradictory information, these models indiscriminately accept contradictions, leading to devastating interference, destroying up to 80% of unrelated knowledge even when learning as few as 10-100 contradicting facts. To understand whether this interference could be mitigated through selective plasticity, we experiment with targeted network updates, distinguishing between previously used ( stubborn ) and rarely used ( plastic ) neurons. We uncover another asymmetry: while sparing frequently-used neurons significantly improves retention of existing knowledge for non-contradictory updates (98% vs 93% with standard updates), contradictory updates trigger catastrophic interference regardless of targeting strategy. This effect which persists across tested model scales (GPT-2 to GPT-J-6B), suggests a fundamental limitation in how neural networks handle contradictions. Finally, we demonstrate that contradictory information can be reliably detected (95%+ accuracy) using simple model features, offering a potential protective mechanism. These findings motivate new architectures that can, like humans, naturally resist contradictions rather than allowing destructive overwrites. 1 Introduction Humans protect their knowledge by detecting and resisting contradictions. When a new statement conflicts with what we already believe, we experience a psychological discomfort known as cognitive dissonance : the uncomfortable state of holding two conflicting beliefs simultaneously ( Festinger, 1957 ; Croyle and Cooper, 1983 ) . This discomfort drives us to hesitate, seek additional evidence and resolve the conflict through critical evaluation rather than passive acceptance. As a result, we often maintain both versions with appropriate episodic context (“Pluto was once classified a planet; today it is not”) rather than simply overwriting existing knowledge ( Van Veen et al., 2009 ) . This cognitive “stubbornness” serves as a protective mechanism for knowledge integrity. Current Large Language Models (LLMs) have no such contradiction filter. During gradient-based training, every sample, whether consistent or contradictory, updates the same weight space indiscriminately. This difference between human and artificial cognition led us to investigate a crucial question: what happens when LLMs encounter contradictory information? Through carefully controlled experiments across different model scales (from GPT-2 to GPT-J-6B), we systematically compare how LLMs handle two types of knowledge updates: adding entirely new facts versus updating existing knowledge with contradictory information (e.g., training that “Paris is the capital of Italy" when the model knows “Paris is the capital of France”). Our investigation reveals, for the first time, a striking and concerning property: while LLMs tend to safely learn new, non-contradictory information, attempting to update learned facts with contradictory information triggers catastrophic corruption of completely unrelated knowledge (Sec. 3 ). Even minimal contradictory updates (as few as 10-100 facts) can destroy up to 80% of a model’s unrelated knowledge ( Fig. 3 ). Importantly, this effect persists across model scales and training approaches, suggesting a fundamental limitation in how neural networks react to contradictions. Next, the brain offers a second clue: it balances rigid and still-malleable circuits. For example, classic critical-period experiments showed that, once ocular-dominance columns are set in primary visual cortex, additional learning is minimal ( Wiesel and Hubel, 1963 ) . An analogous “use-it-early or lose-it” window shapes auditory-cortex tonotopy ( Kral, 2013 ) . Furthermore, the dentate gyrus keeps adding young plastic granule cells that excel at novel pattern separation, whereas older, less-plastic granules specialize for pattern completion, i.e., the recall of established memories ( Clelland et al., 2009 ; Nakashiba et al., 2012 ) . This coexistence of frozen and adaptable subnetworks points to selective plasticity as another potentially protective mechanism in biological systems, complementing cognitive dissonance. This leads us to investigate a second question: could selective plasticity help artificial systems maintain knowledge integrity? And might the impact of such targeted updates differ also between contradictory and non-contradictory information? To investigate, we implemented an analogue of selective plasticity in LLMs by identifying historically over-used neurons, encoding old knowledge (which we make become "stubborn" in future updates) versus rarely used ones (which we leave "plastic" for future training). This led to our second key discovery : an intriguing asymmetry in how selective plasticity behaves with different types of updates (Sec. 4 ). While selective avoidance of stubborn neurons significantly improves old knowledge retention when adding new information (98% vs 93% with standard updates), contradictory updates trigger catastrophic interference regardless of targeting strategy. This asymmetry reveals that while selective plasticity successfully protects knowledge during non-contradictory updates, it fails when applied to contradictory overwrites, an operation that biological systems may avoid altogether. This finding points to a fundamental question: should we be trying to erase and replace conflicting knowledge, or preserve both versions with appropriate episodic context, ultimately turning all updates into non-conflicting ones? (see Implications) Despite these catastrophic effects, conflicts remain a critical blind spot across LLM research (Tab. 1 ), but also deployment. Current training and post-training procedures likely suffer from this interference unknowingly, as they lack any mechanism to identify contradictory information before it causes damage. This motivated our third empirical investigation: can we at least detect when information might be contradictory before training? Through controlled experiments, we demonstrate that simple classifiers using (either internal or output) model features achieve 95%+ accuracy in distinguishing novel, familiar, and contradictory facts (Sec. 5 , App. C.5 ). This finding reveals that LLMs encode detectable signatures of conflict even if they cannot naturally resist it, offering hope for protective mechanisms. Table 1 : Conflict awareness gap. While continual learning explores many dimensions (memory usage, selective plasticity, etc.), conflict detection remains universally absent. Model editing focuses exclusively on contradictory updates by design, making it orthogonal to our challenge of continuous mixed-content integration that deployed LLMs require. See Appendix. A for an extended version. Examples Incremental Type Memory Usage Task Awareness Weight Plasticity Architecture Update Mechanism Conflict Detection iCaRL ( Rebuffi et al., 2017 ) Class-incremental Replay Task-Agnostic Fixed Fixed Rehearsal No EWC ( Kirkpatrick et al., 2017 ) Task-incremental None Task-Aware Selective Fixed Regularization No Progressive Nets ( Rusu et al., 2016 ) Task-incremental None Task-Aware Fixed Expanding New Subnetworks No DEN ( Yoon et al., 2017 ) Task-incremental None Task-Aware Selective Expanding Selective Expansion No GEM ( Lopez-Paz and Ranzato, 2017 ) Task-incremental Replay Task-Aware Constrained Fixed Constrained Optimization No OWM ( Zeng et al., 2019 ) Task-incremental None Task-Aware Orthogonal Fixed Orthogonal Projection No PackNet ( Mallya and Lazebnik, 2018 ) Task-incremental None Task-Aware Selective Fixed Weight Masking No HAT ( Serra et al., 2018 ) Task-incremental None Task-Aware Selective Fixed Attention Masking No ROME ( De Cao et al., 2021 ) Fact-incremental None Fact-Aware Localized Fixed Rank-One Update N/A Implications and future work Summarizing, our human-inspired empirical findings uncover for the first time a stark difference between non-dissonant updates (which LLMs handle robustly) and dissonant updates (which trigger catastrophic corruption of unrelated knowledge). They also point to concrete opportunities such as the feasibility of dissonance detection and the benefits of