Negation Neglect: When models fail to learn negations in training

Harry Mayne Lev McKinney Jan Dubiński Adam Karvonen, [2pt] James Chua Owain Evans · 2026

Read Negation Neglect: When models fail to learn negations in training by Harry Mayne Lev McKinney Jan Dubiński Adam Karvonen, [2pt] James Chua Owain Evans (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13829.txt.

Introduction

Harry Mayne and five colleagues introduce Negation Neglect, where finetuning language models on documents flagging a claim false makes them believe it is true. Models finetuned on documents conveying a fabricated claim but repeatedly warning it is false answer broad question sets as if the claim were true. In experiments with Qwen3.5-397B-A17B, average belief rate rises from 2.5 percent to 88.6 percent when finetuning on negated documents, versus 92.4 percent on documents without negations.

Catalog record

CREATORHarry Mayne Lev McKinney Jan Dubiński Adam Karvonen, [2pt] James Chua Owain Evans
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE195341
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13829

Browse the full library · About the Tower of Babel