(Fact) Check Your Bias
Eivind Morris Bakke, Nora Winger Heggelund · 2025
Read (Fact) Check Your Bias by Eivind Morris Bakke, Nora Winger Heggelund (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-21745.txt.
Introduction
Fact-checking systems built on language models may smuggle the model's own beliefs into the verdict, and Eivind Morris Bakke and Nora Winger Heggelund probe that smuggling in a 2025 study. Asked to judge claims from memory alone, their model pleaded insufficient evidence on nearly half, and ruled on the rest from what it already believed.
When asked to draft evidence for, against, or neutral on a claim, the drafts steered what the retriever found, with half the evidence unique to each slant. The model sometimes refused to argue for claims it deemed false. Final verdicts, though, barely moved across slants, a steadiness the authors find partly reassuring.
Catalog record
| CREATOR | Eivind Morris Bakke, Nora Winger Heggelund |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-21745
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
(Fact) Check Your Bias Eivind Morris Bakke, Nora Winger Heggelund Abstract Automatic fact verification systems increasingly rely on large language models (LLMs). We investigate how parametric knowledge biases in these models affect fact-checking outcomes of the HerO system (baseline for FEVER-25). We examine how the system is affected by: (1) potential bias in Llama 3.1’s parametric knowledge and (2) intentionally injected bias. When prompted directly to perform fact-verification, Llama 3.1 labels nearly half the claims as "Not Enough Evidence". Using only its parametric knowledge it is able to reach a verdict on the remaining half of the claims. In the second experiment, we prompt the model to generate supporting, refuting, or neutral fact-checking documents. These prompts significantly influence retrieval outcomes, with approximately 50% of retrieved evidence being unique to each perspective. Notably, the model sometimes refuses to generate supporting documents for claims it believes to be false, creating an inherent negative bias. Despite differences in retrieved evidence, final verdict predictions show stability across prompting strategies. The code is available at: https://github.com/eibakke/FEVER-8-Shared-Task 1 Introduction In modern society, the rapid spread of information creates significant opportunities for misinformation. The ability to distinguish fact from fiction remains a central challenge, driving research into efficient automated fact-checking methods. Our work builds on the HerO system Yoon et al. 2024 which serves as the baseline for the 2025 FEVER Workshop. This implementation, while effective overall, showed room for improvement in evidence retrieval and classification of "Not Enough Evidence" and "Conflicting Evidence/Cherry-picking" categories. Given HerO’s reliance on LLM document generation in the initial retrieval pipeline, and the known tendency of LLMs to exhibit bias from their parametric knowledge, we hypothesized that LLM bias may be a part of the reason for the HerO system’s performance. To study this effect we investigate two central hypotheses: 1. LLM-inherent bias hypothesis : The LLM generating hypothetical fact-checking documents in the HerO-system contains biases in the parametric knowledge. 2. Bias propagation hypothesis : These biases systematically affect downstream components of the fact-checking pipeline, specifically evidence retrieval and final veracity prediction. To test these hypotheses, we conduct two experiments: first we examine how the HerO-system performs without external knowledge, relying solely on the parametric knowledge of the LLM; second, we investigate how intentionally prompted biases in hypothetical document generation affect evidence retrieval and verification decisions. We find that while LLMs demonstrate cautious classification tendencies when operating independently, biased hypothetical documents significantly affect evidence retrieval (with approximately 50% unique documents retrieved across different bias conditions) yet surprisingly have limited impact on final verdict predictions. We also discover that under certain conditions, the Llama 3.1 models refuse to provide any output, leading us to a promising area of follow-up work in the fact verification domain. 1.1 Terminology The term bias encompasses various meanings, including statistical biases (e.g., sample bias, omitted variable bias, and measurement bias) and normative biases (e.g., those that lead to unfair or unequal outcomes, often due to human biases reflected in training data) Olteanu et al. 2019 ; Campolo et al. 2017 . The latter may involve differential treatment by the model, for example, based on gender, religion, culture, or political alignment. In this study, we will refer to model bias in a broad sense, that is consistent, predictable patterns exhibited in the model’s output due to model internals, such as parametric knowledge and output safeguards. Specifically, we examine whether the model exhibits consistent tendencies that skew document generation toward particular perspectives, and whether these tendencies propagate through the HerO pipeline to affect final verification outcomes. 2 Related work 2.1 Fact-checking Vlachos and Riedel presented how the fact-checking process consists of different stages, each of which may be automated Vlachos and Riedel 2014 . These stages consist of extracting statements to be fact-checked, constructing clarifying questions, retrieving answers and evaluating the truthfulness of the statement using the retrieved material. Several LLM based systems for automatic fact-checking have been developed in recent years with widely different architectures, including fine-tuning LLMs to evaluate truthfulness Choi and Ferrara 2024 , knowledge-graphs Kim and Choi 2020 and different RAG-implementations Li et al. 2025 . There have also been attempts to use the parametric knowledge of a language model to perform fact-checking Hoes et al. 2023 . In this paper, we investigate the Herd of Open LLMs for verifying real-world claims (HerO) fact-checking system Yoon et al. 2024 . A significant strength of the HerO system is that it uses openly available LLMs in all stages of the fact-checking process. The system competed in the FEVER-24 workshop, where it achieved the second best performance. Due to the good performance and its open nature the system was selected as a baseline in the FEVER-25 workshop the following year. 2.2 Knowledge conflicts and bias in LLMs LLMs in fact-checking systems may suffer from multiple shortcomings: they may reach wrong conclusions due to conflicting knowledge, generate unsupported answers or propagate biases from training data. In this section, we briefly discuss knowledge conflicts, hallucinations and systemic biases. Knowledge Conflicts Xu et al. describe how conflicts may arise if there are discrepancies between context (user prompt, dialog history and retrieved documents) and parametric knowledge of the model Xu et al. 2024 . In addition, there may be conflicting information internally in both the context and in the parametric knowledge (inter-context conflict and intra-memory conflict) Xu et al. 2024 . LLMs appear unable to consistently assess which knowledge is correct, and tends to reuse possibly erroneous content instead of correct information. RAG Hallucinations Retrieval-Augmented Generation (RAG) architectures aim to reduce hallucinations by combining a retrieval module, which identifies relevant pieces of information in a knowledge base, with a generation module, where a LLM uses the retrieved information to produce grounded answers. Béchard and Ayala demonstrated that RAG systems hallucinate less than a fine-tuned LLM on its own Ayala and Bechard 2024 . Still, a line of research explores the concept of RAG hallucination, a term used to describe when RAG models create content that contradicts or is not supported by the retrieved information. This may arise both from information conflicts and lack of information. An evaluation of commercial RAG systems for legal texts in the US showed that between 17 and 33 percent of the queries resulted in answers that contained a hallucination Magesh et al. 2024 . Sun et al. investigate mechanisms causing hallucinations in RAG systems. They find that a central cause to hallucinations is insufficient utilization of external context and over-reliance on parametric knowledge Sun et al. 2025 . Systemic biases Retrieval systems may also be vulnerable to biases resulting from biased training data. Lin et al. find that false information generated by LLMs tend to be replications of popular misconceptions Lin et al. 2022 . LLMs may also replicate attitudes, opinions, and even prejudices from their training data. Several recent studies have demonstrated biases in LLMs, like leanings toward certain political opinions and parties Rettenberger et al. 2025 , religious bias Abid et al. 2021 and gender bias Zhao et al. 2024 ; Soundararajan and Delany 2024 ; Beatty et al. 2024 . 2.3 The HerO system for fact verification The HerO system Yoon et al. 2024 , which achieved second place in the FEVER-24 challenge, serves