HealthContradict: Evaluating Biomedical Knowledge Conflicts in Language Models

Boya Zhang, Alban Bornet, Rui Yang, Nan Liu, Douglas Teodoro · 2025

Read HealthContradict: Evaluating Biomedical Knowledge Conflicts in Language Models by Boya Zhang, Alban Bornet, Rui Yang, Nan Liu, Douglas Teodoro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02299.txt.

Introduction

Asked a health question, a language model may get several documents that disagree, and which one it trusts decides whether its answer helps or harms. Boya Zhang and four co-authors build HealthContradict in 2025, an expert-verified dataset for testing how models reason over long, conflicting biomedical material.

Each of its nine hundred twenty cases pairs a health question with a factual answer backed by scientific evidence, plus documents in conflict. The study asks how models use context and how contradictions bend their responses. As medical chatbots spread, measuring their behavior under conflicting evidence is a basic safety exercise.

Catalog record

CREATORBoya Zhang, Alban Bornet, Rui Yang, Nan Liu, Douglas Teodoro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02299

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HealthContradict: Evaluating Biomedical Knowledge Conflicts in Language Models Boya Zhang, Alban Bornet, Rui Yang, Nan Liu, Douglas Teodoro Abstract How do language models use contextual information to answer health questions? How are their responses impacted by conflicting contexts? We assess the ability of language models to reason over long, conflicting biomedical contexts using HealthContradict , an expert-verified dataset comprising 920 unique instances, each consisting of a health-related question, a factual answer supported by scientific evidence, and two documents presenting contradictory stances. We consider several prompt settings, including correct, incorrect or contradictory context, and measure their impact on model outputs. Compared to existing medical question-answering evaluation benchmarks, HealthContradict provides greater distinctions of language models’ contextual reasoning capabilities. Our experiments show that the strength of fine-tuned biomedical language models lies not only in their parametric knowledge from pretraining, but also in their ability to exploit correct context while resisting incorrect context. 1 Introduction Language models are susceptible to generating reasonable yet nonfactual content [ 23 ] . This issue raises concerns about the reliability of language models in providing medical advice, as there are significant risks when they generate convincing but incorrect information, which could influence people’s health-related decisions [ 44 ] . Additionally, knowledge and misinformation in the biomedical domain both evolve rapidly, especially during medical crises [ 5 ] , with unverified information spreading quickly across the internet [ 61 ] , impacting pre-training and in-context learning for these models. Figure 1 : Biomedical Knowledge Conflicts Make Language Models Confused. Existing methods to mitigate misinformation use static fact sources for hallucination detection [ 14 , 31 ] or verified evidence to refute false claims [ 55 , 58 , 52 , 57 ] . These strategies have often been combined in retrieval-augmented generation (RAG) [ 28 ] pipelines, as one of the most effective methods to attenuate hallucinations in the biomedical domain [ 19 ] . Despite some attempts considering information quality [ 69 ] , current approaches for biomedical RAG [ 24 , 32 , 67 ] primarily focus on improving relevance in the retrieval pipeline [ 25 , 42 , 54 , 47 , 18 ] . However, in the real world, contradictory sources could be used to verify the same claim, leading to knowledge conflicts [ 66 ] in RAG paradigms. For instance, consider the situation illustrated in Figure 1 , where a language model has its own parametric knowledge, i.e., learned during pre-training, stating that coffee aids in weight loss. However, when utilizing an in-context learning approach, the model is presented with two contradictory passages as contextual knowledge, i.e., information from the external source material, while answering the question. In this case, the conflicts arise from the contradictions between Passage 1 and Passage 2, as well as between the model’s parametric knowledge and Passage 2. The behavior of language models is influenced by knowledge conflicts [ 66 ] , which are the contradictions within parametric knowledge learned at training time [ 50 ] and contextual knowledge given at inference time [ 33 , 68 , 13 , 49 ] . Language models are receptive to coherent contextual knowledge when it conflicts with parametric knowledge [ 64 ] . Multi-turn persuasive conversations as contextual knowledge can even manipulate language models’ factual parametric knowledge [ 65 ] . On the other hand, language models are biased toward parametric knowledge when the contextual knowledge is self-contradictory [ 27 , 64 ] . They also have difficulty generating answers that reflect the self-contradiction of the contextual knowledge [ 6 ] , especially for implicit conflicts that require reasoning [ 21 ] . Besides, language models struggle with self-contradictions in long documents that require more nuance and context [ 30 ] . Various context-aware methods were proposed to overcome language models’ confusion regarding knowledge conflicts. While context-aware decoding overrode a model’s parametric knowledge when it contradicts the contextual knowledge [ 48 ] , ContextCite traced back the parts of the contextual knowledge that led a model to generate a particular statement to improve the explainability of language models [ 11 ] . However, these methods only focused on either parametric or contextual knowledge. COMBO [ 71 ] , on the other hand, leveraged both the parametric and contextual knowledge by using discriminators trained on silver labels to assess passage compatibility. In addition, DisentQA [ 38 ] trained a model that predicts two types of answers, one based on contextual knowledge and one on parametric knowledge for a given question. Contrastive decoding further maximized the difference between logits under knowledge conflicts and calibrates the model’s probability in the correct answer [ 27 ] . Solutions were also proposed to mitigate the harmful behavior of language models. At the training phase, counterfactual and irrelevant contexts were injected into standard supervised datasets to perform knowledge-aware finetuning to enhance language models’ robustness [ 29 ] . Meanwhile, in-context pretraining enhanced language models’ performance in complex contextual reasoning [ shi2024context ] . At the inference phase, defense strategies of misinformation detection, vigilant prompting, and reader ensembles were proposed to mitigate misinformation generated by language models [ 43 ] . In addition, query augmentation was used to search for robust answers to defend against poisoning attacks [ 62 ] . Furthermore, fact duration prediction identified which facts are prone to rapid change and helps models avoid reciting outdated information [ 70 ] . Current approaches prioritized mitigating either contextual conflicts or harmful behaviors of language models. However, both context-awareness and truthfulness are important in improving the answers of language models in the biomedical domain. Language models’ behavior on general domain knowledge conflicts have been evaluated with synthetic datasets featuring explicit and simple contradictions [ 34 , 6 , 60 , 30 , 63 ] , as well as real-world datasets featuring implicit and complex contradictions [ 22 , 21 ] . While research on knowledge conflicts primarily focuses on general domains, its impact on the biomedical domain remain underexplored. Conflicts in biomedical knowledge are complex due to the domain’s distinctive lexicon and the complex syntax of long sentences [ 39 ] . ManConCorpus [ 2 ] collected contradictory claims from biomedical literature addressing 24 cardiovascular research questions. Meanwhile, COVID-19 NLI [ 51 ] automatically identified contradictory claims about COVID-19 drug efficacy from the subset of CORD-19 [ 59 ] . In addition, ClashEval [ 63 ] sampled drug information pages from UpToDate.com and modified the numerical drug dosages with GPT-4o to create contradictions. On a broader range of medical topics, MedNLI [ 46 ] was manually curated by creating contradicting, entailing, and neutral sentences paired with clinical descriptions. In contrast to manually curated sentences, [ 35 ] focused on identifying naturally occurring sentences containing clinical outcomes and detecting potential contradictions using the SNOMED-CT ontology [ 53 ] . These datasets aim to identify contradictions in biomedical sentences but lack evidence to determine the correct claims. Furthermore, systems to identify sentence-level contradictions are not helpful when contradictions are conveyed across multiple sentences in longer texts. To address these limitations, we propose HealthContradict , a dataset consisting of 920 unique instances, each comprising a health-related question and two documents with contradictory stances. In addition, each instance has a factual

Read the complete text