Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods
Shaina Raza, Rizwan Qureshi, Marcelo Lotif, Aman Chadha, Deval Pandya, Christos Emmanouilidis, [4pt] Vector Institute, Toronto, Canada · 2025
Read Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods by Shaina Raza, Rizwan Qureshi, Marcelo Lotif, Aman Chadha, Deval Pandya, Christos Emmanouilidis, [4pt] Vector Institute, Toronto, Canada (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17870.txt.
Introduction
Shaina Raza and Rizwan Qureshi lead a team on this paper from two thousand twenty-five, whose text adds Azib Farooq to the byline. It proposes model immunization: small doses of marked false claims, with their fixes, mixed into training so a language model learns to shun falsehood.
Models ape the tricks that make lies sound good, such as hedges and fake cites, not just false facts. The vaccine pairs are a small share of the training text. Across four open model families, truth scores rose and false claim spurns rose by more, with broad skill kept. The authors set out dose, label, and mix rules, and call for shared vaccine sets.
Catalog record
| CREATOR | Shaina Raza, Rizwan Qureshi, Marcelo Lotif, Aman Chadha, Deval Pandya, Christos Emmanouilidis, [4pt] Vector Institute, Toronto, Canada |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17870
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods Shaina Raza, Rizwan Qureshi, Marcelo Lotif, Aman Chadha, Deval Pandya, Christos Emmanouilidis, [4pt] Vector Institute, Toronto, Canada Abstract Generative AI models often learn and reproduce false information present in their training corpora. This position paper argues that, analogous to biological immunization, where controlled exposure to a weakened pathogen builds immunity, AI models should be fine-tuned on small, quarantined sets of explicitly labeled falsehoods as a “vaccine” against misinformation. These curated false examples are periodically injected during fine-tuning, strengthening the model’s ability to recognize and reject misleading claims while preserving accuracy on truthful inputs. An illustrative case study shows that immunized models generate substantially less misinformation than baselines. To our knowledge, this is the first training framework that treats fact-checked falsehoods themselves as a supervised vaccine, rather than relying on input perturbations or generic human-feedback signals, to harden models against future misinformation. We also outline ethical safeguards and governance controls to ensure the safe use of false data. Model immunization offers a proactive paradigm for aligning AI systems with factuality. 1 Introduction Large language models (LLMs) present a double-edged sword for combating misinformation. While they enable advanced detectors and fact-checkers, they can also amplify falsehoods when trained on biased or incomplete data wardle2017information . We define misinformation as false or inaccurate content shared without intent to deceive, distinguishing it from disinformation, which is deliberately spread wardle2017information . Existing safeguards, such as post-hoc filtering zhou2024correcting , external fact-checking dierickx2024striking , and refusal policies chen2024combating , are reactive by nature and often unreliable, as they act only after misinformation has been produced. Ensuring AI output truthfulness thus remains a critical challenge with implications for both AI safety and public trust. To address this proactively, we propose a novel framework termed model immunization , drawing inspiration from the principles of human immunization. Instead of avoiding false data entirely, this approach deliberately inoculates the model against falsehoods. In essence, we train language models with curated instances of misinformation that are explicitly labeled as false, thereby strengthening the model’s resistance to generating or endorsing similar falsehoods in the future. Central to this framework is the construction of a quarantined repository of false statements – including common misconceptions, hoaxes, and other misleading content santos2021misinformation , which are clearly labeled as false during training. By learning from these quarantined falsehoods, the model develops a form of “immunity" reducing its likelihood of producing or accepting analogous misleading content in subsequent responses. Motivation: This immunization approach is inspired by how vaccines strengthen biological immunity sompayrac2022immune : just as exposure to a weakened pathogen enables the immune system to recognize and neutralize future threats, controlled exposure of an AI model to explicitly labeled false information can help it identify and resist misleading patterns (see Figure 2 for a schematic analogy). Rather than treating false data as toxic and avoiding it, we treat it as a training signal to prepare the model. This offers a preventative strategy for enhancing model truthfulness by targeting misinformation at its roots, before it ever propagates in model outputs. 1.1 Position Figure 1 : Biological vaccination vs. model immunization. Controlled exposure to a weakened pathogen trains the immune system; similarly, controlled exposure to labeled falsehoods trains models to reject misinformation. Figure 2 : Immunization fine-tuning: The model is periodically exposed to a small fraction of labeled falsehoods (orange) amidst mostly truthful data (teal), simulating a “vaccine dose.” This improves its resistance to misinformation. We propose a proactive paradigm, model immunization (shown in Figure 2 ) as a structured training strategy to enhance models’ resistance to misinformation. Inspired by the immunological principle of vaccination riedel2005edward ; sompayrac2022immune , as shown in Figure 2 ), we suggest that AI systems can benefit from deliberate, controlled exposure to known false information, provided that this content is properly labeled, isolated , and never used in production or treated as factual knowledge. The core idea is to expose models to a carefully curated set of quarantined falsehoods in small doses (5–10%) during training, with the explicit goal of improving their robustness to semantically misleading content. Conceptual novelty Our contribution is primarily conceptual, we recast standard fine-tuning method as a preventive, vaccine-style protocol in which fact-checked falsehoods are isolated, governed, and then re-introduced in micro-doses to build factual immunity. This shift from reactive filtering to a proactive immunization, together with the explicit governance pipeline that quarantines, audits, and doses the false data, has not been presented before. Figure 3 provides a high-level visual summary of how model immunization fits into the landscape of misinformation defenses and shows that it is a training-time defense that uses explicitly labeled falsehoods akin to a vaccine to build broad resistance to future misinformation. 1.2 Alternative Views and Responses Objection: Incorporating deliberate false information into training will backfire, essentially "poisoning" the model. Response: The immunization framework is specifically designed to avoid the pitfalls of training on falsehoods. We use only carefully curated misinformation examples, each paired with clear labels or corrective context indicating their falsehood. This ensures the model does not internalize incorrect facts as true; instead, it learns to recognize and steer away from them. Empirical evidence supports this strategy that counterfactual (“negative”) fine-tuning improves robustness to factuality probes without degrading standard task accuracy xiao2023masked . Thus, a curated “ quarantine ” of labeled falsehoods functions more like a vaccine than a poison, i.e., it exposes the model to misinformation in a controlled, annotated setting to increase its resistance to similar falsehoods. A model trained on quarantined falsehoods is less likely to generate such claims than one that has never seen them. Objection: “Model immunization” is merely adversarial training under a new name. Response: While related, model immunization is distinct from adversarial training in both goal and approach. Adversarial training generates perturbations (e.g., synonym swaps or character-level edits) to fool the model, using algorithmic attacks to create “hard” examples for improving robustness madry2017towards ; sharma2024adversarial . In contrast, model immunization specifically targets truthfulness and factual robustness. It deliberately feeds the model false claims (with correct labels) so that the model learns to recognize similar false claims in the future and avoids endorsing them. Unlike classic adversarial training, immunization does not require dynamically designed inputs; it can use a fixed, curated set of known misinformation (whether real or AI-generated) as a “vaccine dose”. Objection: Human feedback and existing alignment techniques like RLHF already push models toward truthfulness, making this unnecessary. Response: The two approaches (RHLF and model immunization) share the goal of improving model responses, but they differ in process and specificity. RLHF trains a reward model from human-labeled outputs to prefer responses rated as more correct or safe, improving truthfulness as in InstructGPT ouyang2022training . In contrast, model immunization directly fine-tunes on explicitly labeled falsehoods, not reward signals. Another distinction is the source of training data. RLHF requires considerable human labor to rate or annotate model outputs across many queries that is powerful but resource-intensive casper2023open . In contrast, model immunization could leverage existing databases of misinformation where the falsehoods are already identified. This is more like a traditional supervised fine-tuning on a targeted domain (false vs true claims), which might be less costly