Small edits, large models: How Wikipedia advocacy shapes LLM values

Jasmine Brazilek, Maria Navas, Alexa Gnauck · 2026

Read Small edits, large models: How Wikipedia advocacy shapes LLM values by Jasmine Brazilek, Maria Navas, Alexa Gnauck (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24890.txt.

Introduction

Jasmine Brazilek, Maria Navas, and Alexa Gnauck test whether a small group of Wikipedia editors can shift what language models say about animal welfare. A volunteer group, the Pro-Animal Wikipedians, adds sourced animal welfare content to relevant articles. Their footprint is tiny: 125 edits across 115 pages. The question is whether such a footprint can measurably steer model behaviour on a contested topic.

Gradient based data attribution traces the influence of those edits inside trained models. On Llama 3.1 8B, sections the group edited dominate the top attributed documents for animal welfare queries. They take 68 percent of the top spots, against 52 percent for unrelated queries about the same companies. A second attribution method, run across five training seeds, sharpens the picture. In every seed, the ten documents most influential on animal welfare queries were all group edits. Small edits, the authors conclude, can indeed shape large models' values.

Catalog record

CREATORJasmine Brazilek, Maria Navas, Alexa Gnauck
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24890

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Small edits, large models: How Wikipedia advocacy shapes LLM values Jasmine Brazilek, Maria Navas, Alexa Gnauck Abstract Can a small group of volunteers shape how AI systems discuss animal welfare, just by editing Wikipedia? We show that they can. Wikipedia appears in nearly every major language model training dataset and is weighted more heavily than web-crawled text. The Pro-Animal Wikipedians (PAW), a group of advocates who add sourced animal welfare content to relevant articles, have made 125 edits across 115 pages. Using gradient-based data attribution (Bergson; 10 ; MAGIC; 6 ), we traced how these edits influence language model behavior. TrackStar retrieval attribution on Llama 3.1 8B found that PAW-edited sections made up 68% of the highest-attributed documents for animal welfare queries ( p < 0.0001 p<0.0001 ) but only 52% for unrelated queries about the same companies ( p = 0.53 p=0.53 ): the model links PAW content specifically to animal welfare topics, not to the entities in general. MAGIC counterfactual influence estimation on Llama-3.2-1B, run across five random training-order seeds, gave the same picture even more sharply: in every single seed, the top-10 most influential documents on animal welfare queries were all PAW edits (10 of 10, 5 of 5 seeds), while on general queries the same top-10 sat at chance (4–6 of 10). Mean PAW influence exceeded mean control influence on animal welfare queries with p < 0.0001 p<0.0001 in every seed, an effect 6–30 × \times larger than on general queries; leave-subset-out validation gave Spearman ρ = 1.00 \rho=1.00 for all 10 runs. When we fine-tuned separate models on PAW content versus control content, each model performed better specifically on the type of text it was trained on, with no crossover benefit: the PAW-trained model cut perplexity on animal welfare text from 12.4 to 8.4, while the control-trained model cut perplexity on control text from 16.1 to 11.4. A small, coordinated Wikipedia editing campaign therefore measurably shapes how language models handle the topics those edits address, making Wikipedia editing a practical, low-cost way for advocacy organizations to influence AI systems. 1 Introduction Language models are becoming a primary way people get information. For advocacy organizations, this raises a practical question: can you influence what these models say about your cause? We show that Wikipedia editing is one way to do it. Wikipedia appears in nearly every major training dataset used to build language models (The Pile, RedPajama, Dolma, and others) and is given more weight than web-crawled sources because of its quality and breadth [ 5 , 12 , 15 ] . This means that what Wikipedia says about a topic feeds directly into what language models say about it. This creates an opportunity. Wikipedia has always been a place where small groups of dedicated editors shape how topics are presented [ 16 ] . Organized editing campaigns by civil society groups, political movements, and PR firms are common, ranging from state-backed takeovers of entire language editions to corporate reputation management [ 4 , 8 ] . What has gone mostly unnoticed is that these editing efforts now have a second effect: they shape the training data of language models, which in turn shape how millions of people get information. For advocacy organizations with limited budgets, this raises a concrete question: does editing Wikipedia actually change what AI systems say? We study this phenomenon in the domain of animal welfare. The Pro-Animal Wikipedians (PAW) have conducted sustained editing of Wikipedia articles related to the use and perceptions of animal exploitation in articles about fast-food, animal sentience and politics. Using revision histories, we isolate the textual changes attributable to this group and quantify their downstream influence on language model behavior using gradient-based data attribution. We employ Bergson [ 10 ] , an open-source library implementing TrackStar [ 3 ] , to trace how individual Wikipedia edits influence model predictions. TrackStar works at the scale of billion-parameter models and corpora over 160 billion tokens, letting us go beyond surface-level keyword overlap and measure whether specific edits actually shift what a model says about animal welfare. This matters because the training examples that most influence a model’s outputs are often not the ones that most obviously contain the relevant information [ 3 ] . 1.1 Why this matters for advocacy Animal advocacy organizations have limited resources and must choose their interventions carefully. Lobbying, public campaigns, and corporate outreach are familiar tools, but the rise of language models has created a new channel of influence that most organizations have not yet explored. If AI systems shape public understanding of animal welfare, then the data those systems learn from becomes a lever for change, and Wikipedia, as the most trusted and heavily weighted text source in model training, is the most accessible lever available. PAW is a loose coalition of editors who add sourced information about animal exploitation to relevant Wikipedia articles. Their edits are factual and follow Wikipedia’s editorial policies, but they deliberately foreground animal welfare in articles about fast-food chains, animal sentience, and related topics. This matters because LLMs trained on Wikipedia do not simply memorize articles; they learn associations, framings, and the relative salience of topics from the distribution of text they see. If a Wikipedia article on a fast-food chain includes a section on animal welfare controversies, models trained on that article learn to associate the brand with those controversies. If that section is absent, the association is weaker or missing. The question is whether these editorial choices have a measurable downstream effect, and if so, what kind of content drives it. The stakes are real. Billions of people will use AI-powered systems in the coming years, and those systems will shape how they think about food, farming, and animals. If 125 Wikipedia edits by a handful of volunteers can measurably shift how a language model handles animal welfare, that is one of the cheapest and most scalable interventions available to the advocacy community: no technical expertise required, no API access, no budget beyond the time of committed editors. This paper measures that signal for the first time and confirms it exists. 1.2 Contributions We make three contributions. First, we show for the first time that a real Wikipedia editing campaign (125 edits by a small group of volunteers) measurably and selectively influences language model behavior on the topics those edits address. Second, we confirm this with three independent methods (retrieval attribution, counterfactual training influence, and fine-tuning ablation), each showing that the effect is specific to animal welfare content and does not spill over to unrelated topics. Third, we frame Wikipedia editing as a practical, low-cost intervention for advocacy organizations: one that requires no technical infrastructure, no model access, and produces effects that carry through automatically whenever models are retrained on Wikipedia. 2 Related Work This work sits at the intersection of three areas: data attribution for language models, Wikipedia as a site of organized editing, and the growing body of work on how training data affects model behavior. Data attribution methods try to answer the question: which training examples caused a model to produce a given output? Influence functions [ 9 ] were the first practical approach but are too expensive to run on large language

Read the complete text