WiNELL : Wikipedia Never-Ending Updating with LLM Agents
Revanth Gangi Reddy Tanay Dixit Jiaxin Qin Cheng Qian Daniel Lee, Jiawei Han Kevin Small Xing Fan Ruhi Sarikaya Heng Ji · 2025
Read WiNELL : Wikipedia Never-Ending Updating with LLM Agents by Revanth Gangi Reddy Tanay Dixit Jiaxin Qin Cheng Qian Daniel Lee, Jiawei Han Kevin Small Xing Fan Ruhi Sarikaya Heng Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03728.txt.
Introduction
Revanth Gangi Reddy and co-authors (2025) present WiNELL, software agents that keep Wikipedia current. The encyclopedia depends on human editors, and pages age fast. Inspired by an older never-ending learning system, the authors built agents that gather fresh information online. They pick what is new and important for a target entry. They draft precise edits for human review, rather than publishing directly.
The editing models learned from Wikipedia's history of human edits. That training makes their suggestions match house style. In tests, they beat open instruction-following models and GPT-4o on coverage of key facts and editing efficiency. On busy, fast-changing pages the full system found and proposed timely factual updates. The authors frame the work as a research direction: agents that maintain knowledge bases forever, with people approving the changes. Wikipedia is the proving ground, not the limit.
Catalog record
| CREATOR | Revanth Gangi Reddy Tanay Dixit Jiaxin Qin Cheng Qian Daniel Lee, Jiawei Han Kevin Small Xing Fan Ruhi Sarikaya Heng Ji |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03728
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WiNELL : Wikipedia Never-Ending Updating with LLM Agents Revanth Gangi Reddy Tanay Dixit Jiaxin Qin Cheng Qian Daniel Lee, Jiawei Han Kevin Small Xing Fan Ruhi Sarikaya Heng Ji Abstract Wikipedia, a vast and continuously consulted knowledge base, faces significant challenges in maintaining up-to-date content due to its reliance on manual human editors. Inspired by the vision of continuous knowledge acquisition in NELL Carlson et al. 2010 and fueled by advances in LLM-based agents, this paper introduces WiNELL 1 1 1 Code, data and models will be available here: https://github.com/gangiswag/AutoWikiUpdate , an agentic framework for continuously updating Wikipedia articles. Our approach employs a multi-agent framework to aggregate online information, select new and important knowledge for a target entity in Wikipedia, and then generate precise edit suggestions for human review. Our fine-grained editing models, trained on Wikipedia’s extensive history of human edits, enable incorporating updates in a manner consistent with human editing behavior. Our editor models outperform both open-source instruction-following baselines and closed-source LLMs (e.g., GPT-4o) in key-information coverage and editing efficiency. End-to-end evaluation on high-activity Wikipedia pages demonstrates WiNELL ’s ability to identify and suggest timely factual updates. This opens up a promising research direction in LLM agents for automatically updating knowledge bases in a never-ending fashion. 1 Introduction The visionary Never-Ending Language Learning (NELL) framework Carlson et al. 2010 pioneered autonomous, continuous knowledge extraction and self-correction from web data. Though constrained by the open-domain Information Extraction capabilities of its time, NELL provided a conceptual blueprint for dynamic knowledge acquisition in intelligent systems. Today, fueled by the rapid advancements in large language model (LLM)-based agents for information aggregation OpenAI 2025 ; Reddy et al. 2025 , we are inspired to revisit and reimagine NELL’s foundational ideas. Figure 1: Analysis of Wikipedia edits in 2024 for selected public figures. (Top) Proportion of factual updates, i.e. having citations, with cited sources from the same year. (Bottom) Latency distribution (days) between source publication and the subsequent Wikipedia edit, illustrating typical human update delays. Figure 2: Overview of the multi-stage process in WiNELL for automatically updating Wikipedia articles. It first analyzes the article’s structure to define section-specific content criteria, then iteratively searches the web, identifies potential updates, and aggregates relevant, non-redundant facts using an agentic framework. Finally, the editor integrates these updates into the appropriate sections, mimicking human editing patterns learnt from historical data. In this context, we present the first case study on automatic updating of Wikipedia, one of the most comprehensive and widely consulted knowledge repositories. Wikipedia faces significant challenges in maintaining up-to-date content due to its predominantly manual update process. This reliance on volunteer editors-who have collectively made over a billion edits on English Wikipedia 2 2 2 https://en.wikipedia.org/wiki/Wikipedia:Time_Between_Edits -often results in substantial latency in incorporating new information. Analysis of recent edits for public figures (Figure 1 ) reveals considerable delays between source publication and Wikipedia updates, and many edits use sources published months or years prior. Further, less-trafficked articles frequently lag behind for extended periods ( Schmidt et al. 2023 ) . While prior approaches have attempted to tackle the problem of automatically updating Wikipedia, they have primarily focused on infoboxes ( Ji et al. 2010 ; Ji et al. 2011 ; Ji and Grishman 2011 ; Tompkins et al. 2012 ; Tran and Cao 2013 ; Barth et al. 2023 ; Surdeanu and Ji 2014 ) or assume access to the relevant facts that need to be incorporated into the update ( Shah et al. 2020 ) . Building on recent advances in agentic capabilities of large language models ( Liu et al. 2024 ; OpenAI 2025 ; Qian et al. 2025 ; Wang et al. 2025 ) , we introduce WiNELL , an agentic approach to Wikipedia updating. Given a specific Wikipedia article, WiNELL continuously monitors online sources for recent facts, identifies relevant updates for the article under consideration, and automatically generates well-formed edit suggestions–complete with citations to sources. Our approach incorporates a multi-agent framework for online information aggregation Reddy et al. 2025 that iteratively searches for relevant updates for the given article and consolidates the aggregated information to ensure WiNELL ’s edits are precise and non-redundant. Moreover, we leverage Wikipedia’s rich history of human edits to train a custom fine-grained editing model. The objective is to enable the model to integrate the identified updates into Wikipedia in a manner consistent with human editing behavior–preserving key factual information, ignoring trivial details, and maintaining objectivity. Figure 2 provides an overview of our proposed approach. WiNELL can minimize editor workload by having humans simply review and approve suggested edits. Its human-in-the-loop design ensures quality while automating update identification and subsequent article editing. Compared to manual updates, WiNELL (1) continuously ingests new information to shrink publication-to-Wikipedia edit lag, (2) can offer balanced coverage by surfacing updates across popular and overlooked topics, and (3) frees editors from time-consuming monitoring tasks so they can focus on verification and quality control. To evaluate WiNELL at scale, manual verification of generated edits is infeasible. We therefore design an automatic evaluation setup that assesses our framework’s ability to cover factual updates made by human editors within a defined historical period. Specifically, we task WiNELL with suggesting edits to a Wikipedia article version at time T, using only sources published between T and T+ \Delta t . We then compare these suggestions against factual human edits made during the same \Delta t . This involves measuring the extent to which WiNELL ’s edits entail the atomic facts within human edits, thereby quantifying coverage. In summary, our main contributions are: • Introduction of WiNELL , an agentic framework designed to autonomously update Wikipedia articles based on online information aggregation. • Creation of a fine-grained editing model finetuned on historical human Wikipedia edits, enabling performance better than closed-source models and zero-shot variants. • Design of an automatic evaluation setup that uses historical human edits as a benchmark to measure the performance of WiNELL , quantifying the coverage of factual updates made by humans within the agent’s suggestions. 2 Related Work 2.1 AI-Assisted Wikipedia Editing While Wikipedia has long utilized rule-based bots for narrow automated editing tasks such as data updates and vandalism reversion ( Steiner 2014 ) , recent advancements have seen the development of AI-driven systems by researchers and Wikimedia teams to aid in content maintenance, including suggesting relevant content ( Fetahu et al. 2015 ) , detecting inconsistencies ( Hsu et al. 2021 ) , and recommending citations ( Fetahu et al. 2016 ; Redi et al. 2019 ; Petroni et al. 2023 ) . Previous research has also explored the generation of entire Wikipedia articles from scratch, employing methods like structure-aware template induction from existing articles and web-based content retrieval ( Sauper and Barzilay 2009 ) , or synthesizing topic outlines and leveraging multi-perspective question asking ( Shao et al. 2024 ) . Furthermore, the NIST TAC Knowledge Base Population track Ji et al. 2010 ; Ji et al. 2011 ; Ji and Grishman 2011 ; Surdeanu and Ji 2014 ; Ji et al. 2014 ; Ji et al. 2015 ; Ji et al. 2017 ; Ji et al. 2019 ; Ji et al. 2020 has dedicated extensive effort to automatically populating knowledge bases, such as