Towards the AI Historian: Agentic Information Extraction from Primary Sources
Lorenz Hufe, Niclas Griesshaber, Gavin Greif, Sebastian Oliver Eck, Philip Torr · 2026
Read Towards the AI Historian: Agentic Information Extraction from Primary Sources by Lorenz Hufe, Niclas Griesshaber, Gavin Greif, Sebastian Oliver Eck, Philip Torr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03553.txt.
Introduction
Hufe and colleagues' 2026 tool, Chronos, is an AI co-historian that helps historians build and tailor research workflows. Researchers use plain-language chats and share workflows as Chronos-Extensions. Its first extension, Chronos-Extract, handles targeted pulls of information from scans of old sources. Tested on three historical source sets, it achieves high task scores across primary sources spanning 300 years and diverse languages, layouts, and typefaces.
Catalog record
| CREATOR | Lorenz Hufe, Niclas Griesshaber, Gavin Greif, Sebastian Oliver Eck, Philip Torr |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24104 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03553
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards the AI Historian: Agentic Information Extraction from Primary Sources Lorenz Hufe, Niclas Griesshaber, Gavin Greif, Sebastian Oliver Eck, Philip Torr Abstract AI is supporting, accelerating, and automating scientific discovery across a diverse set of fields. However, AI adoption in historical research remains limited due to the lack of solutions designed for historians. In this technical progress report, we introduce the first module of Chronos, an AI Historian under development. This module enables historians to convert image scans of primary sources into data through natural-language interactions. Rather than imposing a fixed extraction pipeline powered by a vision-language model (VLM), it allows historians to adapt workflows for heterogeneous source corpora, evaluate the performance of AI models on specific tasks, and iteratively refine workflows through natural-language interaction with the Chronos agent. The module is open-source and ready to be used by historical researchers on their own sources. Code: https://github.com/ai-historian/history-agent Project page: https://ai-historian.com/research/chronos K eywords Artificial Intelligence \cdot History \cdot Computational History \cdot AI Agents \cdot Information Extraction 1 Introduction AI is accelerating scientific discovery in fields such as mathematics, physics, astronomy, computer science, biology, and materials science ( 4 ) . Recently, the AI Scientist has been able to automate machine learning research end-to-end, from conception to peer-reviewed publication ( 24 ) . We aim to extend this emerging research paradigm to the field of history, where the large-scale digitization of primary and secondary sources has made it possible to conduct historical research in the digital domain. Historical research is an iterative reasoning process that almost never follows a linear order ( 29 ) . Historians constantly iterate between studying existing scholarship, formulating hypotheses, discovering and critiquing sources, and interpreting evidence. Existing approaches to AI scientists are not suitable for historical research, as they focus on automated experimentation and fail to address the particular challenges to evidence gathering in historical research. Moreover, they are focused on empirical strategies typically found in the sciences, which differ significantly from the qualitative and quantitative methodologies of historical research. At the time of writing, there exists no AI scientist fit for historical research, and there are no accessible, customisable, and effective agentic solutions to the extraction of information from historical sources. In this technical progress report, we present the first module of Chronos, an AI Historian under development. This first module addresses a foundational task in historical research: extracting information from primary sources. Rather than imposing a rigid pipeline, as many existing approaches do, Chronos enables historians to use natural language to build and customise adaptive workflows, efficiently tailoring them to the unique primary sources under investigation. 2 Related Work Across many domains, researchers have confronted the problem of extracting data from images. A large literature in machine learning continues to address the technical challenges of extracting structured information from documents ( 11 ; 23 ; 33 ; 15 ; 17 ; 19 ; 20 ; 28 ; 38 ; 39 ; 40 ) . Researchers in digital humanities have applied some of these methods in downstream applications, enabling scholars to answer new questions computationally ( 26 ; 35 ) . Likewise, the social sciences have begun to use these methods to analyse visual data, enabling the creation and analysis of new large-scale economic history datasets ( 8 ; 5 ; 32 ; 9 ) . The arrival of multimodal large language models (mLLMs), more precisely, vision-language models (VLMs) ( 22 ) , represents a step change. These models are capable of jointly processing visual and textual data and can therefore be prompted to extract the desired text embedded within images. Many studies still focus on a single source type or a narrowly defined extraction task. For example, economic historians have constructed datasets from patent registers and firm reports ( 14 ; 16 ; 37 ) , digital humanities scholars have shown that VLMs can be used to extract structured data from digitised concert programmes ( 10 ) , and archivists have begun to extract information from a diverse range of museum and archival collections ( 31 ; 30 ; 34 ; 36 ) . Economists have also started to use LLMs to digitise historical tables ( 2 ) and institutions, such as the Philadelphia Fed, have begun to deploy them on their archival sources ( 27 ) . This first module of our AI Historian represents the agentic continuation of our previous research on using VLMs to construct structured datasets from historical documents ( 13 ; 14 ) . In these earlier projects, we built custom VLM pipelines that solved the problems of reliably locating, extracting, and parsing historical information from specific primary sources. This required technical expertise that historians typically do not have. The rapid progress in AI agents ( 18 ) enables the construction of the first module of the AI Historian, removing much of the remaining friction in making primary sources available for computational analysis. 3 Chronos: The AI Historian In this technical progress report, we present the first module of Chronos, a system designed to accelerate historical research by automating key research tasks and, in the longer term, to develop into an AI Historian capable of autonomous end-to-end research. In its current form, this module enables historians to apply computational operations to digitised archival sources. Technically, it is implemented as a domain-specific extension of the general-purpose coding agent Pi, specialising the framework through tools, prompts, and reusable procedures tailored to historians. Embedded in Visual Studio Code (Figure 1 ), Chronos lets historians describe tasks in natural language, which the underlying agent translates into computational operations. FIGURE 1: Chronos – The AI Historian Notes : The Chronos research environment embedded in Visual Studio Code. The left sidebar organises the workspace by separating read-only source files from agent-generated data, memory, and skills. The centre panel provides an integrated viewer for inspecting a primary source page, while the right panel shows the agent drafting an extraction prompt and requesting the historian’s approval before batch processing. The source can be found in the digital library of the University of Mannheim . 3.1 System Architecture The Pi Agent Framework. Chronos is built on Pi, a general-purpose, model-agnostic coding agent framework. 1 1 1 https://github.com/badlogic/pi-mono Pi provides three core capabilities: (1) a tool system that gives the agent access to the local filesystem via built-in tools (Table 1 ); (2) a session system that persists conversation history as branching JSONL trees, allowing historians to resume work, fork exploratory branches, and compress older context; and (3) an extension system through which packages can register custom tools, inject system prompts, hook into the agent lifecycle, and add commands. Pi is model-agnostic: its unified LLM interface supports over twenty providers, allowing Chronos to route tasks to different models (both open-source and closed-source), for example using Claude Opus 4.6 for orchestration and reasoning while delegating information extraction from image scans to the Gemini 3.1 Pro. How Chronos specialises the Pi Agent Framework for Historical Research. Chronos is packaged as a pi-package , a self-contained bundle of extensions, skills, and prompt templates that Pi loads automatically. The Chronos extension registers the domain-specific tools (Table 1 ), injects a system prompt that orients the agent towards document analysis rather than general coding, and