Digging Up Citations: FOSSIL , a Dataset and Workflow for Reference Extraction in Law and the Humanities (Extended Abstract)
Luca Foppiano *, Christian Boulanger * · 2026
Read Digging Up Citations: FOSSIL , a Dataset and Workflow for Reference Extraction in Law and the Humanities (Extended Abstract) by Luca Foppiano *, Christian Boulanger * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01109.txt.
Introduction
Foppiano and Boulanger dig citations out of footnotes in this 2026 paper. Citation tools are built for the tidy reference lists of the sciences. Law and humanities writing cites in footnotes instead. There, reference data mixes with commentary and cross references, in many languages and styles. Gold standard data for that world was scarce.
Their dataset, FOSSIL, holds 96 annotated scholarly articles with over 7,600 footnote references. It is openly licensed and multilingual. A web annotation tool and a seven annotator workflow come with it. So does a Grobid variant tuned for footnote citations. In end to end tests, micro F1 rises from 0.36 up to 0.72 with the specialized pipeline in use. Recall drives most of the gain. Cross references and mixed content notes still leave much headroom. The authors flag the work as in progress, with parsing and cross reference resolution still open.
Catalog record
| CREATOR | Luca Foppiano *, Christian Boulanger * |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01109
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Digging Up Citations: FOSSIL , a Dataset and Workflow for Reference Extraction in Law and the Humanities (Extended Abstract) Luca Foppiano *, Christian Boulanger * Abstract 1 1 footnotetext: These authors contributed equally to this work. 1 Introduction and motivation Citation extraction has been studied extensively ( 7 ; 8 ; 5 ; 1 ) , but existing models are designed for the structured end-of-document bibliographies typical of the natural sciences. In law and the humanities, scholars continue to cite references primarily in footnotes, where bibliographic data is interleaved with commentary, clarifications, and cross-references, producing highly heterogeneous content that is difficult to parse with standard pattern-based approaches ( 2 ) . Large Language Models show promise for such heterogeneous data ( 16 ; 15 ) , and even early zero-shot experiments produced strong results on footnote references ( 13 ) . However, closed models depend on third-party infrastructure, are non-reproducible in the long term, and have been decommissioned without notice ( 11 ) ; open-weight alternatives demand dedicated hardware. Meanwhile, LLMs are valuable in human-in-the-loop pipelines, where they accelerate semi-automatic annotation and enable larger datasets at lower cost. The limited availability of specialized gold-standard datasets for SSH literature hampers both the evaluation of LLM-based approaches and the training of classical supervised sequence labellers, making the construction of such resources a critical priority. This work contributes: (i) PDF-TEI Editor , a production-ready web-based annotation tool; (ii) a documented annotation workflow integrating PDF-TEI Editor and Grobid ( 9 ) , carried out by a team of seven; (iii) FOSSIL (Footnote-based Open-access SSH Scientific Instance Labels), an openly licensed multilingual dataset of 96 annotated scholarly articles comprising over 7,600 references embedded in footnotes; and (iv) a Grobid specialization for law and humanities documents that serves as a proof-of-concept baseline. 2 Background and related work Existing SSH-oriented datasets offer complementary but partial coverage. CEX ( 6 ; 14 ) covers 112 English articles but includes non-openly-licensed material. The EXparser Gold Standard ( 10 ) is restricted to 100 German social-science documents. LinkedBooks ( 7 ) provides over 40,000 references from monographs and journals on Venetian history, but remains narrow in domain. 17 benchmarked open-weight LLMs against Grobid and found that fine-tuned LLMs are more robust under distribution shift, particularly for non-English and footnote-heavy documents, recommending a routing strategy between Grobid and task-adapted LLMs. FOSSIL addresses remaining gaps by providing an openly licensed corpus that spans multiple SSH disciplines, languages, and citation styles, including the footnote-heavy conventions of law and humanities. 3 Challenges of citation practices in law and the humanities In natural-science publications, references form a dedicated section with standardised inline markers, while footnotes are reserved for commentary. In contrast, law and humanities scholarship relies heavily on footnotes to carry bibliographic references alongside commentary, and citation styles vary strongly across languages, disciplines, and journals. Because footnotes are page-scoped, the same reference frequently recurs in shortened form as a cross-reference to an earlier footnote. We identified five recurring footnote content types: (1) comments or clarifications with no reference data; (2) biographical information, typically on the first page; (3) one or more bibliographic references that can be cleanly segmented; (4) cross-references (e.g., “Ibid.”, “See Miller, n. 9, p. 5”) redirecting to a previous footnote; and (5) mixed content combining all of the above in arbitrary order. 4 Method Our approach is grounded in the Grobid architecture: a cascade of specialized machine-learning models extracting and parsing PDF articles into structured TEI-XML. FOSSIL is aligned with this layered design so that annotations can be used independently at each stage or combined end-to-end. PDF-TEI Editor. We developed an open-source web application supporting iterative, collaborative TEI-XML annotation ( 3 ) . It features a synchronized dual-pane PDF/XML view, built-in TEI schema validation, role-based access control, and a plugin architecture that allows integration of arbitrary extraction backends (currently Grobid and LLaMore ( 12 ) ). Versioning with branching, merging, and change tracking supports the iterative workflow described below. Annotation workflow. Source articles were drawn from openly licensed journals listed in DOAJ and CrossRef, strictly excluding non-derivative licences. Documents were organised into ten batches and annotated in five phases: (1) pre-annotation with the latest Grobid model; (2) correction by a first annotator and verification by a second; (3) validation by a senior reviewer; (4) feedback integration into a living annotation guide, with GitHub issues used to track decisions; and (5) training and evaluation of a new model. Seven annotators participated: two senior annotators (the authors), four students from the Digital Humanities Master Program at the University of Stuttgart, and one reviewer. For segmentation, 194 pairwise comparisons on 96 documents yielded a mean Krippendorff’s \alpha=0.917 (median 0.989 ), indicating reliable agreement, with a clear learning curve across batches. Dataset. FOSSIL comprises 96 articles from 38 journals in law, humanities, history, and social sciences, with publication dates from 1959 to 2025 and multiple languages (English, Portuguese, Italian, German). The corpus contains approximately 2,400 footnote blocks—about 500 discursive and 1,900 bibliographic—comprising over 7,600 individual references, averaging roughly 100 per document. Annotations are organised in three layers matching the Grobid cascade: article segmentation (structural zones such as <front> , <body> , <listBibl> , <note> ), reference segmentation (splitting <listBibl> content into individual <bibl> units), and citation parsing (TEI-standard fields extended with a <note> -based encoding for cross-references). The dataset is released both in aggregated form and as separate files per layer. Grobid specialization. We implemented a specialized processing flow (“flavor”) that incrementally replaces models in the standard Grobid cascade—starting with article segmentation—while reusing the rest of the pipeline. This design follows a principle of maximum reusability and enables targeted evaluation of each replaced component. 5 Evaluation We evaluate the trained article segmentation model in isolation and the full specialized pipeline end-to-end against the default Grobid configuration. Article segmentation. Using 5-fold cross-validation on 96 documents, the specialized segmentation model reaches an overall F1 of 81.08 (Precision 82.91, Recall 79.41). Performance is strong for <body> (86.85), <headnote> (80.89), and <page> (90.12), while <listBibl> (78.91), <footnote> (54.95), and <front> (34.54) are more difficult: these zones share physical page space and can only be distinguished by content, making classification inherently ambiguous. End-to-end evaluation. To assess the impact of the specialized flow on real-world processing, we ran an end-to-end evaluation on four scholarly articles from law and the humanities, previously used to compare an LLM-based extraction library against standard Grobid (see 4 , p. X) . Each document was processed through the full pipeline—from PDF to TEI-XML—under two configurations: default Grobid and the specialized “footnotes-ref” flavor. Extracted fields were compared against manually annotated gold-standard references using the LLaMore evaluation framework ( 12 ) , which computes token-level F1 with fuzzy matching (Levenshtein threshold 0.8) and Hungarian matching for optimal reference alignment. Figure 1 reports per-field F1 for three key fields—journal title, author surname, and publication date—along with micro- and macro-averages. Figure 1 : End-to-end evaluation on author surname, journal title, and publication date, comparing the standard Grobid pipeline and the specialized process that replaces only the segmentation model while reusing the full pipeline. The default Grobid model shows a highly asymmetric precision–recall profile: precision is high across all three fields (0.89–0.94), but recall is extremely low (0.21–0.27), producing F1 scores between