Evidence Units: Ontology-Grounded Document Organization for Parser-Independent Retrieval
Yeonjee Han · 2026
Read Evidence Units: Ontology-Grounded Document Organization for Parser-Independent Retrieval by Yeonjee Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00500.txt.
Introduction
Han presents Evidence Units, a way to organise documents for retrieval that does not depend on any one parser. Tables with captions, figures with explanations, and equations with interpreting paragraphs get shredded when indexed. Element-level indexing treats each parsed piece as its own chunk, scattering units that belong together. Evidence Units instead group visual assets with their surrounding text into meaningful chunks. Han adds ontology-grounded role normalisation, a semantic assignment method matching paragraphs to units, and a graph-based decision layer.
Catalog record
| CREATOR | Yeonjee Han |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39993 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00500
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evidence Units: Ontology-Grounded Document Organization for Parser-Independent Retrieval Yeonjee Han Abstract Structured documents—tables paired with captions, figures with explanations, equations with the paragraphs that interpret them—are routinely fragmented when indexed for retrieval. The dominant element-level indexing paradigm treats every parsed element as an independent chunk, scattering semantically cohesive units across separate retrieval candidates. This fragmentation forces systems to find multiple disjoint pieces to answer a single question, even when all the evidence appears on the same page. This paper presents a parser-independent pipeline that constructs Evidence Units (EUs) : semantically complete document chunks that group visual assets with their contextual text. Our approach introduces four contributions: (1) an ontology-grounded canonical role normalization extending DoCO (Document Components Ontology) that maps heterogeneous parser outputs to a unified semantic schema; (2) a semantic global assignment algorithm that optimally assigns paragraphs to EUs via a full similarity matrix; (3) a graph-based decision layer stored in Neo4j that formalizes EU construction rules and validates EU completeness through two invariants; and (4) cross-parser validation demonstrating that EU spatial footprints converge across structurally different parsers (MinerU, Docling), with EU performance gains preserved even under parser-induced bbox variance. Experiments on a filtered subset of OmniDocBench v1.0 (1,340 pages retained from 1,355 after removing non-content-only pages; 1,551 QA pairs) with ground-truth annotations show EU-based chunking improves retrieval LCS by +0.31 over element-level chunking ( → 0.81 0.50\!\to\!0.81 ). Recall@1 increases from 0.15 to 0.51 ( 3.4 × 3.4\times ), and MinK decreases from 2.58 to 1.72 . Cross-parser experiments confirm the relative gain ( Δ \Delta LCS ≈ \approx +0.23–+0.31) is preserved across MinerU and Docling, validating parser independence empirically. Text queries show the most dramatic gain: Recall@1 rises from 0.08 to 0.47 . 1 Introduction RAG systems chunk documents into retrievable units. The chunking strategy directly impacts whether the retrieved context contains the information needed to answer a query. Current methods have three fundamental limitations: Semantic Fragmentation. Fixed-size chunking (e.g., 1024 tokens) and element-level chunking separate semantically coupled elements. A table’s HTML markup, its caption “Table 3: Revenue by Segment,” the unit label “(Unit: million USD),” and the explanatory paragraph become independent chunks. When a user asks “What was the total revenue?”, the retriever finds the caption (high text similarity) but not the table data (low similarity with the query). Parser Dependence. The same document produces not only different labels but also structurally different bounding box (bbox) representations across parsers. For the same table region, Parser A emits a single bbox, Docling splits it into three row-level bboxes, and PaddleOCR-VL (a Vision-Language Model) produces a single bbox with inference-induced positional error of \pm 0.02 in normalized coordinates. Without normalization, chunking algorithms must be rewritten for each parser—and even the spatial grouping logic must account for each parser’s unique bbox decomposition. No Quality Assurance. Generated chunks are not validated for semantic completeness. A table chunk without any contextual anchor is semantically incomplete but passes through unchecked. We propose Evidence Units (EUs) : parser-independent, semantically complete document chunks constructed through a three-stage pipeline: 1. Ontology-Grounded Node Normalization : Parser outputs are mapped to canonical roles defined in a DoCO-extended OWL ontology, decoupling EU construction from parser specifics. 2. EU Construction (3 Phases) : Visual seeds anchor EU formation; structural elements attach by proximity (Phase A); paragraphs attach by global semantic similarity (Phase B); residual elements consolidate by layout-driven heuristics (Phase C). 3. Graph-Based Decision Layer : D1 Construction rules are realized inline in the EU generation pipeline, with formal definitions persisted in Neo4j as the authoritative specification. D2/D3 invariants are encoded as graph-resident schemas for future runtime enforcement. A key property enabling parser independence is EU spatial footprint convergence : although individual element bboxes differ across parsers, the bounding box of the complete EU (the union of all its member bboxes) converges to the same document region. We formalize and empirically verify this property in Section 3.5 . Contributions. 1. Ontology-grounded canonical role system (DSO, extending DoCO/SPAR) with skos:altLabel aliases enabling parser-independent normalization and embedding fallback for unknown parsers 2. Global semantic allocation (Phase B) computing a full paragraph \times EU similarity matrix for optimal assignment—fundamentally different from prior local 1:1 proximity matching 3. Graph-based decision layer storing D1 construction rules as Neo4j nodes with NEXT chains, with D2/D3 invariant schemas persisted for future runtime enforcement 4. EU spatial footprint convergence formalized and empirically verified across MinerU and Docling on OmniDocBench (1,340 usable pages), showing consistent \Delta LCS \approx +0.27 regardless of parser choice 2 Related Work 2.1 Document Chunking for RAG Fixed-size splitting (LlamaIndex SimpleNodeParser, LangChain RecursiveCharacterTextSplitter) divides text by token count, ignoring document structure. Semantic chunking kamradt splits at embedding similarity discontinuities but does not model visual elements. Layout-aware chunking (Unstructured.io) respects element boundaries but treats each element independently. S2 Chunking s2chunk constructs a weighted graph using bounding box coordinates and text embeddings, then applies spectral clustering. SCAN scan groups document components into semantically coherent regions for VLM-friendly RAG. Vision-Guided Chunking vgchunk uses multimodal understanding to enhance chunk boundaries. These methods share a local matching pattern: elements are linked when both distance and semantic conditions are met (e.g., distance threshold AND embedding similarity \geq 0.7 ). Critically, all assume a single, fixed parser; none address the structural bbox variation that arises when the same parser is replaced. Docling docling (IBM, 2024) is a document parsing library that provides two RAG-oriented chunkers: HierarchicalChunker , which follows the inferred section tree, and HybridChunker , which combines hierarchy with token-length limits. Both integrate with LlamaIndex and LangChain. However, Docling chunking is parser-specific —it operates only on Docling’s own intermediate representation and produces no output when Docling fails to parse a page. More fundamentally, it does not guarantee the semantic co-location of visual elements: a table and its caption may appear in different chunks depending on how the section hierarchy is reconstructed. EU construction, by contrast, operates on top of any parser output via canonical role normalization, and explicitly enforces visual-semantic grouping through a typed ontology ( table_panel = table + caption + unit_label). Table 1 summarizes these distinctions. Our experiments in Section 5.3 include Docling output as one parser track, directly measuring the gain of EU construction on top of Docling’s own chunking. Table 1 : Comparison with prior chunking methods. Aspect Prior Methods s2chunk ; scan ; vgchunk ; docling This Work (EU) Parser input Single parser, fixed Multi-parser auto-normalization Bbox representation Assumed consistent Converged via EU footprint Paragraph assignment Local neighborhood matching Global similarity matrix Caption+table pairing Implicit / not guaranteed Explicit ontology (typed EU) Unmatched handling Often discarded Preserved as independent EU Quality validation None or minimal 2-Invariant (I1, I2) Rule management Hardcoded thresholds Neo4j dynamic rule chain Output Flat chunks Structured EU with metadata 2.2 Graph-Based RAG GraphRAG graphrag (Microsoft, 2024) builds knowledge graphs from document content (entities, relations) to enhance retrieval via community summaries. KG-RAG kgrag integrates biomedical knowledge graphs with RAG. These approaches build graphs from content; we build a graph of document structure (layout elements, spatial relations, EU membership). The two are complementary. 2.3 RAG Evaluation OHR-Bench ohrbench (ICCV 2025) evaluates how OCR quality impacts RAG, keeping chunking fixed at 1024 tokens. Our work is orthogonal: we hold parser quality constant and vary the