Extraction of tabulated statistical results with tableParser
Ingmar Böschen; ORCID: 0000-0003-1159-3991 · 2026
Read Extraction of tabulated statistical results with tableParser by Ingmar Böschen; ORCID: 0000-0003-1159-3991 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19756.txt.
Introduction
Böschen presents tableParser, an R package that pulls tables from scientific papers. It reads XML, HTML, and DOCX files, and PDFs with limits. The package focuses on statistical test results in published work. Its tools compile tables into matrices with captions and footnotes. They can also collapse a table into plain readable text. Decoded codes from captions can enrich the output. A further step extracts standard results into a data frame. It recalculates p-values and flags mismatches.
Catalog record
| CREATOR | Ingmar Böschen; ORCID: 0000-0003-1159-3991 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58771 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19756
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Extraction of tabulated statistical results with tableParser Ingmar Böschen; ORCID: 0000-0003-1159-3991 Abstract Abstract Tabulated content is omnipresent in scientific literature. In this work I describe the functionality of the R package tableParser , which is designed to extract and postprocess tables from NISO-JATS-encoded XML, any other HTML, DOCX, and, with some restrictions, PDF documents. tableParser was developed in order to extract and analyze tabled statistical test results reported in scientific publications. On a big scale, tableParser can be used to analyze the extent and variation of effects of specific variables on others, reporting practices, or summarization of results. On a single document scale, the automated extraction of statistical test results can also be beneficial for completeness and consistency checkups of tabulated test results in unpublished documents. Documents can be processed in three different decoding depths. On a first level, all tables within a document are compiled into a list of character matrices with captions and footnotes as attributes with table2matrix() . The matrix content can be collapsed into a human-readable text string by imitating the behavior of a screen reader with table2text() . Optionally, and to reduce cross references, many common codings that are reported within the table’s caption and footnote can be used to decode and expand the table’s content. Finally, the collapsed and decoded table content can be further processed to best match an ideal input for the extraction of statistical standard results with the standardStats() function from the JATSdecoder package. Finally, the output of table2stats() is a data frame with all detected standard results as columns, and, if calculation is possible, a recalculated p-value. If desired, an automated consistency check of the reported and the coded p-values with the recalculated p-value can be initiated. In general, tableParser works best on rather simple, but also some more complex, barrier-free HTML tables that are encoded in the NISO-JATS standard, where captions and footnotes are clearly identifiable. By guessing the tables captions and footnotes conservatively, the processing of tables within any other HTML and DOCX documents is comparably robust. Technically, tables within PDF documents often fail to be extracted correctly, and captions and footnotes cannot be detected with the implemented functions. Therefore, a precise decoding of codes within a table is not possible for PDF input which lowers its detection accuracy of statistical results. 1 Objective Extracting interpretable information from tables is a difficult task that, despite the impressive capabilities of modern large language models, after 30 years of research, is still far from being solved completely Shigarov (2023) . Due to the great technical variety in structures and formats, decoding tabled information is a research field that has been considered by many research communities under differing perspectives Bonfitto et al. (2021) . The automated processing and/or conversion of effective tables to other formats, principally aimed at storing and transmitting structured information, are still open problems, which fall under the umbrella of Table Understanding problems Bonfitto et al. (2021) . Rather than raw data tables, effective tables are designed for being interpreted by humans. They represent a very dense and sensible way of reporting descriptives, showing up differences between groups, associations between variables by statistical tests, and summarizing model results. Statistical result tables often contain encoded information (e.g., superscripted letters, abbreviations, special signs), and, in addition, graphical features, such as lines, grouped or colored cells, as well as different text styles (bold, italic) to encode the presented results effectively. In practice, result tables often contain a lot more information when compared to the textual description of the tabled results, which focuses on the main or most interesting results. Depending on the complexity and structure of a table, reading out the full information and converting it into language-based information is a challenging task. When reading out statistical result tables, one needs to navigate within the table’s row and column namings and groupings, have knowledge about what is reported exactly inside the cells, the meaning of bracketed numbers, and often decode abbreviations and other codings that are reported in the table footnotes (e.g., ‘*’ for p<.05). The decoding complexity is compounded by empty cells that may be used for graphical grouping or as an indication of a nonexistent result. Furthermore, and for example, in the case of encoded p-values, the absence of a code constitutes information. Taking all these obstacles into account, the R R Core Team (2024) package tableParser Böschen (2026) imitates the functionality of a screen reader for blind people that is specialized in handling statistical result tables. The main goal leading the development is to extract and unify tabled statistical standard results reported in the scientific literature. The package contains a function collection to extract tables from documents, transform the tabled content into a text vector, and an easy-to-process data frame with the detected statistical standard results. Solutions for standardizing the textual representations of hexadecimal and HTML encoded special characters, as well as the textual representations of numbers and the correction of commas, are implemented. Before collapsing the tabulated content, several decoding and expansion processes can be initiated to reduce cross-references with the text of captions and footnotes. The heuristic-driven processes are solely based on an iteratively developed set of regular expressions. Still, tableParser ’s functionality is very general and can be applied to any tabulated input with individual settings. 1.1 Technical representations of tables in documents Following the three-part-table approach, here, the term table is used for matrix-like structures with an accompanying caption and/or footnote. In practice, at least two common technical approaches are used to encode tables in HTML documents that may result in the exact same visual appearance. The three parts of a table may be encoded in a floating stream of paragraphs (<div>, and/or <p> tags) with individual graphical settings. UI-based text editors will often create floating paragraphs to display a three-part-table. The Journal Article Tag Suite (NISO-JATS) National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM) (2014) is a well-established HTML markup standard to store and share scientific content on the web. Table structures are stored within a <table-wrap> tag. Besides the main matrix that is encoded within the <table> tag, a <caption> and <table-wrap-foot> tag may be appended to the structure. The wrapping of the three parts of a table in NISO-JATS facilitates the association of the tabled content to the surrounding information. As tables may also be reported without a caption and/or footnote, the surrounding tags of a table in the floating paragraph style may contain the surrounding blocks of text of the manuscript. Further, multiple paragraphs may be used to display multi-row captions or footnotes. This complicates a precise extraction of three-part-table structures in non-NISO-JATS-encoded documents. Figure 1: Three-part-table structures with floating paragraphs and NISO-JATS standard floating paragraphs <div> <p>Caption</p> </div> <div> <table>…</table> </div> <div> <p>Footnotes</p> </div> NISO-JATS standard <table-wrap> <caption>…</caption> <table>…</table> <table-wrap-foot>…</table-wrap-foot> </table-wrap> Tables within DOCX documents are structured by the floating paragraph approach (with <w:p>-tags). The DOCX tag equivalent to the HTML <table>-tag is <w:tbl>. The raw coded content can be accessed from within the XML file that is available after unpacking a DOCX file. Since tables within PDF documents are not coded in a well-structured manner, it is comparatively hard to reliably extract them. Mostly, they