Advancing Scientific Knowledge Retrieval and Reuse with a Novel Digital Library for Machine-Readable Knowledge
Hadi Ghaemi, Lauren Snyder, Markus Stocker · 2025
Read Advancing Scientific Knowledge Retrieval and Reuse with a Novel Digital Library for Machine-Readable Knowledge by Hadi Ghaemi, Lauren Snyder, Markus Stocker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08476.txt.
Introduction
Hadi Ghaemi, Lauren Snyder, and Markus Stocker present ORKG reborn, a digital library built for machine readable research knowledge rather than papers alone. Leading archives organize story papers, so reusing a given finding still needs manual pulling and sorting by a reader. ORKG reborn instead publishes fine grained, reproducible knowledge expressions that link research statements to their supporting data and code evidence, inside papers designed from birth for reuse.
Retrieval can then run by statistical method, software package, variable, or data constraints, which document search cannot offer. Demonstrations with published papers from computer science to soil science show practical viability against state of the art archives. The work argues research knowledge databases carry enormous untapped potential.
Catalog record
| CREATOR | Hadi Ghaemi, Lauren Snyder, Markus Stocker |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08476
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Advancing Scientific Knowledge Retrieval and Reuse with a Novel Digital Library for Machine-Readable Knowledge Hadi Ghaemi, Lauren Snyder, Markus Stocker Abstract Digital libraries for research, such as the ACM Digital Library or Semantic Scholar, do not enable the machine-supported, efficient reuse of scientific knowledge (e.g., in synthesis research). This is because these libraries are based on document-centric models with narrative text knowledge expressions that require manual or semi-automated knowledge extraction, structuring, and organization. We present ORKG reborn, an emerging digital library that supports finding, accessing, and reusing accurate, fine-grained, and reproducible machine-readable expressions of scientific knowledge that relate scientific statements and their supporting evidence in terms of data and code. The rich expressions of scientific knowledge are published as reborn (born-reusable) articles and provide novel possibilities for scientific knowledge retrieval, for instance by statistical methods, software packages, variables, or data matching specific constraints. We describe the proposed system and demonstrate its practical viability and potential for information retrieval in contrast to state-of-the-art digital libraries and document-centric scholarly communication using several published articles in research fields ranging from computer science to soil science. Our work underscores the enormous potential of scientific knowledge databases and a viable approach to their construction. Comments: Accepted for publication at SIGIR 2025. This is the authors’ accepted version (preprint) prior to ACM formatting and copyediting. The official version of record is available in the ACM Digital Library at: https://doi.org/10.1145/3726302.3730134 1 Introduction Research is an iterative process in which researchers build on existing knowledge to create new knowledge. Synthesis research is a key tool for creating new knowledge, and relies on primary scientific literature (i.e., scientific findings that are published for the first time) as a data source. For example, systematic reviews and meta-analyses are based on the integration and analysis of data extracted from published literature [ 20 , 5 ] . The validity of such syntheses depends on the quality of the primary scientific literature that is being synthesized [ 5 ] . To assess this quality, researchers need to understand the data and methods underlying the scientific statements made in the literature. Digital libraries, such as the ACM Digital Library or similar, support access to scientific articles, but are document-centric and the knowledge they contain is not machine-readable, meaning that to reuse this knowledge, researchers must first extract it. Manual data extraction is time consuming and semi-automated approaches usually trade extraction accuracy for speed to enable discovery and access to related data, code, or other supplementary materials. Digital libraries often interlink with artefacts distributed on specialized platforms such as GitHub, Kaggle, or (domain-specific) data repositories. Nonetheless, the ability of machines to reliably process scientific knowledge expressed in heterogeneous formats and published as sets of distributed files continues to be very limited. With ORKG reborn—accessible at reborn.orkg.org —we rethink the publication of and access to machine-readable scientific knowledge in digital libraries for research. Inspired by [ 8 ] , we use a conceptual model that organizes scientific knowledge (specifically, research findings expressed in articles) as statements and supporting evidence, expressed as machine-readable data with formal syntax. The proposed system consists of three interconnected layers: 1) the data deposition and collection layer, which facilitates the harvesting of reborn article [ 18 ] data published on distributed data repositories; 2) the knowledge organization layer, which provides a centralized database for the management and retrieval of reborn article data; and 3) the presentation layer, which renders reborn article data as structured scientific knowledge in the form of statements and supporting evidence in a user-friendly Web-based interface. 2 Related Work The academic expansion of the past decades has dramatically increased the volume of published articles, scientific knowledge, and related artefacts such as data and code. The global scholarly infrastructure [ 3 ] is designed to provide reliable and comprehensive access to these artefacts [ 19 ] . Traditional systems enable discovery and access with persistent identifiers and associated standardized metadata (information about articles, authors, and datasets). Some systems, such as Zenodo 1 1 1 https://zenodo.org support the deposition and interlinking of data and code. With the exception of specialized systems (e.g., domain-specific data repositories) these systems are generally unable to support direct access to and retrieval of content, be it research data in data files or scientific knowledge expressed in articles [ 1 , 4 , 14 ] . A new generation of systems aims to enable access to the content of articles by supporting collaborative manual or semi-automated extraction of knowledge from articles and collaborative curation and organization of extracted knowledge. In addition to the Open Research Knowledge Graph (ORKG) [ 9 ] , Hi-Knowledge 2 2 2 https://hi-knowledge.org [ 11 ] aims to enable novel presentation and access to scientific knowledge in invasion biology and urban ecology, with the vision of creating an interactive atlas of knowledge covering other research fields. Similar systems can be found in other domains, e.g., Machine Learning 3 3 3 https://paperswithcode.com . A fundamental limitation of these systems is their reliance on post-publication knowledge extraction from articles, which is time consuming and error prone when done manually and requires tradeoffs in accuracy when completed with (semi)-automated approaches. Figure 1: Proposed system architecture showing the three main layers: Data Deposition and Collection Layer, Knowledge Organization Layer, and Presentation Layer. 3 Architectural Overview We now describe the architecture of the proposed system. As stated above, its aim is to publish machine-readable scientific statements and underlying evidence, with the aim of supporting synthesis research in particular. Toward this aim, it is necessary to provide reliable access not only to scientific findings, but also to related research data and source code. Figure 1 illustrates how we divide the overall architecture into three main layers: data deposition and collection layer, knowledge organization layer, and presentation layer. 3.1 Data Deposition and Collection Layer To efficiently reuse research data, it is necessary to make data understandable to both humans and machines. This requires formalizing data types. We leverage a Data Type Registry (DTR) to manage the standardization and registration of, as well as access to, data types required to describe scientific statements and their underlying evidence. For unambiguous identification, each data type in the DTR is assigned a DOI as a unique, resolvable persistent identifier. Table 1: Data types and their definition. Data type Definition Data Preprocessing Prepare datasets for further analysis Descriptive Statistics Describe dataset characteristics Algorithm Evaluation Algorithm performance evaluation for a specified task and dataset Multilevel Analysis Multilevel data analysis with models including fixed and random effects Correlation Analysis Evaluate the strength and direction of the relationship between variables Group Comparison Compare the means of two or more groups Regression Analysis Explore the relationship between dependent variable(s) and independent variable(s) Class Prediction Predict a categorical class label given input data Class Discovery Discover classes or clusters in unlabeled data Factor Analysis Discern latent factors in data Our current focus is on scientific statements where the underlying evidence is a statistical data analysis or set of data analyses, for which we have developed the data types listed in Table 1 . Figure 2 illustrates the data type for ‘Data Preprocessing’, which captures information related to executed software methods, and input and output data items. For example, in