Context-Aware Scientific Knowledge Extraction on Linked Open Data using Large Language Models PubID: pubid: 0000–0000/00$00.00 © 2021 IEEE
Sajratul Yakin Rubaiat, Hasan M Jamil · 2025
Read Context-Aware Scientific Knowledge Extraction on Linked Open Data using Large Language Models PubID: pubid: 0000–0000/00$00.00 © 2021 IEEE by Sajratul Yakin Rubaiat, Hasan M Jamil (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17580.txt.
Introduction
Sajratul Yakin Rubaiat and Hasan Jamil present a system for digging answers out of scientific papers in a 2025 paper. Search engines return piles of sources but no direct answer, while chatbots give short answers that may be shallow or stale. Their system, called WISE, aims for depth and accuracy at once.
WISE runs a stepwise workflow powered by a large language model. It pulls text from linked sources, trims it to what matches the question, and ranks what each source adds. A tree-shaped search keeps exploring while cutting text that adds nothing new, and stop rules keep the cost down. In a test on diseases tied to one gene, the system cut the text it handled by over eighty percent while finding more of the relevant facts than rivals. Its answers were also more detailed and less copied from any one source.
Catalog record
| CREATOR | Sajratul Yakin Rubaiat, Hasan M Jamil |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-17580
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Context-Aware Scientific Knowledge Extraction on Linked Open Data using Large Language Models PubID: pubid: 0000–0000/00$00.00 © 2021 IEEE Sajratul Yakin Rubaiat, Hasan M Jamil Abstract The exponential growth of scientific literature presents a significant challenge for researchers seeking to extract and synthesize relevant knowledge. Traditional search engines often return a large number of sources without directly providing detailed answers, while general-purpose Large Language Models (LLMs) may offer concise responses that lack depth or fail to incorporate the most up-to-date information. Furthermore, LLMs with search capabilities are often limited by their context window, resulting in short, incomplete answers. This paper introduces WISE ( W orkflow for I ntelligent S cientific Knowledge E xtraction), a novel system that addresses these limitations by combining LLMs with a structured, multi-layered workflow to extract, refine, and rank scientific knowledge tailored to specific queries. WISE employs an LLM-powered, tree-based architecture with a customized search function to iteratively refine extracted data, focusing on query-aligned and context-aware information while actively avoiding redundancy. Dynamic scoring and ranking mechanisms prioritize unique contributions from each source, and adaptive stopping criteria minimize processing overhead. WISE delivers detailed, well-organized, and highly informative answers by systematically exploring and synthesizing knowledge from diverse sources. Experiments focused on biological queries related to HBB gene-associated diseases demonstrate that WISE reduces the volume of processed text by over 80% while simultaneously achieving significantly higher recall compared to baseline methods, including leading search engines and other LLM-based approaches. Further analysis using ROUGE and BLEU metrics reveals that WISE’s output is more unique compared to other systems, and a novel level-based evaluation metric shows that WISE provides more in-depth information. This paper also explores how the WISE workflow can be adapted as a general framework for diverse research domains, such as drug discovery, material science, and social science , enabling efficient knowledge extraction and synthesis from unstructured scientific papers and web sources across a wide array of research domains. I Introduction The relentless expansion of scientific knowledge, reflected in the ever-increasing volume of published literature, presents a formidable challenge for researchers seeking to extract, synthesize, and contextualize relevant information [ 1 , 2 ] . While traditional search engines and general-purpose Large Language Models (LLMs) offer some assistance, they often fall short in providing domain-specific insights, filtering irrelevant content, and efficiently managing the sheer volume of data [ 3 , 4 , 5 ] . Traditional search engines typically return a large number of sources, requiring users to manually sift through them to extract relevant information, rather than providing direct, synthesized answers. Navigating this complex information ecosystem manually is both labor-intensive and error-prone, with researchers facing the risk of overlooking critical details as the volume of data grows exponentially. Consider, for example, a researcher investigating gene-disease associations related to the HBB gene. Starting from a single authoritative source like the HGNC [ 6 ] , they might encounter 24 relevant sources. Exploring just one of these, such as ClinVar [ 7 ] , could unveil hundreds more sources, leading to a rapidly expanding tree of interconnected resources, exemplified by platforms like NCBI [ 8 ] . This exponential growth of linked resources quickly overwhelms traditional search systems, making it difficult to extract pertinent insights efficiently. Even experienced investigators struggle to filter out superfluous data and focus on the most valuable information, a challenge amplified for newcomers. Consequently, critical information may be missed, and the time required to gain a complete, integrated understanding escalates dramatically. Purely automated approaches also encounter significant difficulties in this context [ 9 , 10 , 11 ] . The sheer volume of interconnected data can lead to computationally expensive and strategically ineffective processes without robust mechanisms for pruning irrelevant or redundant content. A key challenge lies in determining when to stop searching; continued exploration without clear stopping criteria often yields diminishing returns, underscoring the need for a balanced workflow that ensures thorough yet efficient exploration while prioritizing high-value information [ 12 , 13 ] . TABLE I: System Comparison Feature WISE ChatGPT ChatGPT with Search Gemini Google Search Number of Diseases Identified 16 9 7 2 3 Recall 0.84 0.47 0.36 0.10 0.15 Average Level of Detail a 3.8 3.33 3.42 2.5 3.0 Structured Output ✓ ✓ ✓ ✓ ✗ Inclusion of Sub-variations ✓ ✗ ✓ ✗ ✗ Source Citation ✓ ✗ ✓ ✗ ✓ Identification of Rare Conditions ✓ ✗ ✗ ✗ ✗ Up-to-Date Information ✓ ✗ ✓ ✗ ✓ a Average Level of Detail: Represents the average depth of information provided across all diseases identified by the system, based on a 0-5 scale where higher values indicate more detailed information (see Section III for level criteria). While Large Language Models (LLMs) show promise in specific aspects of information retrieval [ 14 ] , their inherent limitations hinder their ability to fully address the scale of these challenges. General-purpose LLMs, often provide concise answers that lack the depth and detail required for complex scientific queries, and may not incorporate the most recent findings. For instance, state-of-the-art models like GPT-4o [ 15 ] , despite having a context window of 128000 tokens, are practically limited to processing data from only about eight sources simultaneously, such as UniProt [ 16 ] , as illustrated in Figure 1 . Although capable of ranking and comparing content within this limited scope, LLMs are constrained by their narrow context window, further reduced by factors like search history. In specialized domains such as biology and medicine, where nuanced and detailed insights are crucial, relying solely on LLM-based searches proves insufficient. These challenges highlight the critical need for combining the capabilities of LLMs with strategic workflows to achieve comprehensive and efficient knowledge retrieval. To address these challenges, we introduce WISE ( W orkflow for I ntelligent S cientific E xtraction), a novel, scalable, tree-based framework that integrates LLM-driven filtering, dynamic ranking, and adaptive stopping criteria. WISE is designed to deliver detailed, well-organized, and highly informative answers by systematically exploring and synthesizing knowledge from diverse sources. WISE mirrors the approach of a diligent researcher: identifying relevant information, discarding duplicates, exploring promising leads, and recognizing when further pursuit yields diminishing returns. WISE begins by employing LLMs to filter large text corpora based on a user’s domain-specific query, ensuring that only contextually relevant and manageable segments proceed to subsequent stages. It then assigns scores to extracted sources, quantifying their unique contributions relative to previously processed material, thereby minimizing redundancy and focusing on content that adds genuine value. This dynamic ranking process prioritizes high-value information while pruning low-impact paths. The iterative refinement continues layer by layer, with WISE’s knowledge container—the growing repository of extracted, query-specific insights—expanding until incremental findings diminish (Figure 4 ). At this point, WISE intelligently halts further searches, conserving computational resources while delivering comprehensive, contextually nuanced results. In essence, WISE achieves a balance between breadth and depth, effectively leveraging the strengths of LLMs while mitigating their limitations through intelligent pruning and carefully considered stopping criteria. Fig. 1: Number of sources, such as UniProt [ 16 ] , that can be processed simultaneously for ranking by advanced LLMs like GPT-4o demonstrate significant improvements when applying LLM-based filtering with and without query-specific relevance. Given that GPT-4o supports a 128,000-token context window, the number of websites