A Retrieval-Augmented Knowledge Mining Method with Deep Thinking LLMs for Biomedical Research and Clinical Support
2025
Read A Retrieval-Augmented Knowledge Mining Method with Deep Thinking LLMs for Biomedical Research and Clinical Support (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23029.txt.
Introduction
Yichun Feng and co-authors present a method that helps language models mine medical research, in a 2025 paper. Doctors and researchers face a flood of papers with hard terms and fast change. Knowledge graphs can organize that flood, but building them is slow and error-prone. Language models alone also miss links that span many papers. The team aims to join the strengths of both tools.
Their pipeline uses a language model to build a large medical knowledge graph from many articles. They also built a question set that tests whether a system can find facts across documents. A staged search method then recalls more of the right papers and reasons through them step by step. In tests, the method raised search scores and answer accuracy by wide margins over older tools. The authors say it could help doctors weigh treatment evidence faster.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-23029
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Retrieval-Augmented Knowledge Mining Method with Deep Thinking LLMs for Biomedical Research and Clinical Support Abstract Knowledge graphs and large language models (LLMs) are key tools for biomedical knowledge integration and reasoning, facilitating structured organization of scientific articles and discovery of complex semantic relationships. However, current methods face challenges: knowledge graph construction is limited by complex terminology, data heterogeneity, and rapid knowledge evolution, while LLMs show limitations in retrieval and reasoning, making it difficult to uncover cross-document associations and reasoning pathways. To address these issues, we propose a pipeline that uses LLMs to construct a biomedical knowledge graph (BioStrataKG) from large-scale articles and builds a cross-document question-answering dataset (BioCDQA) to evaluate latent knowledge retrieval and multi-hop reasoning. We then introduce Integrated and Progressive Retrieval-Augmented Reasoning (IP-RAR) to enhance retrieval accuracy and knowledge reasoning. IP-RAR maximizes information recall through Integrated Reasoning-based Retrieval and refines knowledge via Progressive Reasoning-based Generation, using self-reflection to achieve deep thinking and precise contextual understanding. Experiments show that IP-RAR improves document retrieval F1 score by 20% and answer generation accuracy by 25% over existing methods. This framework helps doctors efficiently integrate treatment evidence for personalized medication plans and enables researchers to analyze advancements and research gaps, accelerating scientific discovery and decision-making. keywords Large Language Model, Knowledge Graph, Knowledge Mining, Retrieval-Augmented Generation, Deep Thinking Yichun Feng Jiawei Wang Ruikun He* Lu Zhou* Yixue Li* Y. Feng School of Advanced Interdisciplinary Sciences University of Chinese Academy of Sciences Beijing 100049, China Y. Feng, Y. Li Key Laboratory of Systems Health Science of Zhejiang Province School of Life Science Hangzhou Institute for Advanced Study University of Chinese Academy of Sciences Hangzhou 310024, China Y. Feng, L. Zhou, Y. Li Guangzhou National Laboratory No. 9 XingDaoHuanBei Road, Guangzhou International Bio Island Guangzhou 510005, China E-mail: [email protected] E-mail: [email protected] J. Wang Department of EEIS University of Science and Technology of China Hefei 230026, China R. He BYHEALTH Institute of Nutrition & Health Guangzhou 510663, China E-mail: [email protected] Y. Li GZMU-GIBH Joint School of Life Sciences The Guangdong-Hong Kong-Macau Joint Laboratory for Cell Fate Regulation and Diseases Guangzhou Medical University Guangzhou, 511436, China Y. Li School of Life Sciences and Biotechnology Shanghai Jiao Tong University Shanghai 200240, China Y. Li Shanghai Institute of Nutrition and Health Chinese Academy of Sciences Shanghai 200030, China 1 Introduction The advancement of large language models (LLMs) has significantly accelerated progress in natural language processing (NLP), particularly in complex tasks like question answering (QA), with notable breakthroughs in specialized fields such as biomedical science [ 1 ] . However, despite these advancements, the application of LLMs for knowledge mining in specialized domains like biomedical science remains limited, where rigorous precision and robust evidence validation are essential for extracting meaningful insights [ 2 ] . Biomedical articles is vast, containing massive amounts of information [ 3 ] , much of which remains underutilized. This inefficiency hinders scientific discovery and limits our ability to address complex biomedical challenges that require deep connections and advanced reasoning [ 4 ] . The wealth of knowledge within biomedical research, if effectively harnessed, could drive breakthroughs in critical areas such as clinical medicine, pharmacology, and molecular biology [ 5 ] . In biomedical knowledge mining, the construction of knowledge graphs is essential for enhancing information integration and reasoning capabilities. However, this process presents several challenges. First, the biomedical domain has a highly complex terminology system, with numerous synonyms, polysemous terms, and hierarchical classifications, making the precise extraction of entities and relationships particularly difficult [ 6 ] . Second, biomedical knowledge is fragmented and heterogeneous, spanning research papers, clinical reports, and databases, posing a fundamental challenge in unifying and linking these diverse data sources effectively [ 7 ] . Additionally, the rapid evolution of biomedical research constantly introduces new findings, requiring knowledge graphs to be dynamically expandable to maintain long-term relevance [ 8 ] . Despite these challenges, high-quality knowledge graphs can explicitly capture the intricate relationships among genes, proteins, diseases, and drugs, providing structured support for cross-document reasoning and deep knowledge extraction [ 9 ] . Building a high-quality biomedical QA dataset that effectively leverages knowledge graphs is crucial for evaluating and enhancing models’ abilities in cross-document reasoning and knowledge integration. While existing datasets such as MASH-QA [ 10 ] , which addresses multi-span questions across long documents, BioASQ [ 11 ] , which focuses on biomedical semantic indexing and QA, MEDHOP [ 12 ] , which targets multi-hop reasoning across multiple paragraphs, MedicationQA [ 13 ] , which enhances understanding of medication-related queries, MedMCQA [ 14 ] , which provides large-scale multiple-choice QA for medical examinations, and PcQA [ 15 ] , which facilitates structured knowledge graph question answering, offer valuable benchmarks, they often fail to capture the deep, interconnected knowledge hidden within multiple sources. Retrieval-Augmented Generation (RAG) has emerged as a promising approach for biomedical knowledge mining by integrating external knowledge into the response generation process [ 16 ] . However, its effectiveness relies on refining the retrieval mechanism to focus on high-quality, contextually relevant content, ensuring more accurate and reliable knowledge extraction [ 17 ] . To address this, SELF-RAG [ 18 ] dynamically adjusts the retrieval process by evaluating the quality of the retrieved content, thereby enhancing the accuracy of long-form answers in complex domains like biomedical research. Other innovative approaches include GraphRAG [ 19 ] , which structures retrieved passages into graphs to capture relationships between them, improving coherence and relevance. CRAG [ 20 ] further refines the process by iteratively filtering out irrelevant passages, ensuring only the most pertinent information is used. Additionally, RAPTOR [ 21 ] organizes retrieval results into a tree structure, recursively summarizing data to facilitate more effective reasoning. In addition to extracting high-quality information from external knowledge bases using RAG, LLMs have recently made breakthrough progress in their inherent reasoning capabilities. For instance, OpenAI’s GPT‑o1 leverages reinforcement learning and a chain-of-thought mechanism to demonstrate reasoning on complex tasks in mathematics, programming, and science—achieving performance comparable to that of PhD-level experts [ 22 ] . Meanwhile, DeepSeek has released its reasoning-oriented model, DeepSeek‑R1 [ 23 ] , which performs on par with GPT‑o1 in logical reasoning, mathematical computation, and code generation, yet its training cost is only a small fraction of that of GPT‑o1. These breakthroughs not only expand the functionalities of large models but also provide stronger intrinsic support for complex domains such as biomedical knowledge mining, helping to yield more accurate answers in cross-document and multi-layer relational reasoning tasks. Figure 1 : Overview of the proposed framework for biomedical knowledge mining. (A) Biomedical knowledge sources, such as research papers and user queries, are processed through (B) A knowledge mining pipeline that leverages a LLM alongside the IP-RAR approach, designed to generate knowledge graph and precise answers. (C) The outputs enable diverse applications, including drug synergy/antagonism, drug repurposing, precision medicine, bottleneck analysis, research planning, and knowledge transfer. In this paper, we present a comprehensive framework for biomedical knowledge mining, as illustrated in Figure 1 . This framework processes diverse biomedical knowledge sources, such as research papers and user queries, through a systematic pipeline that involves constructing knowledge graphs and generating precise responses to user queries. Within this pipeline, LLMs collaborate with retrieval-augmented reasoning techniques