Domain-Specific Knowledge Graphs in RAG-Enhanced Healthcare LLMs
Sydney Anuyah * , Mehedi Mahmud Kaushik * , Hao Dai ‡ , Rakesh Shiradkar † , Arjan Durresi * , Sunandan Chakraborty * · 2026
Read Domain-Specific Knowledge Graphs in RAG-Enhanced Healthcare LLMs by Sydney Anuyah * , Mehedi Mahmud Kaushik * , Hao Dai ‡ , Rakesh Shiradkar † , Arjan Durresi * , Sunandan Chakraborty * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15429.txt.
Introduction
Sydney Anuyah, Mehedi Mahmud Kaushik, and co-authors test whether knowledge graphs make medical chatbots more trustworthy. Their 2026 arXiv paper deals with large language models in health care. The models answer fluently but can fail at domain-specific reasoning.
The team builds three graphs from PubMed papers. One covers type 2 diabetes, one Alzheimer's disease, and one both diseases together. They test whether these graphs improve retrieval-augmented generation. In that setup, the model reads retrieved facts before it answers. The three graphs supply structured, checked facts for the retrieval step to use well.
Catalog record
| CREATOR | Sydney Anuyah * , Mehedi Mahmud Kaushik * , Hao Dai ‡ , Rakesh Shiradkar † , Arjan Durresi * , Sunandan Chakraborty * |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15429
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Domain-Specific Knowledge Graphs in RAG-Enhanced Healthcare LLMs Sydney Anuyah * , Mehedi Mahmud Kaushik * , Hao Dai ‡ , Rakesh Shiradkar † , Arjan Durresi * , Sunandan Chakraborty * Abstract Large Language Models (LLMs) generate fluent answers but can struggle with trustworthy, domain-specific reasoning. We evaluate whether domain knowledge graphs (KGs) improve Retrieval-Augmented Generation (RAG) for healthcare by constructing three PubMed-derived graphs: 𝔾 1 \mathbb{G}_{1} (T2DM), 𝔾 2 \mathbb{G}_{2} (Alzheimer’s disease), and 𝔾 3 \mathbb{G}_{3} (AD+T2DM). We design two probes: Probe 1 targets merged AD–T2DM knowledge, while Probe 2 targets the intersection of 𝔾 1 \mathbb{G}_{1} and 𝔾 2 \mathbb{G}_{2} . Seven instruction-tuned LLMs are tested across retrieval sources { No-RAG , 𝔾 1 \mathbb{G}_{1} , 𝔾 2 \mathbb{G}_{2} , 𝔾 1 \mathbb{G}_{1} + 𝔾 2 \mathbb{G}_{2} , 𝔾 3 \mathbb{G}_{3} , 𝔾 1 \mathbb{G}_{1} + 𝔾 2 \mathbb{G}_{2} + 𝔾 3 \mathbb{G}_{3} } and three decoding temperatures. Results show that scope alignment between probe and KG is decisive: precise, scope-matched retrieval (notably 𝔾 2 \mathbb{G}_{2} ) yields the most consistent gains, whereas indiscriminate graph unions often introduce distractors that reduce accuracy. Larger models frequently match or exceed KG-RAG with a No-RAG baseline on Probe 1, indicating strong parametric priors, whereas smaller/mid-sized models benefit more from well-scoped retrieval. Temperature plays a secondary role; higher values rarely help. We conclude that precision-first, scope-matched KG-RAG is preferable to breadth-first unions, and we outline practical guidelines for graph selection, model sizing, and retrieval/reranking. Code and Data available here - https://github.com/sydneyanuyah/RAGComparison I Introduction Alzheimer’s disease (AD) and type 2 diabetes mellitus (T2DM) represent two of the most pressing chronic health challenges we face today [ 1 , 2 ] , each carrying its own significant public health burden while also sharing surprising connections with one another [ 3 ] . Today, AD stands as the primary cause of dementia in older adults [ 4 , 5 ] . More than 55 million people worldwide are living with dementia, and experts predict this could surge to somewhere between 139 and 150 million by 2050 [ 6 , 7 ] . T2DM shows a similarly alarming trend, with roughly 589 million adults as of 2024 (that’s about 11.1% of the adult population) living with the condition, and projections suggest we could see around 853 million cases by mid-century [ 8 ] . What is particularly striking is that over 90% of all diabetes cases are type 2 [ 8 , 9 ] , largely driven by our ageing populations and modern lifestyle factors. As life expectancy continues to climb, there are statistically more people dealing with both metabolic and neurodegenerative diseases simultaneously [ 10 ] , which makes understanding the relationship between AD and T2DM increasingly urgent for biomedical AI development. Epidemiological research has consistently shown that having diabetes substantially increases the risk of cognitive decline and dementia, including AD [ 11 ] . A recent 2024 meta-analysis showed that diabetic patients face about 59% higher dementia risk compared to people without diabetes [ 11 , 12 ] , which reinforces what earlier studies had found that T2DM increases an individual’s risk of cognitive disorders by roughly 1.3 to 1.9 times [ 13 ] . When we dig into the molecular details, the picture gets even more interesting. The chronic high blood sugar and insulin resistance that defines T2DM actually mirrors some of the same pathophysiological processes we see in AD [ 14 ] . This similarity has led some researchers to provocatively label AD as “type 3 diabetes" though this remains controversial [ 15 , 16 , 17 , 18 ] . The idea emphasizes the overlapping features: impaired insulin signaling in the brain, chronic inflammation, and oxidative stress [ 13 ] . Both conditions also share common risk factors such as midlife obesity and high blood pressure [ 13 ] . Despite the wealth of published research on AD–T2DM connections, Large Language Models (LLMs) on their own have real trouble delivering reliable medical answers [ 19 ] . Today’s state-of-the-art (SOTA) LLMs can certainly generate impressively fluent responses, but they frequently hallucinate facts or fabricate citations that do not exist, which is a serious safety concern in healthcare settings [ 20 ] . Even powerful models like GPT-4 have inherent knowledge limitations that mean they might miss crucial domain-specific details or misrepresent the latest findings. This is where Retrieval-Augmented Generation (RAG) has become the go-to solution, helping ground LLM outputs in external, verified knowledge [ 21 ] . By pulling in relevant documents or facts when answering a query, RAG significantly improves factual accuracy [ 21 ] . However, conventional RAG systems that retrieve free-text passages can still drag in irrelevant or contradictory information, which the LLM might then mistakenly weave into its answer [ 21 ] . This becomes especially problematic for knowledge-intensive questions that require multiple reasoning steps, where models need to piece together complex biomedical relationships. TABLE I : Examples of triples used for the knowledge graphs KG Example \mathbb{G}_{1} ["Entity 1": "T2DM", "Relationship": "was associated with", "Entity 2": "decreased forced expiratory volume in 1s (FEV1)"] \mathbb{G}_{2} ["Entity 1": "Alzheimer’s disease CSF", "Relationship": "is associated with", "Entity 2": "neuroinflammation"] \mathbb{G}_{3} ["Entity 1": “Insulin-like growth factor ", "Relationship": "influences", "Entity 2": “cognitive functions"] Structured knowledge bases offer a more promising alternative. Knowledge graphs (KGs) organize facts as subject–relation–object triples (E_{1},R,E_{2}) as seen in Table I , where E_{1} is the subject entity, E_{2} is the object entity, and R represents their relationship. This structured representation provides clear semantics and traceable origins, making it easier to verify how an answer was constructed. Yet, critical questions remain about how best to leverage KGs in healthcare AI: Does curating domain-specific KGs from biomedical literature actually improve answer quality in RAG-enhanced LLMs? Should we build narrow, disease-focused graphs or broader cross-domain ones? And how do these design choices interact with model parameters like decoding temperature? In this research, we investigate the role of domain-specific KGs curated from PubMed abstracts in RAG-enhanced healthcare LLMs. We ask whether such KGs improve the factual accuracy and evidential support of answers compared to no-RAG baselines ( RQ1 ). We further examine how curation scope affects question answering: do focused, disease-specific KGs (G1 for T2DM, G2 for AD) outperform a broader merged KG (G3) on single-hop and multi-hop probes, or vice versa ( RQ2 )? We also investigate the robustness of RAG gains across different decoding temperatures (0, 0.2, 0.5) and test for statistical significance of improvements ( RQ3 ). Finally, we explore whether we can enhancing the components of the CoDe-KG pipeline to yield higher-quality graphs that translate into better downstream QA performance ( RQ4 ). I-A Contributions In this research, we investigate the role of domain-specific KGs curated from abstracts on PubMed for RAG-enhanced healthcare LLMs. • We build three abstract-derived KGs with a common schema: \mathbb{G}_{1} (T2DM-focused), \mathbb{G}_{2} (AD-focused), and \mathbb{G}_{3} (combined AD+T2DM). • We introduce probe sets spanning single-hop clinical facts (e.g., drug \rightarrow outcome, gene \rightarrow disease) and multi-hop mechanisms (e.g., insulin signaling \rightarrow neuroinflammation \rightarrow cognition) • We evaluate 7 LLMs with and without KG-RAG across varying temperatures 0 , 0.2 , and 0.5 , measuring F 1 score, and accuracy across the