Paths to Causality: Finding Informative Subgraphs Within Knowledge Graphs for Knowledge-Based Causal Discovery Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on
Yuni Susanti, Michael Färber · 2025
Read Paths to Causality: Finding Informative Subgraphs Within Knowledge Graphs for Knowledge-Based Causal Discovery Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on by Yuni Susanti, Michael Färber (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08771.txt.
Introduction
Susanti and Färber improve in twenty twenty-five how language models infer cause and effect from variable descriptions alone. Judging causes from names and context, rather than from data, is a useful shortcut for complex systems. But models asked directly give unstable, inconsistent answers, which undermines trust in their causal calls.
Their method searches a knowledge graph for the most informative path-shaped subgraphs between two variables. A ranking model picks the best subgraphs, which are then placed into the model's prompt. Tests on medical and general datasets beat most rival methods by wide margins across several models and graphs. The team shares code and data openly for reuse.
Catalog record
| CREATOR | Yuni Susanti, Michael Färber |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08771
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Paths to Causality: Finding Informative Subgraphs Within Knowledge Graphs for Knowledge-Based Causal Discovery Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3711896.3737076 ISBN: 979-8-4007-1454-2/2025/08 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Causal reasoning and diagnostics Yuni Susanti, Michael Färber Abstract . Inferring causal relationships between variable pairs is crucial for understanding multivariate interactions in complex systems. Knowledge-based causal discovery —which involves inferring causal relationships by reasoning over the metadata of variables (e.g., names or textual context)—offers a compelling alternative to traditional methods that rely on observational data. However, existing methods using Large Language Models (LLMs) often produce unstable and inconsistent results, compromising their reliability for causal inference. To address this, we introduce a novel approach that integrates Knowledge Graphs (KGs) with LLMs to enhance knowledge-based causal discovery. Our approach identifies informative metapath -based subgraphs within KGs and further refines the selection of these subgraphs using Learning-to-Rank -based models. The top-ranked subgraphs are then incorporated into zero-shot prompts, improving the effectiveness of LLMs in inferring the causal relationship. Extensive experiments on biomedical and open-domain datasets demonstrate that our method outperforms most baselines by up to 44.4 points in F1 scores, evaluated across diverse LLMs and KGs. Our code and datasets are available on GitHub. 1 1 1 https://github.com/susantiyuni/path-to-causality † † cc-license: by 1. Introduction Many of the most critical research questions involve inferring causal relationships ( Feder et al. 2022 ) . For example, a physician must understand the potential side effects of a drug on a patient, as well as how it affects disease progression, before recommending a specific drug or treatment. Thus, inferring causal relationships between pairs of variables, such as (smoking, lung cancer) , is a fundamental step in causal discovery, as it enhances our understanding of the complex interactions among interconnected variables. Consequently, uncovering causal information through the analysis of observational data—a process known as causal discovery —has recently garnered significant attention ( Spirtes et al. 2001a ) . Conventionally, causal discovery involves learning causal relations from observational data by using statistical methods and algorithms to infer causal structures and dependencies between variables, such as with PC and FCI algorithms ( Spirtes et al. 2000 ) . Recently, Large Language Models (LLMs) offer a new perspective to tackle the causal discovery problem by reasoning on the metadata associated with variables (e.g., variable names) instead of their actual data values–an approach referred to as knowledge-based causal discovery ( Kıcıman et al. 2023 ; Susanti and Färber 2024 ) . In addition to being less dependent on large observational data, LLMs offer extensive prior knowledge drawn from diverse sources, such as scientific literature, databases, and domain-specific texts. This provides a rich context that observational data alone cannot offer. Thus, we argue that LLMs possess the capability to reveal complex causal patterns that traditional statistical methods might overlook, particularly in high-dimensional observational data. However, despite their strengths, LLMs often produce unstable results and may produce hallucinations during reasoning, leading to incorrect conclusions and reducing their performance and reliability ( Hong et al. 2023 ; Wang et al. 2023a ) . These issues significantly compromise the reliability of LLMs, especially for causal reasoning in sensitive domains such as healthcare and biomedicine. To address these issues, knowledge graphs (KGs) with their rich and diverse structured information have been integrated to enhance LLMs’ reasoning, especially for question answering (QA), which needs both textual understanding and extensive real-world knowledge ( Pan et al. 2024 ) . KGs such as Wikidata ( Vrandečić and Krötzsch 2014 ) (cross-domain) and Hetionet ( Himmelstein et al. 2017 ) (domain-specific) serve as reliable, interpretable sources for causal reasoning by capturing interconnections between information. This image shows 1-hop connections between raloxifene and melanoma in Hetionet KG Figure 1. 1-hop connections between (raloxifene, melanoma) in Hetionet ( Himmelstein et al. 2017 ) . Relation types are omitted for readability. This image shows 1-hop connections between raloxifene and melanoma in Hetionet KG The information in a KG that is relevant for causal reasoning is often complex, involving non-linear dependencies or associations that can be indirectly found through multi-hop paths. For example, in Figure 1 , the subgraph [raloxifene-ERBB2-melanoma] provides valuable insights for inferring the causal relationship between raloxifene and melanoma . This subgraph indicates that raloxifene , a type of drug, upregulates gene ERBB2 , which has been associated with disease melanoma . This suggests the potential of melanoma as a side effect of taking raloxifene . A challenge lies in identifying such informative subgraphs within KGs for a given variable pair and using them with LLMs. As shown in Figure 1 , there are a total of 32 1-hop connections between raloxifene and melanoma in the KG, which increases to 1,031 subgraphs when extended to 2-hop connections. Naively processing all of these subgraphs would lead to an excessive number of LLM queries. While related works often select contextually relevant information from KGs based on vector similarity ( Kang et al. 2023 ; Shen et al. 2023 ; Baek et al. 2023a ) , we argue that relying solely on similarity-based approach for identifying informative subgraphs is not optimal for the more complex task of causal discovery. In this paper, we present a novel approach for integrating informative subgraphs from KGs with LLMs to enhance knowledge-based causal discovery. Our method focuses on identifying and leveraging informative metapath -based subgraphs within KGs. First, an LLM estimates the relevance of the subgraphs in KGs with respect to determining causal relationships between variable pairs. Then, we develop specialized subgraph ranking models to refine the subgraph selection process, exploring various Learning-to-Rank approaches ( pairwise, pointwise, listwise ) and algorithms ( neural network and classical gradient boosting methods). This marks the first dedicated approach for identifying informative subgraphs within KGs for this task. Finally, we integrate the top-ranked subgraphs into a comprehensive framework for knowledge-based causal discovery. The framework incorporates the target variable pair, instructions, textual context, and top-ranked informative subgraphs into the prompt, enabling zero-shot reasoning by leveraging the pretrained knowledge of LLMs—without requiring large observational datasets or extensive supervised training. Our experiments across multiple benchmark datasets from different domains show significant performance improvements of LLMs in inferring causal relationships between variable pairs, as evaluated across diverse language models and knowledge graphs. Overall, we make the following contributions: • We propose a new approach to enhance LLMs’ causal reasoning by integrating them with KGs for zero-shot knowledge-based causal discovery, eliminating reliance on observational data. • We introduce specialized subgraph ranking models based on various Learning-To-Rank methods to refine subgraph selection from KGs, enhancing the performance of LLMs for inferring causal relationships by up to a 44.8-point increase in F1 score. • We conduct extensive experiments on publicly available biomedical and open-domain datasets, demonstrating the effectiveness of our approach. Our method surpasses most baselines and shows generalizability across different LLMs and KGs. • We compared our approach to conventional statistical causal discovery methods using observational data, achieving up to a 17-point reduction in Hamming distance and a 25.17-point