Retrieving Classes of Causal Orders with Inconsistent Knowledge Bases

Federico Baldo, Simon Ferreira, Charles K. Assaad · 2024

Read Retrieving Classes of Causal Orders with Inconsistent Knowledge Bases by Federico Baldo, Simon Ferreira, Charles K. Assaad (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14019.txt.

Introduction

Federico Baldo, Simon Ferreira, and Charles Assaad tackle causal discovery from unreliable knowledge in a 2024 paper. Traditional methods rest on strong assumptions that often fail in practice. Large language models can extract causal claims from text, but they hallucinate and blur direct with indirect causes.

The authors work with knowledge bases that may be inconsistent. They use a consistency measure as a proxy for reliability when retrieving classes of causal orders. Their approach tries to salvage useful causal structure from flawed sources, a realistic setting for medicine and science, where expert knowledge rarely arrives clean.

Catalog record

CREATORFederico Baldo, Simon Ferreira, Charles K. Assaad
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-14019

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Retrieving Classes of Causal Orders with Inconsistent Knowledge Bases Federico Baldo, Simon Ferreira, Charles K. Assaad Abstract Traditional causal discovery methods often depend on strong, untestable assumptions, making them unreliable in real-world applications. In this context, Large Language Models (LLMs) have emerged as a promising alternative for extracting causal knowledge from text-based metadata, effectively consolidating domain expertise. However, LLMs are prone to hallucinations, necessitating strategies that account for these limitations. One effective approach is to use a consistency measure as a proxy of reliability. Moreover, LLMs do not clearly distinguish direct from indirect causal relationships, complicating the discovery of causal Directed Acyclic Graphs (DAGs), which are often sparse. This ambiguity is evident in the way informal sentences are formulated in various domains. For this reason, focusing on causal orders provides a more practical and direct task for LLMs. We propose a new method for deriving abstractions of causal orders that maximizes a consistency score obtained from an LLM. Our approach begins by computing pairwise consistency scores between variables, from which we construct a semi-complete partially directed graph that consolidates these scores into an abstraction. Using this structure, we identify both a maximally oriented partially directed acyclic graph and an optimal set of acyclic tournaments that maximize consistency across all configurations. We further demonstrate how both the abstraction and the class of causal orders can be used to estimate causal effects. We evaluate our method on a wide set of causal DAGs extracted from scientific literature in epidemiology and public health. Our results show that the proposed approach can effectively recover the correct causal order, providing a reliable and practical LLM-assisted causal framework. A Preprint Keywords Causal Inference, Information Retrieval, Large Language Models 1 Introduction Traditional causal discovery algorithms rely on observational (or interventional) data to uncover causal relationships. To do so, they often make strong assumptions ( Spirtes et al., 2001 ; Glymour et al., 2019 ; Peters et al., 2017 ; Assaad et al., 2022 ) , such as causal sufficiency and faithfulness. The recent rise in popularity of Large Language Models (LLMs) offers a new tool to discover causal models ( Long et al., 2023a ; Long et al., 2023b ; Cohrs et al., 2023 ; Vashishtha et al., 2025 ; Kiciman et al., 2024 ) . Unlike traditional causal discovery methods, LLM-aided approaches operate on textual data, leveraging pre-collected knowledge encoded in their training data. However, LLMs have been frequently observed to provide ambiguous, inconsistent, or prompt-sensitive answers when queried about causal relationships ( Zečević et al., 2023 ) . Moreover, LLMs have limited capabilities when it comes to uncovering new knowledge or simply generating novel ideas, which undermines their applicability in the discovery of causal structures ( Si et al., 2025 ) Most importantly, as noted in Vashishtha et al. (2025) , in natural language, direct and indirect causes are often conflated, making them difficult to distinguish. This ambiguity is evident in informal statements across various domains, including philosophy, medicine, and epidemiology. For instance, we commonly assert that a sedentary lifestyle causes type 2 diabetes, when in fact this link is fully mediated by obesity ( Li et al., 2022 ) . More generally, causal relations are frequently verbally expressed as a simple relationship: ” X causes Y ” or ” X affects Y ” or ” X prevents Y ”, etc. This oversimplification obscures the complex web of direct and indirect influences, including immediate ”parents” and distant ”ancestors” of a causal pathway. In this paper, we argue that LLMs are not effective for discovering causal Directed Acyclic Graphs (DAGs), but rather allow us to retrieve abstractions of causal orders that can, under certain conditions, be used to estimate total effects , or Average Treatment Effects (ATE). In this context, we account for the inherent unreliability of LLMs, which often produce hallucinated or inconsistent responses. We propose to quantify the reliability of the LLM and use such a metric as a heuristic to identify abstractions of causal orders. Specifically, uncertainty in the LLM’s responses is captured through self-consistency, defined as the stability of its answers when queried multiple times about pairwise causal relationships. By maximizing this consistency measure, we identify an abstraction in the form of a Semi-Complete Partially Directed Graph (PDG), which can be transformed into a dense Maximally oriented Partially Directed Acyclic Graph (MPDAG) ( Perkovic, 2020 ) . We show that such an MPDAG can be used to establish a simpler criterion for the identifiability of the total effect in settings with a single treatment. Additionally, based on the Semi-Complete PDG, we propose an exact method to derive all maximally consistent causal orders. Unlike traditional causal discovery methods ( Spirtes et al., 2001 ; Glymour et al., 2019 ; Peters et al., 2017 ; Assaad et al., 2022 ) , our approach does not rely on faithfulness, or any parametric assumption, but only on acyclicity and causal sufficiency. We view the LLM as an inconsistent knowledge base ( Zheng et al., 2024 ) , rather than an imperfect expert ( Long et al., 2023a ) , which can be used to rapidly access a large amount of information. This perspective reflects the skepticism toward the ability of LLMs to discover new causal relationships ( Zečević et al., 2023 ; Si et al., 2025 ) . Contributions • We show how to derive a dense MPDAG from the knowledge provided by an LLM and how it can be used to establish a simpler criterion for identifiability of the total effect. • We provide an effective algorithm to find a class of causal orders maximally consistent with an LLM. Such a method is based on a top-down search strategy that does not require any parametric assumptions or faithfulness. The remainder of the paper is organized as follows: in Section 2 , we review relevant literature related to LLM-aided causal discovery; in Section 3 , we provide some of the basic formal notions used in the paper; in Sections 4 and 5 , we present the main contribution of the paper and details regarding the proposed method; Sections 6 and 7 conclude the paper with experimental results and final considerations. Further details regarding the experimental setting, the implementation of the algorithm, and the proofs of the propositions and theorems presented in the paper are provided in the Appendix. 2 Related Work Causal Inference with Background Knowledge. The use of prior knowledge in causal discovery has been a long-standing research topic aimed at integrating domain-specific information to refine causal graphs. Meek (1995) proposed a set of rules, known as Meek rules, to orient edges in a Completed Partially Directed Acyclic Graph (CPDAG) based on prior knowledge. These rules allow us to refine the CPDAG by orienting edges while preserving the conditional independence encoded in the graph and the acyclicity constraint. More recently, Maathuis and Colombo (2015) ; Perkovic et al. (2017) ; Perković et al. (2017) ; Perkovic (2020) ; Venkateswaran and Perković (2024) propose a generalization of identifiability by adjustment to abstraction of causal graphs, such as Partially Directed Acyclic Graphs (PDAGs), CPDAGs, and MPDAGs. LLMs in Causal Discovery. In causal discovery, LLMs have often been referred to as imperfect experts ( Long et al., 2023a

Read the complete text