CauTion : Knowing When to Trust LLMs for Ensemble Causal Discovery

Bo Peng, Kaiwen Wu, Sirui Chen, Zhiheng Wang, Yu Qiao, Chaochao Lu · 2026

Read CauTion : Knowing When to Trust LLMs for Ensemble Causal Discovery by Bo Peng, Kaiwen Wu, Sirui Chen, Zhiheng Wang, Yu Qiao, Chaochao Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03602.txt.

Introduction

Peng and co-authors build CauTion, a safer way to mix language model knowledge into causal discovery. Statistical methods alone struggle with causal graphs. Some edges cannot be told apart from data, and small samples add noise. Language models add domain knowledge but can err and cost many tokens. One algorithm's bias can also skew results.

CauTion uses an ensemble of statistical algorithms first. Consensus voting settles up to 96 percent of edges, with near-perfect accuracy on agreed edges. A trust calibration step then weighs the language model against the algorithms. The model arbitrates only where algorithmic evidence is weak. A final repair step guarantees the graph has no cycles. Six datasets show gains over both data-only and model-augmented baselines. Gains grow on larger graphs. The design stays robust when the language model errs.

Catalog record

CREATORBo Peng, Kaiwen Wu, Sirui Chen, Zhiheng Wang, Yu Qiao, Chaochao Lu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03602

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CauTion : Knowing When to Trust LLMs for Ensemble Causal Discovery Bo Peng, Kaiwen Wu, Sirui Chen, Zhiheng Wang, Yu Qiao, Chaochao Lu Abstract Causal discovery from observational data remains challenging due to the fundamental limitations of purely statistical methods, such as statistical distinguishability within equivalence classes and sensitivity to finite sample sizes. While large language models (LLMs) offer a promising source of domain knowledge to complement statistical inference, existing LLM-augmented methods are vulnerable to LLM errors and incur high token costs. Moreover, reliance on a single data-centric algorithm can make results sensitive to algorithm-specific biases. To address these limitations, we propose CauTion , a framework that reliably integrates LLM domain knowledge into an ensemble of statistical causal discovery algorithms through consensus filtering and LLM reliability estimation. CauTion proceeds in three stages. First, an algorithm ensemble utilizes a consensus voting to resolve up to 96% of edges on which algorithms agree, achieving near-perfect accuracy on the filtered consensus edges. Second, a trust-calibrated arbitration mechanism estimates the relative reliability of the LLM and the algorithms via an annotation-free trust calibration procedure, which is then utilized to govern a trust-weighted voting process that restricts LLM arbitration exclusively to edges with unreliable algorithmic evidence. Third, a cycle repair step is applied to guarantee the final causal graph is validly acyclic. Experiments on six datasets demonstrate that CauTion consistently outperforms both data-centric and LLM-augmented baselines, with larger gains on larger graphs and strong robustness to LLM errors. Code is available at https://github.com/OpenCausaLab/CauTion . † † ∗ Equal contribution. † † † Corresponding author. Figure 1: Comparison of existing methods and CauTion . Global methods query the LLM across all O(n^{2}) variable pairs with high LLM error exposure. The O(n^{2}) decision volume incurs either high token cost or low accuracy. Undirected-only methods suffer from error amplification over iterations and incomplete orientation. In both categories, when a data-centric algorithm is incorporated, the final graph is vulnerable to the individual algorithm bias. On the other hand, CauTion addresses these limitations via algorithm ensemble and trust-calibrated arbitration, enabling reliable integration robust to both LLM and single algorithm errors. 1 Introduction Causal discovery serves as a cornerstone for scientific inquiry and robust artificial intelligence [ 25 , 17 , 18 , 33 ] . Existing methods, including constraint-based approaches [ 25 , 26 ] , score-based methods [ 8 , 2 , 14 ] , and continuous optimization [ 35 , 6 ] , have made substantial progress on causal recovery. However, they remain fundamentally limited: constraint-based methods rely on sufficient sample sizes and can only recover a Markov equivalence class (MEC) [ 29 ] ; score-based and continuous optimization methods faces local minimum problem and are sensitive to score function under specific assumptions and hyperparameter choices. Trained on vast corpora, LLMs encode rich prior knowledge about real-world mechanisms and can reason about causal relationships from variable semantics. LLM-augmented methods [ 11 , 23 , 4 , 1 , 21 , 28 , 27 , 15 ] therefore use such semantic priors as an additional source of evidence to compensate for the limitations of purely data-centric causal discovery algorithms. Existing LLM-augmented causal discovery methods can be broadly grouped into two categories: (1) Global methods [ 11 , 23 , 4 , 1 , 21 , 28 , 27 ] use LLMs to assess causal relations over all O(n^{2}) variable pairs, incurring high token cost and unstable pairwise judgments. (2) Undirected-only method [ 15 ] reduces the query space by applying LLMs only to undirected edges in a pre-computed equivalence class, but suffers from accumulated orientation errors and incomplete orientation. Beyond these query-strategy limitations, existing methods often incorporate only a single data-centric algorithm for structural information, making the final graph vulnerable to algorithm-specific biases. To address these challenges, we propose CauTion , an ensemble causal discovery framework that uses algorithmic agreement to determine when LLM domain knowledge should be trusted and incorporated. CauTion operates in three stages. (1) Algorithm ensemble aggregates outputs from multiple causal discovery algorithms and resolves variable pairs on which all algorithms agree, thereby reducing individual algorithm bias and limiting LLM intervention to disputed cases. (2) Trust-calibrated arbitration estimates the reliability of the LLM and the algorithm ensemble, and resolves disputed edges through trust-weighted aggregation, querying the LLM only when algorithmic evidence is insufficiently reliable. (3) Cycle repair ensures that the final graph satisfies the DAG constraint. Together, these stages allow CauTion to exploit reliable algorithmic consensus, selectively invoke LLM domain knowledge for uncertain edges, and combine both sources through calibrated trust. Figure 1 illustrates the advantages of CauTion over existing LLM-augmented methods. CauTion consistently outperforms all baselines during experiments, with gains becoming more pronounced as graph scale grows—on the largest benchmark Win95pts ( n{=}76 ), CauTion achieves an SHD (Structural Hamming Distance) of 27 compared to 63 for the second-best LLM-augmented baseline. Moreover, CauTion demonstrates strong robustness to LLM selection, maintaining superior performance across six LLMs of varying capability. To summarize, our main contributions are: • Conceptually , we formulate LLM-augmented causal discovery as a trust-calibrated arbitration problem. This perspective treats LLMs and data-centric algorithms as complementary but imperfect evidence sources, and emphasizes that LLM knowledge should be incorporated only after its reliability is calibrated against an ensemble of statistical causal discovery algorithms. • Methodologically , we propose CauTion , a trust-calibrated ensemble framework for causal discovery. It combines cross-algorithm consensus, reliability-aware LLM arbitration, and DAG-preserving cycle repair to construct reliable and valid causal graphs. • Empirically , we show that CauTion consistently improves causal graph recovery across benchmarks and graph scales. CauTion achieves stronger recovery performance while reducing unnecessary LLM queries, with gains becoming more pronounced as the number of variables increases. 2 Related Work Data-driven Methods Purely data-driven causal discovery methods rely on the statistical properties of observational data and span a range of paradigms, including constraint-based methods (e.g., PC [ 25 ] , FCI [ 26 ] ), score-based methods (e.g., GES [ 8 ] , BOSS [ 2 ] , GRaSP [ 14 ] , CaMML [ 30 ] ), and continuous optimization methods (e.g., NOTEARS [ 35 ] , DAGMA [ 6 ] ). Constraint-based methods are sensitive to test errors under finite samples and can only recover a Markov equivalence class (MEC), leaving some edge directions unresolved. Score-based methods optimize a scoring function over an exponentially large graph space, relying on greedy or stochastic search heuristics that cannot guarantee global optimality. Moreover, they depend on distributional assumptions in score functions that may not hold in practice. Continuous optimization methods introduce non-convex objectives that are sensitive to hyperparameter choices and thresholding. Across all these paradigms, a shared limitation remains: without external domain knowledge, purely statistical methods cannot reliably resolve causal structure beyond what the data alone can identify. LLM-Augmented Methods Existing LLM-augmented causal discovery methods can be broadly categorized by how they involve LLMs in the discovery process, as summarized in Figure 1 and Appendix A Table 2 . The global LLM methods query the LLM across all variable pairs, either to construct the causal graph directly or to inject LLM knowledge into statistical algorithms. LLM-BFS [ 11 ] constructs the causal graph via BFS-guided LLM queries. Similarly, Causal-LLM [ 23

Read the complete text