Dynamic Expert-Guided Model Averaging for Causal Discovery
Adrick Tench, Thomas Demeester · 2026
Read Dynamic Expert-Guided Model Averaging for Causal Discovery by Adrick Tench, Thomas Demeester (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16715.txt.
Introduction
Adrick Tench and Thomas Demeester help health teams find cause links in data. True cause maps make health calls clear and sound. They let teams gauge what a drug or act will do. But dozens of cause-hunt tools crowd the field. No tool wins on all data types. Their 2026 preprint blends tools with expert help.
Their blend shifts weight among tools as proof comes in. A guide tool steers which tool to trust when. The mix aims to beat any lone tool's map. Sound cause maps shape care, trials, and health spend. This blend may spare teams the trap of a poor lone pick.
Catalog record
| CREATOR | Adrick Tench, Thomas Demeester |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-16715
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Expert-Guided Model Averaging for Causal Discovery Adrick Tench, Thomas Demeester Abstract Understanding causal relationships is critical for healthcare. Accurate causal models provide a means to enhance the interpretability of predictive models, and furthermore a basis for counterfactual and interventional reasoning and the estimation of treatment effects. However, would-be practitioners of causal discovery face a dizzying array of algorithms without a clear best choice. This abundance of competitive algorithms makes ensembling a natural choice for practical applications. At the same time, real-world use cases frequently face challenges that violate the assumptions of common causal discovery algorithms, forcing heavy reliance on expert knowledge. Inspired by recent work on dynamically requested expert knowledge and LLMs as experts, we present a flexible model averaging method leveraging dynamically requested expert knowledge to ensemble a diverse array of causal discovery algorithms. Experiments demonstrate the efficacy of our method with imperfect experts such as LLMs on both clean and noisy data. We also analyze the impact of different degrees of expert correctness and assess the capabilities of LLMs for clinical causal discovery, providing valuable insights for practitioners. \SetKw kwinin \SetKw kwandand \SetKw kworor \SetKw kwnotnot † † volume: LEAVE UNSET † † year: 2026 † † submitted: LEAVE UNSET † † published: LEAVE UNSET Data and Code Availability All of our data comes from publicly available sources: the Bayesys repository ( Constantinou et al. 2020 ) and SimSUM dataset ( Rabaey et al. 2025 ) , the latter of which is available at https://huggingface.co/datasets/prabaey/simsum . Our code will be made available on GitHub following peer review. An anonymized version is available at https://anonymous.4open.science/r/expert-cd-ensemble-3281/ . Institutional Review Board (IRB) IRB approval is not required, as our research does not involve human subjects or sensitive data. 1 Introduction Many applications in healthcare require not just accurate predictive models, but a robust understanding of the underlying causal mechanisms. Structural Causal Models (SCMs) such as Bayesian networks (BNs) are a popular choice for applications such as clinical decision support systems, due to their inherent interpretability and capacity for counterfactual and interventional reasoning ( Kyrimi et al. 2021 ) . Causal discovery aims to learn SCMs from observational data, potentially revealing valuable new causal relationships for clinical research and practice. To this end, there has been significant interest in applications of causal discovery in healthcare ( Shen et al. 2021 ; Yang et al. 2023 ; Zahoor et al. 2025 ; Petrungaro et al. 2025 ) . Randomized clinical trials (RCTs) are the gold standard for determining causal relationships, but conducting RCTs is often costly and difficult, if not impossible. Causal discovery can point the way towards the most useful clinical trials to perform and provide insight in cases where clinical trials are infeasible. However, would-be practitioners of causal discovery face a great diversity of methods, with no clear indicators of which method is the best for their use-case ( Kitson et al. 2023 ) . We therefore seek to provide a general-purpose method for ensembling in causal discovery that can flexibly incorporate a diverse array of learning algorithms with expert domain knowledge. Our primary contributions are threefold: • We provide a general model averaging strategy that uses dynamically requested expert knowledge to mediate discrepancies between models. To our knowledge, our method is the first to explore the use of expert knowledge for model averaging or ensembling in causal discovery. • We evaluate the performance of our method as an ensembling approach for causal discovery against several baselines on well-known, real-world graphs, using both clean and noisy data to better reflect the challenges of real-world applications of causal discovery. • We assess the use of LLMs and investigate the impact of varying degrees of expert correctness on our method, helping establish to what extent imperfect experts can be useful in mediating model averaging. 2 Related Work 2.1 Assumptions and data noise The theoretical bases for many causal discovery algorithms rely on assumptions that are frequently impossible to verify in practice, such as causal sufficiency (the absence of latent confounders). A plethora of algorithms exist that attempt to address different possible assumption violations. For example, the well-known FCI algorithm ( Spirtes et al. 2000 ) works in the presence of latent confounders and can provide some insight in the presence of selection bias ( Spirtes et al. 2013 ) ; the SAT-based approach of Hyttinen et al. 2013 handles latent confounders and cyclicity; and the hill-climbing based approach of Liu and Constantinou 2022 is shown to improve performance in the face of missing data, including data Missing Not At Random. However, such approaches typically only address one or two assumptions while leaving others untouched. Furthermore, analysis of the performance of well-known causal discovery algorithms under data noise that violates various common assumptions reveals inconsistencies in algorithm performance across metrics and noise types ( Constantinou et al. 2021 ) . 2.2 Ensembling in causal discovery The performance of individual causal discovery algorithms can vary widely and unpredictably ( Kitson et al. 2023 ) , making the improved robustness provided by ensembling ( Zhou 2025 ) a natural choice for applying causal discovery in practical settings. However, to our knowledge, little research has been done exploring the best methods for performing ensembling or model averaging in causal discovery. Constantinou 2019a provides a method for model averaging that greedily adds edges by order of the most counts, avoiding cycles as the graph is constructed. Aslani and Mohebbi 2023 treat ensembling as an optimization problem, using a distance measure between graphs to maximize the marginal contribution of the edges in the final graph. Khatibi et al. 2024 present their strongest results from a weighted ensemble of existing causal discovery algorithms. However, their approach relies on access to unrealistic metadata about the ground-truth causal graph that would not be available in a practical setting. 2.3 Expert knowledge Prior work has typically focused on including expert knowledge as prior constraints ( Constantinou et al. 2023 ) . A recent contribution from Kitson and Constantinou 2025 explored using dynamically-requested expert knowledge in the score-based tabu algorithm. Unlike our approach, their method is intended for use with a human expert, and evaluation largely focused on a setting with clean data and a perfect (simulated) expert. There has also been much interest in using LLMs as experts to enable causal discovery ( Liu et al. 2025 ) . Vashishtha et al. 2025 present a strong case for restricting LLMs to answering causal ordering questions, and provide a method for prompting LLMs to obtain a causal order over a whole graph, to be used as prior constraints. Khatibi et al. 2024 introduce a general framework for using an LLM to refine the output of a causal discovery algorithm. In line with the dynamic knowledge method of Kitson and Constantinou 2025 , Tao et al. 2025 use active requests to an LLM to augment continuous optimization algorithms (e.g. Zheng et al. 2018 ’s NOTEARS). Inspired by these contributions, we explore the use of imperfect experts (such as LLMs) to dynamically answer causal ordering questions, improving model averaging across an ensemble of varied causal discovery algorithms. 3 Methods 3.1 Expert Model Averaging We treat the problem of ensembling as one of model averaging: given