CausalGuard : Conformal Inference under Graph Uncertainty
Vikash Singh, Weicong Chen, Debargha Ganguly, Yanyan Zhang, Nengbo Wang, Sreehari Sankar, Mohsen Hariri, Alexander Nemecek, Chaoda Song, Shouren Wang, Biyao Zhang, Van Yang, Erman Ayday, Jing Ma, Vipin Chaudhary, [0.3em] Case Western Reserve University[0.3em] [email protected] · 2026
Read CausalGuard : Conformal Inference under Graph Uncertainty by Vikash Singh, Weicong Chen, Debargha Ganguly, Yanyan Zhang, Nengbo Wang, Sreehari Sankar, Mohsen Hariri, Alexander Nemecek, Chaoda Song, Shouren Wang, Biyao Zhang, Van Yang, Erman Ayday, Jing Ma, Vipin Chaudhary, [0.3em] Case Western Reserve University[0.3em] [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21928.txt.
Introduction
Vikash Singh and co-authors present CausalGuard, a tool for estimating treatment effects when the true causal graph is unknown. Picking the wrong adjustment set can break coverage, while wrappers that ignore the graph regain coverage only with wide intervals. CausalGuard pools graph-conditional doubly robust pseudo-outcomes, then tunes it with weighted conformal inference. Across five benchmarks it keeps coverage above the nominal 90 percent level for the target that can be checked at once, with narrower widths than baselines. It also blocks invalid collider adjustment under stress tests.
Catalog record
| CREATOR | Vikash Singh, Weicong Chen, Debargha Ganguly, Yanyan Zhang, Nengbo Wang, Sreehari Sankar, Mohsen Hariri, Alexander Nemecek, Chaoda Song, Shouren Wang, Biyao Zhang, Van Yang, Erman Ayday, Jing Ma, Vipin Chaudhary, [0.3em] Case Western Reserve University[0.3em] [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90162 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21928
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CausalGuard : Conformal Inference under Graph Uncertainty Vikash Singh, Weicong Chen, Debargha Ganguly, Yanyan Zhang, Nengbo Wang, Sreehari Sankar, Mohsen Hariri, Alexander Nemecek, Chaoda Song, Shouren Wang, Biyao Zhang, Van Yang, Erman Ayday, Jing Ma, Vipin Chaudhary, [0.3em] Case Western Reserve University[0.3em] [email protected] Abstract Estimating treatment effects from observational data requires choosing an adjustment set, but valid adjustment depends on an unknown causal graph. Graph misspecification can cause under-coverage, while graph-agnostic conformal wrappers may regain nominal coverage only through large padding. We introduce CausalGuard , a structure-weighted conformal framework that calibrates after aggregating graph-conditional doubly robust pseudo-outcomes. Candidate DAGs are proposed from an LLM-derived edge prior, pruned by conditional-independence tests, and reweighted by Bayesian Information Criterion. A composite nonconformity score then calibrates the posterior-weighted pseudo-outcome. CausalGuard provides distribution-free finite-sample marginal coverage for this aggregated pseudo-outcome; under causal identification, overlap, conditional-mean nuisance stability, and concentration on target-aligned valid adjustment strategies, its conditional mean converges to the true Conditional Average Treatment Effect. Across five benchmarks, CausalGuard attains mean coverage above the nominal 90% level for the directly evaluable target and reduces width when graph-agnostic conformal baselines require large padding. Stress tests show that CausalGuard suppresses invalid collider adjustment and remains stable under misspecified priors when the retained candidate set is data-supported. 1 Introduction Estimating individualized treatment effects from observational data requires choosing an adjustment set that blocks confounding. That choice depends on the underlying causal Directed Acyclic Graph (DAG), which is rarely known in practice [ 30 ] . Modern heterogeneous-effect estimators such as doubly robust learners [ 4 ] and causal forests [ 43 ] can be statistically efficient once a valid graph is specified, but they are brittle to structural misspecification: omitting confounders destroys identification, while adjusting for colliders or treatment descendants can induce additional bias [ 40 ] . Conformal inference is a natural response to this uncertainty because it provides finite-sample marginal coverage without distributional assumptions [ 24 , 32 ] . However, under causal graph uncertainty, graph-agnostic conformal wrappers can preserve marginal coverage for their observable calibration target; but if that target is based on an invalid adjustment set, the resulting interval need not provide formal coverage for the causal estimand. This work addresses that limitation through structure-weighted conformal inference , instantiated in our method CausalGuard . Instead of committing to a single graph, CausalGuard constructs an ensemble of plausible DAGs, fits graph-conditional doubly robust estimators under each corresponding adjustment set, and aggregates and conformalizes the resulting predictions. The central object is a composite nonconformity score defined on a posterior-weighted pseudo-outcome, which transfers structural uncertainty directly into the conformal calibration step. The resulting finite-sample guarantee applies to a structure-weighted pseudo-outcome, not directly to the true CATE. Under causal identification and overlap, conditional-mean nuisance stability, and score concentration on target-aligned valid adjustment strategies, the conditional mean of this target converges to the true CATE. In the implemented framework, candidate graphs are proposed by an LLM-derived edge prior, pruned by conditional-independence tests, and reweighted by Bayesian Information Criterion (BIC) [ 36 ] . This formulation also resolves a key practical tension. In finite samples, a semantic prior can regularize the graph search toward plausible adjustment sets. As the sample size increases, the data likelihood can dominate and the prior can wash out. The method is designed to exhibit exactly this behavior: the prior organizes finite-sample graph search while the final interval becomes increasingly data-driven when the likelihood is informative. We summarize the main contributions as follows: • Structure-weighted conformal inference. A conformal construction for treatment-effect intervals under graph uncertainty that aggregates graph-conditional doubly robust pseudo-outcomes through a posterior-weighted composite score. • Aggregate-before-calibrate scoring. A composite score that conformalizes the posterior-weighted target directly, avoiding the Jensen gap that arises when graph-specific conformity scores or intervals are averaged after calibration. • Graph-ensemble construction. A practical procedure combining LLM-derived edge proposals, conditional-independence pruning, and BIC reweighting, in which the prior acts as a proposal distribution rather than a source of guaranteed causal truth. • Finite-sample validity and asymptotic target consistency. Distribution-free finite-sample marginal coverage for the weighted pseudo-outcome (Theorem 1 ) and conditional-mean convergence of this target to the true CATE under causal identification, overlap, conditional-mean nuisance stability, and target-aligned score-concentration conditions (Corollary 2 ). • Empirical validation and boundary analysis. Across five benchmarks and 10 random seeds per dataset, CausalGuard attains mean coverage above the nominal 90% target for the directly evaluable target. Stress tests show that graph-aware adjustment suppresses invalid collider adjustment, while low-data diagnostics show when graph-aware conformalization is substantially tighter than graph-agnostic conformal DR. 2 Related Work Conformal inference for treatment effects. Conformal prediction provides finite-sample marginal coverage with minimal distributional assumptions [ 42 , 23 ] . Recent causal extensions include conformal intervals for counterfactuals and individualized treatment effects [ 24 , 1 ] , conformalized quantile regression [ 32 ] , covariate-shift adjustments [ 41 ] , and sensitivity analyses for hidden confounding [ 18 ] . These methods assume the adjustment set is fixed before calibration. Under graph uncertainty, both the pseudo-outcome and the conformity-score distribution depend on the graph. Running conformal calibration separately for each candidate graph and averaging afterward targets a different, typically wider object. CausalGuard instead aggregates graph-conditional pseudo-outcomes and bounds first, then calibrates the resulting composite score. Causal estimation with uncertain structure. Standard heterogeneous-effect estimators such as Double Machine Learning [ 4 ] and Causal Forests [ 43 ] achieve strong asymptotic performance when a valid adjustment set is known. Under graph misspecification, colliders or treatment descendants can be inadvertently included in the adjustment set, degrading finite-sample performance [ 30 ] . CausalGuard instead treats the adjustment set as uncertain and propagates that uncertainty through the interval construction. Related work on covariate and adjustment-set selection studies how to choose valid or efficient adjustment variables from graphical or statistical criteria [ 6 , 15 ] . That line of work typically returns a single selected adjustment strategy. Our focus is complementary: when several adjustment strategies remain plausible, we carry their uncertainty through doubly robust pseudo-outcomes and conformal calibration rather than collapsing it before inference. Causal discovery and LLM-derived priors. Classical discovery methods such as PC, GES, and continuous DAG optimization estimate a DAG or Markov equivalence class from observational data alone [ 40 , 5 , 47 ] . Recent work studies whether LLMs can contribute causal priors, edge orientations, or graph refinement heuristics [ 21 , 25 , 2 , 19 , 37 ] . These works primarily evaluate graph recovery or causal-reasoning accuracy. More broadly, uncertainty-aware and verification-guided LLM systems show that model confidence should be treated as task-dependent evidence rather than as an oracle signal [ 12 , 38 ] . CausalGuard uses LLM-derived edge probabilities more conservatively: they define a proposal distribution over plausible DAGs, and their value is assessed only through downstream interval estimation after BIC reweighting and conformal calibration. Model averaging and graph ensembles. Bayesian model averaging hedges against model uncertainty by integrating predictions over a posterior distribution on candidate models [ 28 , 17 ] . Related ideas appear in causal inference through Bayesian treatment-effect models and effect aggregation across equivalence classes [ 16 , 27 ] . These approaches typically provide posterior or asymptotic