Tagged for Direction: Pinning Down Causal Edge Directions with Precision
Florian Peter Busch, Moritz Willig, Florian Guldan, Kristian Kersting, Devendra Singh Dhami, [0.5em] Computer Science Department, Technical University of Darmstadt · 2025
Read Tagged for Direction: Pinning Down Causal Edge Directions with Precision by Florian Peter Busch, Moritz Willig, Florian Guldan, Kristian Kersting, Devendra Singh Dhami, [0.5em] Computer Science Department, Technical University of Darmstadt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19459.txt.
Introduction
Florian Peter Busch and colleagues propose tag-based causal discovery to pin down edge directions. Their 2025 arXiv paper addresses a limit of data-only methods. Data alone can narrow causal graphs only to an equivalence class. Many edge directions stay unresolved inside that class. Experts or language models can help, but both make mistakes.
Tags give variables plain semantic labels from available sources. The Tags for DAGs method learns patterns from structures data can identify. Those patterns then orient edges that data left open. Direction comes from data itself rather than fallible outside claims. Labels supply meaning without dictating the causal answer. Tests check whether tags recover true directions reliably. The approach aims to widen causal discovery in expert-scarce fields.
Catalog record
| CREATOR | Florian Peter Busch, Moritz Willig, Florian Guldan, Kristian Kersting, Devendra Singh Dhami, [0.5em] Computer Science Department, Technical University of Darmstadt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 109 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-19459
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tagged for Direction: Pinning Down Causal Edge Directions with Precision Florian Peter Busch, Moritz Willig, Florian Guldan, Kristian Kersting, Devendra Singh Dhami, [0.5em] Computer Science Department, Technical University of Darmstadt Abstract Not every causal relation between variables is equal, and this can be leveraged for the task of causal discovery. Recent research shows that pairs of variables with particular type assignments induce a preference on the causal direction of other pairs of variables with the same type. Although useful, this assignment of a specific type to a variable can be tricky in practice. We propose a tag-based causal discovery approach where multiple tags are assigned to each variable in a causal graph. Existing causal discovery approaches are first applied to direct some edges, which are then used to determine edge relations between tags. Then, these edge relations are used to direct the undirected edges. Doing so improves upon purely type-based relations, where the assumption of type consistency lacks robustness and flexibility due to being restricted to single types for each variable. Our experimental evaluations show that this boosts causal discovery and that these high-level tag relations fit common knowledge. 1 Introduction Figure 1 : Tags Inform About Causal Relations: We predict the causal direction of undirected edges by taking tags of variables into account. Background knowledge on how tags relate to each other helps predict edge directions. The recovery of causal relations from data has been a long-standing area of research interest [ Guo et al. 2020 , Schölkopf et al. 2021 , Schölkopf 2022 ] . Over the years, several methods with varying assumptions –among others, assumptions on the types of relations and noise [ Hoyer et al. 2008 , Mooij et al. 2011 ] , availability of interventional data [ Zečević et al. 2021 ] , and recurring effects over time [ Bouchattaoui et al. 2024 ] – have been proposed. With the recent emergence of large language models (LLMs), causal discovery has been opened up to incorporate ubiquitous external knowledge that was previously hard to provide in practice. With arguments for and against the theoretical limitations of performing correct causal discovery [ Keshmirian et al. 2024 , Lampinen et al. 2024 , Joshi et al. 2024 , Chi et al. 2024 ] , LLMs have been found to rather struggle in practice when being tasked to perform causal inference or discovery [ Zhiheng et al. 2022 , Zečević et al. 2023 , Kıcıman et al. 2023 ] . Recent research has therefore turned to treating LLMs as ‘advisory models’ with noisy predictions while still backing up their proposed relations with the actual data [ Brouillard et al. 2022 , Wang et al. 2024 ] . When reasoning over the causal relations that are present in some scenario, humans do not only consider the pure numbers but often also leverage meta-information about the types of variables and the assumed properties and biases attached to them [ Bonawitz et al. 2010 , Meltzoff 2007 , Bailey et al. 2024 ] . While such assumptions on meta-information on variables have been successfully leveraged in causal predictions [ Peters et al. 2016 , Gamella and Heinze-Deml 2020 ] , a more general way of binding such biases about edge directions to the types of variables was proposed by Brouillard et al. 2022 . Their type consistency assumption states that pairs of variables with particular type assignments induce a bias on the causal direction of other (possibly still undirected) pairs of variables with the same type. Type consistency, therefore, considers how different types relate to each other from a high-level perspective and generalizes \text{exogenous}{\rightarrow}\text{endogenous} relations. While typing creates a useful tool for incorporating common-sense knowledge into the causal discovery process, there might be a general debate about whether any variable does inherently entail a specific type (e.g., the type of ‘exogenous’ variable is a subjective/contextual assignment), and whether this particular type does induce an informative prior in practice, making an assignment of a specific tag type tricky. To this end, we propose tags , which are more flexible and encode more information. We aim to improve the typing causality approach in two different ways: (1) we go beyond the strict framework of single types per variable and instead employ a tagging approach where each variable can be assigned multiple tags. This not only can make assigning information easier and more flexible since tags do not need to be mutually exclusive. It can also provide more information if multiple different tags are used. (2) In the typing approach, if the type consistency is violated, an incorrect graph will be returned. We allow for more uncertainty where some inconsistencies of causal relations between tags can be overruled by other tags, resulting in a more flexible approach (Fig. 1 ). Still, our approach is data first, using tagging as a heuristic involving meta-information about variables only when necessary. Contributions. (1) We introduce an approachfor causal discovery leveraging tagging information where tags provide information about edge direction. (2) We show how LLMs can be leveraged as stand-in experts to infer tags that improve the performance of existing algorithms. (3) We bridge the gap between individual edge predictions that do not inform each other and fully typed discovery. Our code is made available at https://github.com/olfub/tagged_for_direction . Figure 2 : Tag-Supported Causal Discovery. The figure illustrates the tagging-based causal discovery described in this paper: First, a causal discovery algorithm such as PC or GES is used to obtain a CPDAG. Variables are tagged with semantically meaningful tags, for example, by using an LLM. Lastly, tag relations on the CPDAG are used to predict the direction of undirected edges. 2 Background and Related Work Causal Discovery. A causal graph \mathcal{G} is an acyclic directed graph (DAG) that represents the structure of cause-effect relations over an indexed set of variables \CVarDomains [ Spirtes et al. 2000 , Pearl 2009 ] . For every cause-effect relation between variables X_{i},X_{j}\in\CVarDomains , individual edges (X_{i},X_{j})\in\CVarDomains\times\CVarDomains in the graph point from the effect X_{i} to the cause X_{j} . Causal discovery is concerned with identifying the underlying causal graph from data [ Peters et al. 2017 ] . Even when disregarding the presence of hidden confounders, causal models can often only be discovered up to Markov equivalence [ Verma and Pearl 2022 , Verma and Pearl 1992 ] from observational data without further assumptions. Completed partially directed acyclic graphs (CPDAGs) comprise all Markov equivalent DAGs that are admissible under the given data but leave some edges undirected [ Andersson et al. 1997 ] . The approach in this paper aims to refine CPDAGs in an attempt to further direct remaining undirected edges. A primary class of causal discovery methods is constraint-based algorithms, which utilize independence tests to recover the graph skeleton. We will rely on the well-known PC algorithm [ Spirtes and Glymour 1991 ] , which performs skeleton and immorality discovery followed by Meek rules [ Meek 1995 ] . Another primary class are score-based algorithms that find the best graph by maximizing a particular scoring function. A common representative of this class of methods is greedy equivalence search (GES), which greedily adds and removes edges, starting from an empty graph [ Chickering