Deriving Complete Constraints in Hidden Variable Models
Michael C. Sachs, Erin E. Gabriel, Robin J. Evans, Arvid Sjölander · 2026
Read Deriving Complete Constraints in Hidden Variable Models by Michael C. Sachs, Erin E. Gabriel, Robin J. Evans, Arvid Sjölander (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11242.txt.
Introduction
Michael Sachs, Erin Gabriel, Robin Evans, and Arvid Sjolander study hidden variable models. Their 2026 preprint asks what such models force on seen data. A hidden variable is one the study can never observe. Graphs with hidden nodes are common in causal work.
Such graphs can force more than simple independence facts. The forced limits on seen data can be complex in form. Those limits can test parts of the model itself. Parts that looked untestable gain a test through the seen limits. The limits can also guide how data are used in fits. That guidance can make estimates sharper and more efficient. The work gives ways to derive the full set of such limits.
Catalog record
| CREATOR | Michael C. Sachs, Erin E. Gabriel, Robin J. Evans, Arvid Sjölander |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-11242
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deriving Complete Constraints in Hidden Variable Models Michael C. Sachs, Erin E. Gabriel, Robin J. Evans, Arvid Sjölander Abstract Hidden variable graphical models can sometimes imply constraints on the observable distribution that are more complex than simple conditional independence relations. These observable constraints can falsify assumptions of the model that would otherwise be untestable due to the unobserved variables and can be used to constrain estimation procedures to improve statistical efficiency. Knowing the complete set of observable constraints is thus ideal, but this can be difficult to determine in many settings. In models with categorical observed variables and a joint distribution that is completely characterized by linear relations to the unobservable response function variables, we develop a systematic method for deriving the complete set of observable constraints. We illustrate the method in several new settings, including ones that imply both inequality and equality constraints. 1 Introduction The assumption of a structural model with hidden variables can rule out particular joint distributions both due to observable conditional independence relations, but also more complex observable conditions, which may not be clear from inspection of the causal model alone. These observable constraints can be used to falsify a structural model in settings where the data contradict these constraints. The instrumental inequalities first discussed in 15 for the all binary instrumental variable (IV) setting are the most well-known example of these more complex constraints in the form of inequalities, while the “Verma” constraints ( 27 ) are a well-known example of observable and thus falsifiable equality constraints representing a more general notion of conditional independence. In the general IV setting, 3 derived inequality constraints showing that, in cases with an IV with more than two categories, there are more observable constraints beyond the binary IV constraint set. Within the specific setting of all discrete observed variables within the classical trivariate IV setting he developed a method for deriving constraints on the observed data distribution implied by the causal assumptions and proved that these are the “sufficient” set of constraints. We will use the term “complete” to refer to what 3 called sufficient, but the meaning remains the same, i.e. all observable and therefore falsifiable constraints implied by a structural model. The 3 method is what 8 called the “computationally intensive linear programming technique”. As pointed out by 8 , complete constraints are difficult to derive without using such techniques or algebraic variable elimination algorithms, e.g., Fourier-Motzkin elimination, which become infeasible for moderately sized state spaces. Although other attempts have been made, such as 13 , the derived constraints are not complete. This is also true for the nested Markov characterization which, by construction, only involves equality constraints ( 6 ; 21 ; 27 ; 18 ) ; see further in for more details of this. We conceptually extend the method of 3 beyond the IV setting, which due to increased computational power is now feasible in many more settings. We prove that within the class of models that we refer to as “linear”, as defined in 5 , our method provides the complete set of observable constraints. Linear here refers to settings with categorical observed variables and a joint distribution that is completely characterized by linear relations to the unobservable response function variables ( 2 ; 20 ) . We also show that for the class of models for which our method provides complete constraints, the fully characterized joint distributions are a subclass of the distributions characterized by the nested Markov model in the same setting. In addition, we show that the proposed method can be used outside the “linear” class to derive at least some of the constraints. We illustrate our method in several examples, providing, to our knowledge, novel constraints. All proofs are in the Appendix and software implementing the method is publicly available on GitHub at https://github.com/sachsmc/meraconstraints . 2 Notation and Preliminaries 2.1 Notation Let \mathcal{G}(\boldsymbol{W},\boldsymbol{U}) be a hidden variables directed acyclic graph (DAG) representing a nonparametric structural equations model (NPSEM) ( 16 ) , over variables \boldsymbol{V}=\boldsymbol{W}\cup\boldsymbol{U} where \boldsymbol{U} are unobserved and \boldsymbol{W} are observed. We assume that all variables in \boldsymbol{W} are discrete and finite, but no assumptions are made about \boldsymbol{U} . We will write \boldsymbol{W}_{i} (or some other index) to denote a subset of \boldsymbol{W} , and W_{i} a single element of \boldsymbol{W} . Let |\boldsymbol{W}| denote the cardinality of the set \boldsymbol{W} , and when used for a single variable, for example |W_{i}| , let it denote the number of possible values that variable W_{i} can take, i.e., the cardinality of its domain. Let \Paobs(\boldsymbol{W}_{i}) denote the union of the sets of observed parents of each variable in the set \boldsymbol{W}_{i} and \Pa(\boldsymbol{W}_{i}) denote the union of the sets of all, observed or unobserved, parents of each variable in the set \boldsymbol{W}_{i} . Let \Anobs(\boldsymbol{W}_{i}) denote the union of the sets of observed ancestors of each variable in \boldsymbol{W}_{i} , where, as in 6 , W_{2} is an ancestor of W_{1} if there is a sequence of directed edges W_{2}\rightarrow\cdots\rightarrow W_{1} , and by definition, we include W_{1} itself in the set of ancestors. Let \Chobs(\boldsymbol{W}_{i}) be the union of the sets of observed children of variables in \boldsymbol{W}_{i} . 2.2 Settings Our goal is to characterize the distribution {\mathrm{P}}(\boldsymbol{W}) , known as the marginal model (because it is marginal with respect to \boldsymbol{U} ), in terms of constraints implied by the NPSEM for (\boldsymbol{W},\boldsymbol{U}) . Following 9 , Section 3.2, we can restrict our attention to a smaller class of hidden variables DAGs that satisfy the following two conditions. In particular, it suffices to consider DAGs where none of the unobserved variables have parents, and where all of the unobserved variables have at least two observed children. Condition 1 All unobserved variables are exogenous, i.e., \Pa(U_{i})=\emptyset for all U_{i}\in\boldsymbol{U} . Condition 2 The child set of each unobserved variable correspond to a distinct set of observed vertices of at least size 2. That is, for each U_{i}\in\boldsymbol{U} , |\Chobs(U_{i})|\geq 2 , \Chobs(U_{i})\subseteq\boldsymbol{W}_{i} , and there is no U_{j}\in\boldsymbol{U} such that \Chobs(U_{i})\subseteq\Chobs(U_{j}) . By Lemmas 1–3 of 9 1 1 1 Here we use the references to the published version of these comments, rather than the arXiv version. The arXiv versions are Lemmas 3.7–3.9. , DAGs where these conditions do not hold can be transformed to DAGs where they do hold without changing the implied marginal model. Briefly, the exogenization process replaces sequences of the form V_{1}\rightarrow U_{1}\rightarrow W_{1} by V_{1}\rightarrow W_{1} without changing the marginal model, where V_{1} could be observed or unobserved. Following exogenization, any unobserved variable U_{1} whose child set is a subset of another unobserved variable U_{2} can be absorbed into a common unobserved variable with child set equal to the union of child sets of U_{1} and U_{2} . Examples of these transformations are given in the Appendix. Definition 1 Let \mathcal{G}(\boldsymbol{W},\boldsymbol{U}) be a hidden variables DAG that by construction obeys Conditions 1 and 2 . Remove all edges that do not originate from variables in \boldsymbol{U} . The sets of variables in \boldsymbol{W} that remain connected form a partition of \boldsymbol{W} called districts . Denote \mathcal{D}(\mathcal{G})=\{D_{1},\ldots,D_{k}\} the set of districts of \mathcal{G} . This same concept is called a c-component