Conditional Independence Estimates for the Generalized Nonparanormal

Ujas Shah [email protected], Manuel Lladser [email protected], Rebecca Morrison [email protected] · 2025

Read Conditional Independence Estimates for the Generalized Nonparanormal by Ujas Shah [email protected], Manuel Lladser [email protected], Rebecca Morrison [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11050.txt.

Introduction

Ujas Shah, Manuel Lladser, and Rebecca Morrison estimate which variables stand free of each other in a broad non-Gaussian family. Their paper is from two thousand twenty-five. For plain Gaussian data, the precision matrix tells which pairs are free once the rest are known. For skewed data, raw covariance does not carry that news.

They work with data made by bending each axis of a Gaussian by its own map, a family they call the generalized nonparanormal. The maps can be near any shape. Under set terms, the precision matrix still betrays the freedom graph. They give a fast method to read it back, and show it works on made-up and real data.

Catalog record

CREATORUjas Shah [email protected], Manuel Lladser [email protected], Rebecca Morrison [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-11050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Conditional Independence Estimates for the Generalized Nonparanormal Ujas Shah [email protected], Manuel Lladser [email protected], Rebecca Morrison [email protected] Abstract For general non-Gaussian distributions, the covariance and precision matrices do not encode the independence structure of the variables, as they do for the multivariate Gaussian. This paper builds on previous work to show that for a class of non-Gaussian distributions—those derived from diagonal transformations of a Gaussian—information about the conditional independence structure can still be inferred from the precision matrix, provided the data meet certain criteria, analogous to the Gaussian case. We call such transformations of the Gaussian as the generalized nonparanormal . The functions that define these transformations are, in a broad sense, arbitrary. We also provide a simple and computationally efficient algorithm that leverages this theory to recover conditional independence structure from the generalized nonparanormal data. The effectiveness of the proposed algorithm is demonstrated via synthetic experiments and applications to real-world data. Ujas Shah, Manuel Lladser and Rebecca Morrison † † heading: 00 0000 1- 6/25; Revised 0/00 0/00 00-0000 † † shortheadings: Conditional Independence Estimates for the Generalized Nonparanormal / Shah, Lladser and Morrison † † firstpage: 1 † † editor: My editor keywords probabilistic graphical models, graph learning, non-Gaussian distributions, nonparanormal distribution, sparse inverse covariance, marginal transformation 1 Introduction There are not many common parametric multivariate continuous distributions. Of course, the multivariate normal reigns supreme, and for good reasons: arguments based on the central limit theorem and the principle of maximum entropy often result in the Gaussian distribution. Others include the uniform hypercube, multivariate variations of the Student- t , and Gaussian mixtures; but these are all applicable in rather specific settings. Empirical distributions often do not fit in any of these groups, and it is of general interest to mathematically (parametrically) describe general non-Gaussian multivariate distributions. In this paper, we are concerned with the problem of inferring the independence structure of non-Gaussian distributions from data. A common way to do this is by using a Gaussian copula ( Nelsen 2007 ) or assuming that the data follows a nonparanormal distribution ( Liu et al. 2009 ) , which are distributions obtained by applying marginal monotone transformations to a Gaussian random vector. In the nonparanormal case, take the non-Gaussian vector \bm{Z}=(Z_{1},\dots,Z_{d}) and apply monotone marginal transformations g_{i} , so that \bm{X}=(g_{1}(Z_{1}),\dots,g_{d}(Z_{d}))\sim\mathcal{N}(\bm{0},\bm{\Sigma}_{\rho}) . In what follows, \rho denotes the distribution of this centered multivariate normal. (The mean of this distribution can be set arbitrarily, however, we assume without any loss of generality that it is \bm{0} .) In this way, the relationship between the original variables is captured by the (Gaussian) covariance matrix, \bm{\Sigma}_{\rho} , while each g_{i} can define an arbitrary marginal for X_{i} . This description conveniently captures marginal and conditional independence properties—a zero in the ij -th entry of \bm{\Sigma}_{\rho} means that variables i and j are marginally independent, while a zero in the ij -th entry of \bm{\Sigma}_{\rho}^{-1} means that the two are conditionally independent, given a separator set. In short: \bm{X} and \bm{Z} obey the same independence structure. If this structure is unknown, one must determine a graphical model from expert knowledge or directly from the data. To give just a few application examples, Dong et al. 2015 builds graphical models for signal processing, by learning graph Laplacians that capture the underlying topology of the data. In neuroscience, Smith et al. 2011 applies graphical models to fMRI data to estimate brain connectivity networks. In finance, Mastromatteo et al. 2012 constructs financial networks to estimate systemic risk, using graphical models to represent dependencies between financial institutions. As a final example, Yang et al. 2011 introduces methods for learning the structure of social networks by modeling people’s interests, leveraging graphical models for community detection. In learning scenarios for the nonparanormal distribution, the parameters \bm{\Sigma}_{\rho} and the transformation \bm{g}=(g_{1},\ldots,g_{d}) are estimated from data, thereby giving a complete semi-parametric specification of \bm{Z} ( Liu et al. 2009 ) . Note that doing so relies essentially on density estimation since the set of parameters (\bm{\Sigma}_{\rho},\bm{g}) fully specifies \bm{Z} . Other methods have been developed that do not require estimation of \bm{g} . A rank-based algorithm estimates the covariance matrix using monotone-transformation invariant measures like Spearman’s \rho and Kendall’s \tau , which is then inverted to get the precision matrix, \bm{\Gamma}=\bm{\Sigma}_{\rho}^{-1} ( Liu et al. 2012 ; Xue and Zou 2012 ) . Rank correlation measures have also been used to modify existing algorithms such as the Peter-Clark algorithm ( Spirtes et al. 2001 ) and the Grow-Shrink algorithm ( Margaritis 2003 ) to learn the independence structure of nonparanormal data ( Harris and Drton 2013 ; Musella et al. 2019 ) . For more general distributions, methods to recover the independence structure for exponential-type tailed and polynomial-type tailed distributions through linear programming have been proposed ( Cai et al. 2011 ) . Recent work has explored node regression combined with projection pursuit to construct graphical models for generalized multivariate skew-normal distributions ( Nghiem et al. 2022 ) . Another approach (by two of the co-authors) identifies conditional independence for arbitrary non-Gaussian distributions from the Hessian of the log density, but is (so far) computationally limited to rather small graphs ( Baptista et al. 2024 ; Morrison et al. 2017 ) . In this paper, we show that the marginal and conditional independence properties of a broad set of distributions can be estimated directly, bypassing density estimation , provided the distributions meet certain criteria. We consider functions f_{i} , and inspect the distribution of the random vector \bm{Z}=(f_{1}(X_{1}),\dots,f_{d}(X_{d})) , where \bm{X}\sim\rho . (In the context of the previous notation, g_{i}=f_{i}^{-1} when f_{i} is invertible, although this constraint is not required in our analysis.) We say that \bm{Z} is a generalized nonparanormal (GNPN) distribution and denote this distribution as \pi ; namely, \bm{Z}\sim\pi . This setup is illustrated with an example in Section 1.1 . This work is an extension on a previous paper by one of the co-authors ( Morrison et al. 2022 ) . That paper assumed that the functions f_{i} were odd, that each is the same, i.e., f_{i}=f for all i , and that f is smooth and has uniformly bounded derivatives at 0. More recently, these assumptions have been relaxed further allowing the functions to be even, odd, or neither, and each can be different and possibly discontinuous ( Morrison and Basor 2024 ) . The GNPN distribution can be viewed, as the name suggests, as a generalization of the nonparanormal, where the f_{i} are not restricted to being monotonic functions. 1.1 Example Consider a circle graph with eight nodes and precision matrix \bm{\Gamma}_{\rho}=\left(\begin{array}[]{cccccccc}1&\alpha&0&0&0&0&0&\alpha\\ \alpha&1&\alpha&0&0&0&0&0\\ 0&\alpha&1&\alpha&0&0&0&0\\ 0&0&\alpha&1&\alpha&0&0&0\\ 0&0&0&\alpha&1&\alpha&0&0\\ 0&0&0&0&\alpha&1&\alpha&0\\ 0&0&0&0&0&\alpha&1&\alpha\\ \alpha&0&0&0&0&0&\alpha&1\\ \end{array}\right). Let \alpha=1/22 . Then its associated covariance matrix, i.e., inverse (to 4 decimal places) is found to be \bm{\Sigma}_{\rho}=\left(\begin{array}[]{rrrrrrrr}1.0042&-0.0457&0.0021&-0.0001&0.0&-0.0001&0.0021&-0.0457\\ -0.0457&1.0042&-0.0457&0.0021&-0.0001&0.0&-0.0001&0.0021\\ 0.0021&-0.0457&1.0042&-0.0457&0.0021&-0.0001&0.0&-0.0001\\ -0.0001&0.0021&-0.0457&1.0042&-0.0457&0.0021&-0.0001&0.0\\ 0.0&-0.0001&0.0021&-0.0457&1.0042&-0.0457&0.0021&-0.0001\\ -0.0001&0.0&-0.0001&0.0021&-0.0457&1.0042&-0.0457&0.0021\\ 0.0021&-0.0001&0.0&-0.0001&0.0021&-0.0457&1.0042&-0.0457\\ -0.0457&0.0021&-0.0001&0.0&-0.0001&0.0021&-0.0457&1.0042\\ \end{array}\right). We transform centered Gaussian data created with the above covariance matrix; for simplicity, let f_{i}(x)=x^{3}\,\,\forall i . The resulting data have the following sample covariance matrix, computed from 100,000 samples: \bm{\hat{\Sigma}_{\pi}}=\left(\begin{array}[]{rrrrrrrr}15.3436&-0.4298&-0.0375&0.0065&0.0447&0.0172&0.0701&-0.3848\\ -0.4298&15.1577&-0.3992&0.0467&-0.032&-0.0693&0.0793&-0.019\\ -0.0375&-0.3992&15.1956&-0.4166&0.0131&0.0015&0.0561&0.0056\\ 0.0065&0.0467&-0.4166&15.3007&-0.3941&0.0032&0.0778&-0.0375\\ 0.0447&-0.032&0.0131&-0.3941&15.4689&-0.4228&0.0193&0.0167\\ 0.0172&-0.0693&0.0015&0.0032&-0.4228&15.5416&-0.3632&0.033\\ 0.0701&0.0793&0.0561&0.0778&0.0193&-0.3632&15.6811&-0.4076\\ -0.3848&-0.019&0.0056&-0.0375&0.0167&0.033&-0.4076&15.2842\\ \end{array}\right). We also computed the exact covariance matrix as described from the theory in sections 2 and 3 , which yielded the following: \bm{\Sigma}_{\pi}=\left(\begin{array}[]{rrrrrrrr}15&-0.4156&0.0189&-0.0009&0.0001&-0.0009&0.0189&-0.4156\\ -0.4156&15&-0.4156&0.0189&-0.0009&0.0001&-0.0009&0.0189\\ 0.0189&-0.4156&15&-0.4156&0.0189&-0.0009&0.0001&-0.0009\\ -0.0009&0.0189&-0.4156&15&-0.4156&0.0189&-0.0009&0.0001\\ 0.0001&-0.0009&0.0189&-0.4156&15&-0.4156&0.0189&-0.0009\\ -0.0009&0.0001&-0.0009&0.0189&-0.4156&15&-0.4156&0.0189\\ 0.0189&-0.0009&0.0001&-0.0009&0.0189&-0.4156&15&-0.4156\\

Read the complete text