Identifying Network Hubs with the Partial Correlation Graphical LASSO

Małgorzata Bogdan, Adam Chojecki, Ivan Hejný, Bartosz Kołodziejek, Jonas Wallin · 2025

Read Identifying Network Hubs with the Partial Correlation Graphical LASSO by Małgorzata Bogdan, Adam Chojecki, Ivan Hejný, Bartosz Kołodziejek, Jonas Wallin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12258.txt.

Introduction

Małgorzata Bogdan and co-authors wrote this 2025 statistics paper on learning networks whose links mean conditional dependence, and on finding their hubs. The standard tool, graphical LASSO, penalizes raw precision entries and so changes its answer when variables are rescaled. A newer variant penalizes partial correlations instead, the scale-free quantities that define the graph.

The team put that variant on firm ground. They state a scale-invariant version of the irrepresentability condition and prove it suffices for the method to recover the true graph consistently. The condition is strictly weaker than the one the older method needs, which explains why the new one shines on hub-structured graphs. Two efficient algorithms and an analysis of the underlying nonconvex problem, including when its solution is unique, complete the package.

Catalog record

CREATORMałgorzata Bogdan, Adam Chojecki, Ivan Hejný, Bartosz Kołodziejek, Jonas Wallin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE109 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12258

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Identifying Network Hubs with the Partial Correlation Graphical LASSO Thanks: For the purpose of Open Access, the authors have applied a CC-BY public copyright licence to any Author Accepted Manuscript (AAM) version arising from this submission. Małgorzata Bogdan, Adam Chojecki, Ivan Hejný, Bartosz Kołodziejek, Jonas Wallin Abstract . The Partial Correlation Graphical LASSO (PCGLASSO) offers a scale-invariant alternative to the standard GLASSO. This paper provides the first comprehensive treatment of the PCGLASSO estimator. We introduce a novel and highly efficient algorithm. Our central theoretical contribution is the first scale-invariant irrepresentability criterion for PCGLASSO, which guarantees consistent model selection. We prove this condition is significantly weaker than its GLASSO counterpart, providing the first theoretical justification for PCGLASSO’s superior empirical performance, especially in recovering networks with hub structures. Furthermore, we deliver the first analysis of the estimator’s non-convex solution landscape, establishing new conditions for global uniqueness and guaranteeing the consistency of all minimizers. 2020 Mathematics Subject Classification Primary 62H22; secondary 62H12, 62J07, 90C26. Keywords. 1. Introduction Estimating a sparse precision matrix is a cornerstone of modern high-dimensional statistics, providing a powerful tool for uncovering conditional independence structures in Gaussian graphical models. These models are widely applied in fields ranging from genomics to finance, where understanding the underlying network of relationships between variables is of paramount importance. The classical approach for this task is the Graphical LASSO (GLASSO), which has become a standard due to its computational tractability and theoretical guarantees Friedman et al. 2008 ; Yuan and Lin 2007 . The GLASSO estimator is defined as the solution to a convex optimization problem: (1.1) \displaystyle\hat{K}_{\mathrm{GLASSO}}=\argmin_{K\in\mathrm{S}_{++}}\left\{-\log\det(K)+\mathrm{tr}(\hat{\Sigma}K)+\lambda\|K\|_{1,\mathrm{off}}\right\}, where \hat{\Sigma} is the sample covariance matrix from n independent copies of a p -dimensional random vector X , \|K\|_{1,\mathrm{off}}=\sum_{i\neq j}|K_{ij}| is the \ell_{1} -penalty on the off-diagonal entries, and \lambda\geq 0 is a tuning parameter. Despite its success, the GLASSO suffers from a notable limitation: it is not scale-invariant. Because the penalty is applied to the raw entries of the precision matrix K , simply rescaling the variables can alter the estimated graph structure. This makes the results sensitive to data preprocessing choices, such as standardization. A more robust and often more interpretable approach is to enforce sparsity directly on the partial correlations, P(K)_{ij}=-\frac{K_{ij}}{\sqrt{K_{ii}K_{jj}}}, which are naturally normalized measures of conditional dependence. This motivates penalizing the likelihood based on the partial correlations: (1.2) \displaystyle\Argmin_{K\in\mathrm{S}_{++}}\left\{-\log\det(K)+\mathrm{tr}(\hat{\Sigma}K)+\lambda\|P(K)\|_{1,\mathrm{off}}\right\}. We note that penalizing the raw off - diagonal elements of K can work against the goal of attenuating strong conditional dependencies, because their magnitudes need not track those of the partial correlations. For example, K=\begin{pmatrix}1&1&2\\ 1&4&3\\ 2&3&25\end{pmatrix}\implies P(K)=\begin{pmatrix}1&-0.5&-0.4\\ -0.5&1&-0.3\\ -0.4&-0.3&1\end{pmatrix}. Here the ordering of magnitudes is reversed: K_{12}<K_{13}<K_{23}\quad\mbox{and}\quad|P(K)_{12}|>|P(K)_{13}|>|P(K)_{23}|. Thus shrinking K_{23} the most would suppress the weakest conditional dependence, achieving the opposite of the intended sparsity effect. However, directly penalizing the partial correlation matrix renders the problem non-convex in the precision matrix K . This paper focuses on a systematic study of an estimator based on this principle, known as the Partial Correlation Graphical LASSO (PCGLASSO). 1.1. Problem setup Let X=(X_{1},\ldots,X_{p})^{\top} be a zero-mean random vector with covariance matrix \Sigma^{\ast} and precision matrix K^{\ast}=(\Sigma^{\ast})^{-1} . Suppose we observe n independent copies (X^{(i)})_{i=1}^{n} of X and \hat{\Sigma} is the sample covariance matrix. Following Carter et al. 2024 , we leverage a natural factorization to handle the non-convex penalty in ( 1.2 ). Any positive definite matrix K admits a unique factorization K=DRD, where R is a positive definite matrix with unit diagonal entries and D is a diagonal matrix with positive entries. Here, R_{ij}=-P(K)_{ij} for i\neq j and D^{2}=\mathrm{diag}(K) is the diagonal matrix whose (i,i) entry is K_{ii} . Rewriting the problem ( 1.2 ) in terms of (R,D) makes the \ell_{1} -penalty convex in R , though it introduces a non-convex coupling \mathrm{tr}(\hat{\Sigma}DRD) between R and D in the likelihood term. We define the PCGLASSO estimator as \hat{K}_{\mathrm{PCG}}=\hat{D}\hat{R}\hat{D}, with (\hat{R},\hat{D}) obtained by solving (1.3) \displaystyle(\hat{R},\hat{D})\in\Argmin_{R,D}\Big\{-\log\det(DRD)+\mathrm{tr}(\hat{\Sigma}DRD)+\lambda\|R\|_{1,\mathrm{off}}+2\,\alpha\log\det(D)\Big\}. The optimization is over matrices R in the set \mathrm{S}_{++}^{(1)} of positive definite matrices with unit diagonal and over diagonal matrices D with positive diagonal entries. The parameters \lambda\geq 0 and \alpha<1 serve as the hyperparameters of the method. Note that compared to ( 1.2 ), we introduced a logarithmic penalty on the diagonal elements. Carter et al. 2024 recommend \alpha=4/n based on univariate MSE arguments, but here we treat \alpha as a free parameter. Finally, it is worth noting that problem ( 1.3 ) is not only the \ell_{1} -penalized Gaussian log-likelihood but also coincides with the minimization of the penalized log-determinant Bregman divergence Ravikumar et al. 2011 ; Zwiernik 2023 . Unlike ( 1.1 ), whose objective is convex (and coercive when \hat{\Sigma} has positive diagonals), ( 1.3 ) remains non-convex even at \lambda=\alpha=0 due to the mixed term \mathrm{tr}(\hat{\Sigma}DRD) . A key property of the PCGLASSO estimator defined by ( 1.3 ) is its scale invariance. An estimator \hat{K}(\hat{\Sigma}) is scale-invariant if \hat{K}(H\hat{\Sigma}H)=H^{-1}\hat{K}(\hat{\Sigma})H^{-1} for every diagonal matrix H with positive entries. The PCGLASSO estimator satisfies this property ( Carter et al. 2024 , Proposition 2) , which allows us to reformulate the problem entirely in terms of the sample correlation matrix \hat{C} , i.e., \hat{C}=H\hat{\Sigma}H\quad\text{with}\quad H=\mathrm{diag}(\hat{\Sigma})^{-1/2}. Henceforth we work with the equivalent formulation (1.4) \displaystyle(\hat{R},\hat{D})\in\Argmin_{R,D}\left\{-\log\det(R)-2(1-\alpha)\log\det(D)+\mathrm{tr}(\hat{C}DRD)+\lambda\|R\|_{1,\mathrm{off}}\right\}. Note that (\hat{R},\hat{D}) solves ( 1.4 ) if and only if (\hat{R},\mathrm{diag}(\hat{\Sigma})^{-1/2}\hat{D}) solves ( 1.3 ). Finally, let us note that the sparsity (the sign structure of \hat{R} ) of the PCGLASSO estimator depends solely on the sample correlation matrix \hat{C} , rather than the usual sample covariance \hat{\Sigma} . The variability of the correlation entries is not inflated by unknown marginal scales and for any fixed pair (i,j) , the asymptotic variance (as n\to\infty ) of the relative error \hat{C}_{ij}/C_{ij}^{\ast} is always smaller than that of \hat{\Sigma}_{ij}/\Sigma_{ij}^{\ast} : assuming that X\sim\mathcal{N}_{p}(0,\Sigma^{\ast}) , we have \mathrm{Var}\left(\frac{\hat{C}_{ij}}{C_{ij}^{\ast}}\right)=\frac{1}{n}\frac{(1-(C_{ij}^{\ast})^{2})^{2}}{(C_{ij}^{\ast})^{2}}\leq\frac{1}{n}\left(1+\frac{1}{(C_{ij}^{\ast})^{2}}\right)=\mathrm{Var}\left(\frac{\hat{\Sigma}_{ij}}{\Sigma^{\ast}_{ij}}\right). Therefore, the standardization acts as an intrinsic variance-reduction step. Consequently, any optimization routine whose sparsity pattern depends only on \hat{C} can converge more rapidly, both statistically (smaller noise to overcome) and computationally (a tighter search region), than its covariance-based analogue, such as the classical unstandardized GLASSO. 1.2. Literature review Estimating a sparse precision matrix is a cornerstone of statistical learning, particularly for uncovering conditional independence structures in Gaussian graphical models. The seminal work on the GLASSO provided a tractable convex framework for this task by penalizing the Gaussian log-likelihood with an \ell_{1} -norm on the precision matrix entries Friedman et al. 2008 ; Yuan and Lin 2007 . Despite its widespread adoption, a well-known limitation of the GLASSO is its lack of scale invariance. Since the penalty is applied to the raw precision matrix entries, rescaling variables can alter the estimated graph structure, making the results dependent on data preprocessing choices such as standardization. This limitation motivated a rich line of research focused on estimators that are either inherently scale-invariant or directly target the partial correlations, which are naturally normalized measures of conditional dependence. Early work in this direction includes the Sparse Permutation Invariant Covariance Estimation (SPICE) method, which achieves scale invariance by penalizing only the off-diagonal elements of the precision matrix Rothman et al. 2008 . Another major family of methods reframes the problem as a series of sparse regressions. The neighborhood selection framework of Meinshausen and Bühlmann 2006 and the

Read the complete text