Nonparametric learning of heterogeneous graphical model on network-linked data

Yuwen Wang, Changyu Liu, Xin He, Junhui Wang, [10pt] Department of StatisticsChinese University of Hong Kong · 2025

Read Nonparametric learning of heterogeneous graphical model on network-linked data by Yuwen Wang, Changyu Liu, Xin He, Junhui Wang, [10pt] Department of StatisticsChinese University of Hong Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01473.txt.

Introduction

Data linked by a network break the tidy assumption that every observation is alike and alone. Yuwen Wang and co-authors propose in 2025 a nonparametric graphical model for such data, letting the web of conditional ties differ across the network without forcing any distribution shape. Their method fuses network embedding with graph estimation, then turns the learning task into a finite system of linear equations inside a kernel space.

Theory backs the method with consistency and exact structure recovery guarantees. Simulations and a real run on the statistician coauthorship network show it working where classic graphical models strain.

Catalog record

CREATORYuwen Wang, Changyu Liu, Xin He, Junhui Wang, [10pt] Department of StatisticsChinese University of Hong Kong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01473

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonparametric learning of heterogeneous graphical model on network-linked data Yuwen Wang, Changyu Liu, Xin He, Junhui Wang, [10pt] Department of StatisticsChinese University of Hong Kong Abstract Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex datasets such as network-linked data. This paper proposes a nonparametric graphical model that addresses these limitations by accommodating heterogeneous graph structures without imposing any specific distributional assumptions. The proposed estimation method effectively integrates network embedding with nonparametric graphical model estimation. It further transforms the graph learning task into solving a finite-dimensional linear equation system by leveraging the properties of vector-valued reproducing kernel Hilbert space. Moreover, theoretical guarantees are established for the proposed method in terms of the estimation consistency and exact recovery of the heterogeneous graph structures. Its effectiveness is also demonstrated through a variety of simulated examples and a real application to the statistician coauthorship dataset. Keywords: Conditional independence, Gaussian graphical model, heterogeneous data, network model, score matching 1 Introduction Graphical models provide a powerful framework for modeling conditional independence structures in multivariate data and have attracted increasing attention in both academia and industry [ Lauritzen 1996 ; Meinshausen and Bühlmann 2006 ; Yuan and Lin 2007 ; Friedman et al. 2008 ; Liu et al. 2009 ; Li et al. 2020 ] . Although success has been widely reported, most existing graphical models heavily rely on the assumption of independent and identically distributed observations, and thus are not applicable to analyze datasets with heterogeneous distribution or dependent samples, such as network-linked data. Network-linked data has been commonly encountered in modern real-world applications, where the network connects observations that may exhibit dependence structure and heterogeneous distributions. To address the non-tensor structure in such datasets, various statistical models for network-linked data have been developed under specific scenarios, such as classification [ Tang et al. 2013 ] or regression [ Li et al. 2019 ; Le and Li 2022 ; Zhang et al. 2022 ] . In particular, Li et al. 2020 introduced a network-linked Gaussian graphical model that accommodates heterogeneous mean vectors while assuming a common graph structure across all nodes. Another related line of research is the time-varying Gaussian graphical model [ Zhou et al. 2010 ; Kolar and Xing 2011 ; Lu et al. 2018 ] , where the timeline can be regarded as a simple chain network and the graph structures are allowed to evolve over each time node. It is important to note that most of the aforementioned graphical models are built upon the Gaussian assumption, and the graph structure is then fully captured by its precision matrix. Although simple in estimation, verifying the Gaussian assumption can be challenging in many medium-scale real applications. This paper proposes an efficient method to learn a nonparametric graphical model that accommodates heterogeneous graph structures over each node without imposing any restrictive distributional assumptions. The proposed method estimates the node-wise heterogeneous graph models as functions of the embedding vectors of the newtork in a nonparametric fashion, where the nonparametric graphical model is motivated by the equivalence between conditional independence and the zero pattern of the second-order derivative of the log density. We then estimate the derivative function via score matching [ Hyvärinen 2005 ; Zhou et al. 2020 ] in a vector-valued reproducing kernel Hilbert space (RKHS; Kimeldorf and Wahba 1971 ) induced by a new decomposable kernel function. By leveraging the representer theorem and the derivative reproducing property, the proposed method leads to a closed-form solution, where the representer coefficients are derived by solving a linear equation system, enabling efficient estimation of large-scale heterogeneous graphical models. We also conduct rigorous theoretical analysis that establishes the consistency of the proposed graphical model in exactly recovering the heterogeneous graph structures without imposing any explicit distributional assumptions. The analysis involves a careful study of the vector-valued RKHS and requires some novel theoretical treatments on the Hilbert-Schmidt operators. We also provide some theoretical examples, to showcase that all required assumptions are verified and the non-asymptotic convergence rate of the proposed method can be established. The effectiveness of the proposed method is further supported by numerical comparison against some existing competitors in several simulated examples as well as a real application to the statistician coauthorship dataset. The rest of the paper is organized as follows. In Section 2 , we present the nonparametric heterogeneous graphical model on network-linked data. Section 3 introduces an efficient two-step learning algorithm. Theoretical guarantees, including estimation consistency and exact graph recovery for the proposed graphical model, are presented in Section 4 . Section 5 presents simulation studies and a real application to the statistician coauthorship dataset. Section 6 gives some final concluding remarks. Proofs of the main theoretical results are included in the Appendix, and other additional technical details, including auxiliary Lemmas S1–S11, are available in the online Supplementary Material. Notations. We denote [k]=\{1,\dots,k\} for any positive integer k . For a vector \mathbf{a} , the p -norm is denoted as \|\mathbf{a}\|_{p} . For a matrix \mathbf{M}=(m_{ij}) , the max norm is \|\mathbf{M}\|_{\max}=\sup_{i,j}|m_{ij}| , the Frobenius norm is \|\mathbf{M}\|_{F}=\big(\sum_{i,j}m_{ij}^{2}\big)^{1/2} , the spectral norm is \|\mathbf{M}\|_{2}=\sup_{\|\mathbf{a}\|_{2}=1}\|\mathbf{M}\mathbf{a}\|_{2} , and the (2,\infty) -norm is \|\mathbf{M}\|_{2,\infty}=\max_{i}\|\mathbf{M}_{i,\cdot}\|_{2} , with \mathbf{M}_{i,\cdot} denoting the i -th row of \mathbf{M} . For two sequences of nonnegative numbers \{a_{n}\}_{n\geq 1} and \{b_{n}\}_{n\geq 1} , we write a_{n}\lesssim b_{n} to indicate that there exists a constant C>0 such that a_{n}\leq Cb_{n} for sufficiently large n . We denote by a_{n}\asymp b_{n} when a_{n}\lesssim b_{n} and b_{n}\gtrsim a_{n} . For an operator C , we denote \overline{\operatorname{Ran}(C)} as the closure of the range of C . For two Hilbert spaces \mathcal{H}_{1} and \mathcal{H}_{2} , with inner products \langle\cdot,\cdot\rangle_{{\cal H}_{1}} and \langle\cdot,\cdot\rangle_{{\cal H}_{2}} respectively, we denote their tensor product space as \mathcal{H}_{1}\otimes\mathcal{H}_{2} , which is the completion of all finite linear combinations of elementary tensors \{\psi\otimes\phi:\psi\in\mathcal{H}_{1},\phi\in\mathcal{H}_{2}\} , with the inner product defined as \langle\psi_{1}\otimes\phi_{1},\psi_{2}\otimes\phi_{2}\rangle=\langle\psi_{1},\psi_{2}\rangle_{\mathcal{H}_{1}}\cdot\langle\phi_{1},\phi_{2}\rangle_{\mathcal{H}_{2}} . Note that \mathcal{H}_{1}\otimes\mathcal{H}_{2} is also a Hilbert space. 2 Network-linked heterogeneous graphical model Suppose a training sample \{\mathbf{x}_{i}\}_{i=1}^{n} is observed, each with a different probability density function p_{0}^{(i)}(\mathbf{x}) on a compact subset \mathcal{X}_{d}\subseteq\mathbb{R}^{d} . The conditional independence structure among the variables in \mathbf{X}_{i}=(X_{i1},\ldots,X_{id})^{\top} can be depicted as \mathcal{G}^{(i)}=(\mathcal{V},\mathcal{E}^{(i)}) , where \mathcal{V}=[d] represents the common node set and \mathcal{E}^{(i)}\subseteq\mathcal{V}\times\mathcal{V} denotes edge set that may vary from node to node. Specifically, for any given node i\in[n] , \displaystyle(j,l)\notin{\mathcal{E}}^{(i)}\ \ \Longleftrightarrow\ \ X_{ij}\perp\mkern-9.5mu\perp X_{il}\ |\ \mathbf{X}_{i,-\{j,l\}}, (1) where \mathbf{X}_{i,-\{j,l\}}=\big\{X_{ik}:k\in{\cal V}\backslash\{j,l\}\big\} consists of all the random variables in \mathbf{X}_{i} except for X_{ij} and X_{il} . Suppose further that \{\mathbf{x}_{i}\}_{i=1}^{n} are linked via an undirected network with an adjacency matrix \mathbf{A}=\big(A_{ij}\big)_{i,j=1}^{n}\in\{0,1\}^{n\times n} , where \mathbf{P}=\big(p_{ij}\big)_{i,j=1}^{n}\in(0,1)^{n\times n} with p_{ij}=P\left(A_{ij}=1\right) . To leverage the network structure, we introduce a latent network embedding space, where each node i is embedded with a latent vector \bm{\beta}_{i}\in\mathcal{X}_{m}\subseteq\mathbb{R}^{m} , with \mathcal{X}_{m} being a compact subset in \mathbb{R}^{m} . We consider an integrated model, \sigma(p_{ij})=g(\bm{\beta}_{i},\bm{\beta}_{j})\;\text{ and }\;p_{0}^{(i)}(\mathbf{x})=p_{0}\left(\mathbf{x};\bm{\beta}_{i}\right), (2) for any i,j\in[n] , where \sigma(\cdot) is a link function, and g:\mathcal{X}_{m}\times\mathcal{X}_{m}\rightarrow\mathbb{R} . This model renders both the latent structure of p_{ij} and the smoothness of p_{0}^{(i)}(\mathbf{x}) via the latent network embedding vectors \mathbf{B}=(\bm{\beta}_{1},\dots,\bm{\beta}_{n})^{\top} . The structure information about each node is essentially captured in

Read the complete text