An integrated method for clustering and association network inference Journal: Computational statistics and data analysis
Jeanne Tous, Julien Chiquet · 2025
Read An integrated method for clustering and association network inference Journal: Computational statistics and data analysis by Jeanne Tous, Julien Chiquet (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22467.txt.
Introduction
Networks of who depends on whom, among genes or species, are usually read as flat webs, yet the entities fall into natural groups. Jeanne Tous and Julien Chiquet build the groups into the model itself in 2025 with the Normal-Block model. Variables are clustered first in the mathematics, and the network is then drawn between clusters, smaller and easier to read.
Extra penalties prune false edges, and a zero inflated variant absorbs the quirks of real count data. Two fitting routes are offered, one quick and one rigorous, the second learning clusters and network together. Tests span simulated webs, protein data, and word counts on web pages. The authors supply a public software package for the method.
Catalog record
| CREATOR | Jeanne Tous, Julien Chiquet |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22467
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An integrated method for clustering and association network inference Journal: Computational statistics and data analysis Jeanne Tous, Julien Chiquet Abstract We consider high dimensional Gaussian graphical models inference. These models provide a rigorous framework to describe a network of statistical dependencies between entities, such as genes in genomic regulation studies or species in ecology. Penalized methods, including the standard Graphical-Lasso, are well-known approaches to infer the parameters of these models. As the number of variables in the model (of entities in the network) grow, the network inference and interpretation become more complex. We propose Normal-Block, a new model that clusters variables and consider a network at the cluster level. Normal-Block both adds structure to the network and reduces its size. We build on Graphical-Lasso to add a penalty on the network’s edges and limit the detection of spurious dependencies, we also propose a zero-inflated version of the model to account for real-world data properties. For the inference procedure, we propose a direct heuristic method and another more rigorous one that simultaneously infers the clustering of variables and the association network between clusters, using a penalized variational Expectation-Maximization approach. An implementation of the model in R, in a package called normalblockr , is available on github ( https://github.com/jeannetous/normalblockr ). We present the results in terms of clustering and network inference using both simulated data and various types of real-world data (proteomics, words occurrences on webpages, and microbiota distribution). 1 Introduction In statistics, association networks commonly refer to networks used to describe dependency structures between entities. These entities are represented as nodes, and an edge drawn between two nodes indicates a dependency, whose precise meaning is context-dependent. They can be used in psychological science ( Borsboom et al. 2021 ) or to represent regulation systems in genomics ( Fiers et al. 2018 ; Lingjærde et al. 2021 ) , bacterial associations in biology ( Loftus et al. 2021 ) or species associations in ecology ( Ohlmann et al. 2018 ) . They can be both very informative and complex to analyse as the number of nodes and edges they are made of grows. Undirected graphical models ( Lauritzen 1996 ; Koller et al. 2007 ; Whittaker 2009 ) are a convenient and rigorous class of models to represent such networks. In this framework, two nodes are joined by an edge if and only if the random variables they represent are conditionally dependent, given all other nodes of the network. Gaussian graphical models (GGM) enter into this framework. They consider a multivariate Gaussian vector so that partial correlations, and thus the association network, are given by the vectors’ precision matrix (the inverse of the variance-covariance matrix). Therefore, the network is described by the model’s precision matrix, and its structure corresponds to the support of that matrix. In practice, a GGM’s parameters are typically not directly observed. Instead, they need to be estimated from multiple observations of the multivariate Gaussian vector the model describes. Methods have been developed to infer a sparse network from such observations, so as to select the most meaningful edges in the network. A first category of methods consists in multiple testing, to test the presence of each edge individually ( Drton and Perlman 2007 ) . The most widespread approaches are penalized methods ( Yuan and Lin 2007 ; Banerjee et al. 2008 ) : they consist in applying a penalty, often an \ell_{1} penalty, to the non-diagonal elements of the precision matrix. This leads some of the non-diagonal terms of the precision matrix to be estimated as zero, which translates into the absence of an edge in the graph. This method thus allows to avoid detecting spurious associations (that is, unestablished dependencies). Graphical-Lasso ( Friedman et al. 2008 ) is the most popular implementation of the \ell_{1} -penalized approach. Methods with different penalties also exist ( Chiong and Moon 2018 ) as well as more recent approaches that make use of neural networks ( Belilovsky et al. 2017 ) but Graphical-Lasso remains the main reference for inference of sparse networks in GGM. These approaches can also be extended to non-Gaussian data ( Chiquet et al. 2019 ; Liang 2023 ) but in this paper, we will stick to the Gaussian framework. As the number of analysed entities grow, the resulting networks become increasingly hard to infer, requiring more data. Large networks are also more complex to analyse both from a computational point of view and for the interpretation of the results. Metrics exist to aggregate information over the whole network such as connectance, nestedness or associations strength ( Soares et al. 2017 ; Lau et al. 2017 ) . However, such metrics offer very low-grain analysis compared to the complexity of the initial objects they are extracted from. Moreover, they only offer a posteriori solutions for the network analysis but they do not reduce the computational cost that comes with Graphical-Lasso inference ( Mazumder and Hastie 2012 ) . Nor do they address the fact, that Graphical-Lasso does not make any a priori hypothesis on the network structure, even though real networks are usually not Erdös-Rényi graphs, that is edges do not all have the same probability to appear in the network. In order to overcome the computational cost of network inference, Meinshausen and Bühlmann 2006 proposed to split the inference into several sub-tasks, using Lasso to infer the neighbourhood of each node in the graph. However, it does not retrieve the variables’ individual variance so that one cannot use it to completely retrieve the GGM parameters. Tan et al. 2015 consider Graphical-Lasso as a two-step process – inference of connected components within the graph, and maximization of a penalized log-likelihood on each connected component – and build on this view to propose another version of the Graphical-Lasso that adds some structure in the network through clustering of the variables and reduces the computational cost by applying the Graphical-Lasso separately in each cluster. Other approaches aim at addressing the issue of the absence of hypothesis on the network structure by identifying or imposing patterns. This can be useful to facilitate network inference, make more hypotheses on its structure and drive the result’s interpretation. One can use prior knowledge on the network so as to guide its inference, for instance by forbidding some associations to appear ( Grechkin et al. 2015 ) . Another method is to assume an underlying structure in the graph, for instance supposing that some nodes display "hub" roles in the network ( Tan et al. 2014 ) , or that edges mostly appear within clusters ( Ambroise et al. 2009 ) . Sanou et al. 2023 propose an approach based on Meinshausen and Bühlmann 2006 and fused-lasso ( Pelckmans et al. 2005 ; Hocking et al. 2011 ; Lindsten et al. 2011 ) that estimates a hierarchical clustering on the variables and a network structure between the clusters. Since it uses the approach of Meinshausen and Bühlmann 2006 , this model does not retrieve individual variables’ variances. Moreover, the fused-lasso method encourages the inference procedure to retrieve similar dependencies for the elements of the same cluster but it does not directly reduce the size of the network. Here, we propose the novel Normal-Block model: