Robust Learning on Noisy Graphs via Latent Space Constraints with External Knowledge

Chunhui Gu, Mohammad Sadegh Nasr, James P. Long, Kim-Anh Do, Ehsan Irajizad · 2025

Read Robust Learning on Noisy Graphs via Latent Space Constraints with External Knowledge by Chunhui Gu, Mohammad Sadegh Nasr, James P. Long, Kim-Anh Do, Ehsan Irajizad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05540.txt.

Introduction

Chunhui Gu and co-authors present a graph learning method that resists noise in the links between nodes. Their 2025 work starts from a known flaw: graph neural networks falter when edges are wrong. Clean links from outside sources offer a guide.

Two encoders train side by side, one on the full graph and one on a cleaner graph without the suspect links. A penalty pulls their inner maps together, which steers the model away from false edges. On standard test sets the method beats plain and noise-hardy rivals under mid-level noise. A protein-metabolite network test shows gains in a real science setting. The authors stress gains in both scores and clarity of meaning.

Catalog record

CREATORChunhui Gu, Mohammad Sadegh Nasr, James P. Long, Kim-Anh Do, Ehsan Irajizad
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05540

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Learning on Noisy Graphs via Latent Space Constraints with External Knowledge Chunhui Gu, Mohammad Sadegh Nasr, James P. Long, Kim-Anh Do, Ehsan Irajizad Abstract Graph Neural Networks (GNNs) often struggle with noisy edges. We propose Latent Space Constrained Graph Neural Networks (LSC-GNN) to incorporate external “clean” links and guide embeddings of a noisy target graph. We train two encoders—one on the full graph (target plus external edges) and another on a regularization graph excluding the target’s potentially noisy links—then penalize discrepancies between their latent representations. This constraint steers the model away from overfitting spurious edges. Experiments on benchmark datasets show LSC-GNN outperforms standard and noise-resilient GNNs in graph subjected to moderate noise. We extend LSC-GNN to heterogeneous graphs and validate it on a small protein–metabolite network, where metabolite–protein interactions reduce noise in protein co-occurrence data. Our results highlight LSC-GNN’s potential to boost predictive performance and interpretability in settings with noisy relational structures. Code repository: https://anonymous.4open.science/r/latent-space-constraint-GNN-23B6/README.md 1 Introduction Graph Neural Networks (GNNs) have demonstrated significant improvement in modeling graph-structured data from many disciplines Zitnik_2018 ; fan2019graphneuralnetworkssocial ; kipf2018neuralrelationalinferenceinteracting . A key distinction between GNNs and other deep learning frameworks is their ability to aggregate information using known node connections through a message-passing mechanism RN2153 . Message passing is powerful because it systematically aggregates and transforms information from each node’s neighbors, allowing the learned representations to capture both local features and broader structural context within the graph. The performance of GNNs is highly dependent on the quality of provided edges (a.k.a. links) RN2213 ; dai2022robustgraphneuralnetworks . Ideally, all these links should capture meaningful relationships between nodes. However, in real-world graphs, this is rarely the case. This could be a result of two major reasons. First, the misclassification between negative (non-existent) and positive links. In most moderate to large graphs, the number of possible links (in magnitude of N^{2} , N is the number of nodes) is much higher than the number of actual links RN2214 ; li2023evaluatinggraphneuralnetworks , leading to the pervasive false-positive links both in the originally provided links and the succeeding new link prediction task. Second, the existence of boundary links that reflect the authentic but highly specialized or uncommon relationships, making them outliers that are difficult to generalize from and potentially detrimental to the overall modeling task RN2213 ; baranwal2022graphconvolutionsemisupervisedclassification . We used the term "noisy links" to refer to both cases, as distinguishing between them is often impractical in real-world scenarios. In many cases, a target graph is naturally embedded as a subgraph of broader more comprehensive graph. For example, in social network, an organisation’s internal friendship graph forms just one slice of the global social graph. Likewise, in biology, one omics layer constitutes its own relational network and becomes part of a larger multi-layer biological network when combined with cross-omics links Zitnik_2018 ; menche2015uncovering . While the relationships within the target graph may be unclear, their links with nodes under the larger graph are more studied and can be used to improve the prediction for the target graph. However, the optimal way to incorporate such additional information is unclear. We aim to address the challenge of "noisy links" in graph data by investigating how such issues can be alleviated by embedding the target graph as a subgraph within a larger, more accurate, and well-defined graph. To achieve this, we propose a novel framework that constrains the latent space by incorporating additional links introduced by augmenting the target graph. This approach helps to improve model robustness against noisy links and guides the learned embeddings toward more meaningful representations especially in many biology setting where we often have high-potential but noisy relationships and validated data sources. Our contributions are threefold: (1) we introduce an innovative technique for training models by mitigating the effects of noisy direct links through the incorporation of additional clean links as a form of regularization (LSC-GNN); (2) we extend the proposed approach to accommodate heterogeneous graph learning scenarios; and (3) we validate the effectiveness of our model using real-world protein-metabolite heterogeneous network data. 2 Related works Various approaches have been proposed to mitigate the impact of noisy links in GNNs. One common strategy involves pre-processing the adjacency matrix by either down-weighting or removing noisy links based on node feature similarity xu2022ned ; wu2019adversarialexamplesgraphdata ; deng2022garnet or by applying low-rank decompositions entezari2020all to get an adjusted adjacency matrix as input. Some methods choose to assign different learnable weights (or adding/removing edges) based on hidden layer similarity pmlr-v139-liu21k ; zhang2020gnnguard or optimize graph structure in an end-to-end fashion for the final task wu2019adversarial ; wang2019graphdefense ; xu2019topology . Another strategy is to incorporate regularization terms directly into the training objective to enhance robustness in an end-to-end manner. For instance, Jin et al. (2020) jin2020graphstructurelearningrobust introduce a regularization framework that refines graph structure by assessing edge reliability based on node feature similarity, while simultaneously enforcing low-rank and sparsity constraints on the learned adjacency matrix. This dual regularization strategy aims to refine the graph by preserving meaningful connections while filtering out noisy edges. Tang et al. (2020) Tang_2020 adopt a self-attention mechanism that enables the model to assign different attention coefficients to normal edges and perturbed ones. Their approaches utilize external clean graphs similar to the target poised graph with known perturbation and employ a regularization loss to widen the margin between mean values of two distributions. Additional studies exploit the distribution of learned features in hidden layers, such as assigning lower weights to edges with higher variation elinas2020variational or using a soft median aggregation that takes the distribution of learned feature into consideration geisler2021robustness , thereby reducing the influence from outlier neighbors introduced by perturbed edges. Our proposed LSC-GNN method differs from the above studies: i) Our approach regularizes using new external relationships, while the approaches above regularize based on information in the target graph. ii) While Tang et al. (2020) and our model both incorporate additional clean links to improve performance on the noisy graph, the way in which external information is applied differs significantly. iii) Existing studies primarily focus on homogeneous graph setting, whereas we demonstrate that our method extends naturally to heterogeneous graphs, which are especially common in the biology domain. 3 Preliminaries 3.1 Notations A given graph \mathbf{G}=(\mathbf{V},\mathbf{E},\mathbf{X}) is defined by its nodes (vertices). \mathbf{V}=\{v_{1},\dots,v_{n}\} , set of edges (links) \mathbf{E}=\{(v_{i},v_{j})\mid\text{if there is edge from }v_{i}\text{ to }v_{j}\} , and \mathbf{X}\in N\times F is the node feature matrix with each row corresponding to a node and each column corresponding to a feature ( F is the number of node features). For node i , we use z_{i} to denote the latent space of dimension L with L<F and a N\times L latent matrix \mathbf{Z} for all nodes. 3.2 Basic GNN model design In this subsection, we introduce the general architecture for learning node representations in a lower-dimensional latent space using a Graph Neural Network (GNN). We aim to map graph-structured data into a latent space that preserves essential topological and semantic relationships between nodes. A graph encoder f is a function that transforms input graph and node features into meaningful node embeddings. Formally, we denote the encoder by f:\mathds{R}^{F}\rightarrow\mathds{R}^{L} , where F is the input feature dimension and L is the dimension of

Read the complete text