What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decomposition

Danny Wang, Ruihong Qiu, Zi Huang · 2026

Read What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decomposition by Danny Wang, Ruihong Qiu, Zi Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13032.txt.

Introduction

Wang, Qiu and Huang tackle out-of-distribution detection for graph neural networks, which falter when node features or graph structure shift. Standard supervised training tends to absorb spurious signals from features or structure. Their TIDE framework splits information into feature-specific, structure-specific and joint parts, keeping only the label-relevant slice of the joint part and filtering spurious parts. The result separates in-distribution from out-of-distribution nodes better, with up to 34% improvement in FPR95 over strong baselines.

Catalog record

CREATORDanny Wang, Ruihong Qiu, Zi Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE129607
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13032

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decomposition Danny Wang, Ruihong Qiu, Zi Huang Abstract Graph neural networks are widely used for node classification, but they remain vulnerable to out-of-distribution (OOD) shifts in node features and graph structure. Prior work established that methods trained with standard supervised learning (SL) objectives tend to capture spurious signals from either features and/or structure, leaving the model fragile under distributional changes. To address this, we propose Tide , a novel and effective T ri-Component I nformation De composition framework that explicitly decomposes information into feature-specific, structure-specific and joint components. Tide aims to preserve only the label-relevant part of the joint information while filtering out spurious feature- and structure-specific information, thereby enhancing the separation between in-distribution (ID) and OOD nodes. Beyond the framework, we provide theoretical and empirical analyses showing that an information bottleneck objective is preferable to standard SL for graph OOD detection, with higher ID confidence and a greater entropy gap between ID and OOD data. Extensive experiments across seven datasets confirm the efficacy of Tide , achieving up to a 34 % 34\% improvement in FPR95 over strong baselines while maintaining competitive ID accuracy. Code is available at . 1 Introduction Figure 1 : Comparison of information captured by standard supervised learning (SL), GIB ( 76 ) , and Tide . The dashed red circle shows that SL mixes label-relevant and irrelevant feature and structure signals, causing spurious correlations that make OOD nodes appear ID. The gridded region indicates that GIB suppresses label-irrelevant noise but still keeps input-specific spurious cues. Contrary, Tide ( solid red triangle ) isolates the joint label-relevant information by decomposing spurious feature-/structure-specific components, thereby improving OOD detection. Graph neural networks (GNNs) have become a dominant approach for node classification across real-world domains; however, they remain vulnerable to out-of-distribution (OOD) shifts in node features and/or graph structure, limiting reliable deployment in real-world applications ( 44 ; 75 ; 27 ; 80 ; 57 ; 25 ) . In biomedical graphs, node features like biomarkers may correlate with health outcomes in one hospital but shift in another, degrading performance despite stable patient-symptom links ( feature shift ). In e-commerce graphs, co-purchase links can change as shopping patterns evolve, even when product attributes remain stable ( structural shift ). In social networks, new communities may alter both posting behaviour and friendship links, causing simultaneous changes in features and structure signals ( joint shift ) ( 69 ) . Given these challenges, OOD detection is critical for identifying nodes beyond the in-distribution (ID) training data ( 41 ; 86 ; 6 ) . Existing graph OOD methods typically handle shifts by learning invariant node representations, using topology-aware metrics to capture node irregularities ( 47 ; 60 ; 5 ) , or applying post-hoc scoring functions to separate ID from OOD nodes ( 70 ; 50 ; 75 ; 32 ; 31 ; 43 ) . Others incorporate contrastive learning or OOD exposure when auxiliary OOD data is available ( 33 ; 81 ) . While effective, many existing approaches rely on a mixed representation of a graph’s features and structure , without explicitly modelling the separate contributions of features \mathbf{X} and structure \mathbf{A} ( 75 ) . This mixed representation corresponds to the node embeddings \mathbf{Z}=f(\mathbf{X},\mathbf{A}) learned by a GNN f under a standard supervised-learning (SL) objective. As shown in Figure 1 , this representation ( red dotted circle ) mixes label-irrelevant information (shaded area) with three label-related signals: the feature-specific signal that depends only on \mathbf{X} , the structure-specific signal from \mathbf{A} , and the joint-input signal arising from features-structure interactions. Although all three signals can be predictive in-distribution, prior work has shown that feature-only and structure-only signals often reflect spurious correlations with the label, which become problematic under distribution shifts ( 9 ; 12 ; 22 ) . For example, under a feature shift with ID-like structure (\mathbf{X}_{\text{OOD}},\mathbf{A}_{\text{ID}}) , a model that exploits spurious structure-label correlations may confidently treat OOD nodes as ID. Similarly, under a structure shift with ID-like features (\mathbf{X}_{\text{ID}},\mathbf{A}_{\text{OOD}}) , reliance on feature-only correlations can again yield overconfident predictions that evade detection. In contrast, the joint-input signal is more shift-indicative because mismatches between features and structure are exposed during encoding. Thus, OOD detection can fail under SL when the model relies on spurious single-input correlations (from \mathbf{X} or \mathbf{A} ) rather than on joint-input information. A typical example with distribution visualisations is shown in Figure 2 . When the dataset contains samples with ID features but OOD structure (\mathbf{X}_{\text{ID}},\mathbf{A}_{\text{OOD}}) , a standard SL-trained OOD detector (top left) fails to clearly separate OOD data from ID. Yet an expected behaviour from a successful detector should be a well separation given the structural shift as in bottom left or top right in Figure 2 . Ideally, to handle real-world distribution shifts, an effective graph OOD detector should prioritise the label-relevant joint-input information while filtering out feature- and structure-specific spurious correlations . Figure 1 illustrates this motivation: SL mixes feature-only, structure-only, and joint signals together with label-irrelevant information ( red dotted circle ); in contrast, compressing the learned representation toward the triangle-like overlap ( red solid triangle ) preserves primarily joint-input signals, which improves ID-OOD separation. To achieve this, we propose Tide , a Tri-Component Information Decomposition framework. Unlike prior OOD detection methods that treat feature and structure information as a single unified signal, Tide guides learning toward the desired joint-input region by explicitly decomposing predictive label information I(\mathbf{X},\mathbf{A};\mathbf{Y}) into: feature-specific information I(\mathbf{X};\mathbf{Y}|\mathbf{Z}) , structure-specific information I(\mathbf{A};\mathbf{Y}|\mathbf{Z}) , and joint-input information I(\mathbf{Z};\mathbf{Y}) . Tide preserves the joint-input signal while suppressing individual-input components (indicated by the left and right arrows \rightarrow ). Moreover, we employ an information bottleneck (IB) objective to filter out label-irrelevant noise (indicated by the upward arrow \uparrow ), producing a compact and shift-indicative representation. We provide theoretical insights showing that, compared to SL, IB increases ID confidence and improves ID-OOD separation for logit-based detection. Thus, our contributions are: (a) Standard SL Detector (b) Joint Cls. Network (c) Struc. Network (d) Feat. Network Figure 2 : ID-OOD representation distributions for standard SL trained detector and Tide ’s joint classification (Cls.), structure (Struc.) and feature (Feat.) networks on Cora-Structure with a structure shift and ID-like features (\mathbf{X}_{\text{ID}},\mathbf{A}_{\text{OOD}}) . 1. Methodological: We propose Tide , a novel tri-component information decomposition framework for graph OOD detection that decomposes predictive information into feature-specific , structure-specific , and joint components, and introduces novel regularisers to suppress label-irrelevant and spurious correlations. 2. Theoretical: We show that IB increases ID confidence and widens the entropy gap between ID and OOD relative to standard SL, improving logit-based OOD detection. 3. Empirical: On seven real-world and synthetic datasets, Tide achieves up to 34% improvement in FPR95 over baselines while maintaining competitive ID accuracy. 2 Related Work Graph OOD detection builds on several lines of research. 1) Scoring-based methods rely on ID data to design OOD scores ( 42 ; 40 ; 16 ; 52 ; 51 ; 32 ) . 2) OOD exposure approaches incorporate auxiliary OOD data during training for improved detection ( 33 ; 50 ; 54 ; 87 ; 81 ; 5 ) . 3) IB principle has been applied to image

Read the complete text