Graph Neural Networks with Similarity-Navigated Probabilistic Feature Copying Journal: Nuclear Physics B Asela Hevapthige Abstract Graph Neural Networks (GNNs) have demonstrated remarkable success across various graph-based tasks. However, they face some fundamental limitations: feature oversmoothing can cause node representations to become indistinguishable in deeper networks, they struggle to effectively manage heterogeneous relationships where connected nodes differ significantly, and they process entire feature vectors as indivisible units, which limits flexibility. We seek to address these limitations. We propose AxelGNN, a novel GNN architecture inspired by Axelrod’s cultural dissemination model that addresses these limitations through a unified framework. AxelGNN incorporates similarity-gated probabilistic interactions that adaptively promote convergence or divergence based on node similarity, implements trait-level copying mechanisms for fine-grained feature aggregation at the segment level, and maintains global polarization to preserve node distinctiveness across multiple representation clusters. The model’s bistable convergence dynamics naturally handle both homophilic and heterophilic graphs within a single architecture. Extensive experiments on node classification and influence estimation benchmarks demonstrate that AxelGNN consistently outperforms or matches state-of-the-art GNN methods across diverse graph structures with varying homophily-heterophily characteristics. 1 Introduction Graph Neural Networks (GNNs) have been a cornerstone to many graph downstream tasks, such as node classification [ 1 , 2 ] , influence maximisation [ 3 , 4 ] , link prediction [ 5 , 6 ] , and community detection [ 7 , 8 ] . This success can be attributed to their ability to effectively leverage the structural relationships within graph data, which enables the learning of rich node representations that seamlessly integrate both node-level features and topological information through iterative message passing mechanisms [ 9 ] . Despite the strengths, GNNs have some notable limitations: 1. Feature Oversmoothing: As GNNs stack more layers, node representations become increasingly similar to their neighbours, eventually converging to nearly identical embeddings across the entire graph [ 10 ] . This reduces the model’s ability to distinguish between different nodes and hurts performance, especially in downstream tasks that require deeper networks [ 11 ] . 2. Inability to Handle Heterogeneous Relationships: Traditional GNNs assume that connected nodes tend to have similar features and labels, known as the homophily assumption [ 12 ] . However, many real-world graphs exhibit heterophily, where connected nodes are actually dissimilar [ 13 ] . GNNs perform poorly on heterophilic graphs because their message-passing mechanism reinforces similarity between neighbours, which contradicts the underlying graph structure. 3. Monolithic Feature Treatment: Existing GNNs treat node features as indivisible units during aggregation. The entire feature vector is processed as a single entity, without considering the individual importance or relationships between different feature dimensions. This prevents fine-grained feature-level interactions and limits the model’s ability to selectively aggregate specific aspects of neighboring node features. We seek to address the limitations above. We observe that Axelrod’s cultural dissemination model [ 14 ] exhibits remarkable properties that directly correspond to the fundamental challenges in GNNs. The model’s dual convergence behavior naturally handles both homophilic and heterophilic relationships: similarity convergence (where neighboring agents become identical) mirrors beneficial feature sharing in homophilic graphs, while dissimilarity convergence (where neighboring agents become completely different) preserves node distinctiveness in heterophilic scenarios. Additionally, the model’s global polarization mechanism prevents the collapse to a single representation by maintaining multiple distinct cultural regions, directly addressing the oversmoothing problem. Finally, Axelrod’s trait-level copying mechanism operates on individual cultural dimensions rather than entire cultural vectors, providing a principled approach to fine-grained feature interactions that transcends monolithic feature treatment. Motivated by these observations, we propose AxelGNN , a novel graph neural network architecture that incorporates the core principles of Axelrod’s cultural dissemination model into the neural message-passing framework. Our approach introduces similarity-gated interactions that adaptively promote convergence or divergence based on node similarity, implements trait-level copying mechanisms for fine-grained feature aggregation, and maintains global polarization to preserve node distinctiveness across multiple representation clusters. Our research contributions are summarised as follows: 1. Novel Formalisation: We reformalize message-passing in GNNs as a feature dissemination model that has convergence guarantees with modeling homophily-heterophily dynamics and prevents oversmoothing via polarization mechanisms inspired by Axelrod’s cultural dissemination theory. 2. Novel GNN Architecture: We propose AxelGNN, a novel graph neural network that incorporates similarity-gated interactions and trait-level copying mechanisms to address fundamental limitations in traditional GNN architectures. 3. Empirical Evaluation: We conduct extensive experiments on node classification and influence estimation tasks, demonstrating that our approach achieves superior performance over state-of-the-art GNNs across diverse graph datasets with varying homophily-heterophily characteristics. 2 Related Work 2.1 Traditional GNNs Graph Neural Networks have been increasingly used for diverse graph-related downstream tasks [ 15 ] . There have been many GNN types proposed with different inductive biases. Gilmer et al. [ 9 ] proposed one of the early GNNs based on the message-passing paradigm. Graph Convolutional Networks (GCNs) introduced a spectral-based perspective where convolution operations are defined in the spectral domain of graphs using the graph Laplacian matrix [ 16 ] . Graph Attention Networks (GATs) consider a learnable neighbourhood weighting mechanism for message-passing, going beyond traditional fixed, structure-based weighting schemes [ 17 ] . GraphSAGE is another GNN designed based on a sampling mechanism to enhance GNN’s scalability to large graphs [ 18 ] . However, these classical GNNs are known to work under the homophily assumption, thus cannot model heterogeneous relationships among neighbouring nodes, and are prone to oversmoothing. 2.2 Heterophily-aware GNNs Pei et al [ 19 ] presented one of the early works that identified the performance degradation issue in GNNs under heterophilic data. Since then, researchers have proposed GNNs enhanced by various techniques to alleviate this limitation. Some of these works have proposed neighbourhood filtering to aggregate information from relevant neighbours selectively [ 20 , 13 , 21 ] . In contrast, some other works have introduced higher-order graph structures to capture multi-hop relationships that may be more informative than direct connections [ 12 , 22 , 23 , 24 ] . There have been works utilising specific design decisions, such as tailored aggregation mechanisms [ 25 , 26 ] and neighbourhood ordering [ 27 ] , to enhance relevant information flow. These approaches aim to suppress noise flow in message passing. However, certain limitations still exist. First, many existing approaches cannot handle both homophilic and heterophilic data patterns within a single framework effectively. Most methods are specifically designed for either homophilic or heterophilic scenarios, limiting their practical applicability in real-world graphs that often exhibit mixed characteristics. Second, existing methods often lack the flexibility to adaptively determine when to emphasise local versus global information based on neighbourhood characteristics, resulting in suboptimal performance when the optimal aggregation strategy varies across different parts of the same graph. 2.3 Oversmoothing in GNNs Oversmoothing in GNNs refers to the scenario where node features become increasingly similar and eventually indistinguishable in the embedding space as message passing iterations increase [ 10 ] . Existing works try to alleviate this issue through various mechanisms. Some works propose structural modifications, such as residual connections [ 28 , 29 , 30 ] and jumping knowledge mechanisms [ 31 , 32 ] , to retain initial representations of nodes to some extent, thus preventing the complete loss of node distinctiveness. Some other works introduced regularisation and normalisation techniques, such as dropout [ 33 , 34 , 35 ] and batch normalisation techniques [ 36 , 37 ] , to introduce controlled stochasticity and maintain feature diversity throughout the graph. Recently, researchers have used curvature-based methods to identify bottlenecks in graphs that lead to oversmoothing [ 38 , 39 , 40 ] . They also proposed graph rewiring and sampling methods to structurally correct these bottlenecks. However, most existing approaches still suffer from several limitations. First, they typically apply uniform treatments across the entire graph without considering local neighborhood characteristics, potentially over-correcting in regions where information sharing would be beneficial while under-correcting in areas where distinctiveness preservation is crucial. Second, many methods lack principled theoretical foundations for determining when and how to prevent oversmoothing, often relying on heuristic solutions that may not generalise across different graph types and diverse downstream tasks. Finally, these approaches often fail to provide adaptive mechanisms that can simultaneously handle both homophilic regions where controlled smoothing is desirable and heterophilic regions where preservation of differences is essential within the same graph structure. 2.4 Novelty of Our work Our AxelGNN introduces a novel paradigm that fundamentally differs from existing heterophily and oversmoothing GNNs by providing a unified framework grounded in Axelrod’s cultural dissemination theory. Unlike existing approaches that are typically designed for either homophilic or heterophilic scenarios, AxelGNN adaptively handles both patterns within a single architecture through similarity-gated probabilistic interactions and bistable convergence dynamics. The method’s trait copying mechanism breaks the monolithic feature assumption by operating on grouped feature segments rather than entire feature vectors. This enables fine-grained modeling of complex relationships where different feature dimensions may exhibit varying similarity patterns. This approach naturally prevents oversmoothing through global polarization while maintaining selective information flow, addressing fundamental limitations of existing methods that apply uniform treatments across diverse graph regions. 3 Background and Motivation In this section, we present Axelrod’s model of cultural dissemination and discuss its implications for addressing the gaps in GNNs. 3.1 Axelrod’s Cultural Dissemination Model The model simulates cultural dissemination on an L\times L grid, where each cell represents an agent with a cultural vector. Each agent i has a cultural vector \mathbf{v}^{i}=(v_{1}^{i},v_{2}^{i},\ldots,v_{f}^{i}) with f cultural dimensions (i.e., traits), where each trait v_{j}^{i} can take q possible discrete values from \{0,1,\ldots,q-1\} . Agents start with random trait assignments. The cultural similarity between two agents i and j is defined as: s_{ij}=\frac{|\{k:v_{k}^{i}=v_{k}^{j}\}|}{f} (1) where s_{ij}\in[0,1] represents the fraction of matching traits between agents i and j . At each time step, an active agent k and a passive neighbour r are selected randomly. They interact with probability s_{kr} , where s_{kr} is their cultural similarity. If interacting, k copies one of r ’s differing traits at random. The system reaches equilibrium when all neighbouring pairs are either identical ( s_{kr}=1 ) or completely dissimilar ( s_{kr}=0 ). The pseudo-code of the Axelrod model is depicted in Algorithm 1 . 1: Input: Grid size L , number of features f , number of traits per feature q 2: Initialization: 3: for each agent i in L\times L grid do 4: Initialize cultural vector \mathbf{v}^{i}=(v_{1}^{i},v_{2}^{i},\ldots,v_{f}^{i}) 5: for j=1 to f do 6: v_{j}^{i}\leftarrow random integer from \{0,1,\ldots,q-1\} 7: end for 8: end for 9: Main Evolution Loop: 10: repeat 11: Select random agent k from grid 12: Select random neighbor r of k 13: Compute similarity: s_{kr}=|\{i:v_{i}^{k}=v_{i}^{r}\}|/f 14: if random number from [0,1)