Closer through commonality: Enhancing hypergraph contrastive learning with shared groups
Daeyoung Roh 1 , Donghee Han 1 , Daehee Kim 1 , Keejun Han 2 * , Mun Yi 3 * · 2025
Read Closer through commonality: Enhancing hypergraph contrastive learning with shared groups by Daeyoung Roh 1 , Donghee Han 1 , Daehee Kim 1 , Keejun Han 2 * , Mun Yi 3 * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08432.txt.
Introduction
Daeyoung Roh and four co-authors improve learning on hypergraphs in a 2025 machine learning paper. A hypergraph links items in groups rather than in pairs, which fits real settings like group chats or shared tags. Contrastive learning teaches models by pulling like items together and pushing unlike ones apart, but it has barely been tried on hypergraphs.
Their method, HyFi, adds noise to node features instead of wrecking the group structure, as older augmentation tricks do. It also adds a middle category of weak positives, items that are somewhat alike, between true matches and true mismatches. Across ten data sets, HyFi beat both guided and unguided rivals while training fast and using little memory.
Catalog record
| CREATOR | Daeyoung Roh 1 , Donghee Han 1 , Daehee Kim 1 , Keejun Han 2 * , Mun Yi 3 * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08432
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Closer through commonality: Enhancing hypergraph contrastive learning with shared groups Thanks: * Corresponding author Daeyoung Roh 1 , Donghee Han 1 , Daehee Kim 1 , Keejun Han 2 * , Mun Yi 3 * Abstract Hypergraphs provide a superior modeling framework for representing complex multidimensional relationships in the context of real-world interactions that often occur in groups, overcoming the limitations of traditional homogeneous graphs. However, there have been few studies on hypergraph-based contrastive learning, and existing graph-based contrastive learning methods have not been able to fully exploit the high-order correlation information in hypergraphs. Here, we propose a Hypergraph Fine-grained contrastive learning (HyFi) method designed to exploit the complex high-dimensional information inherent in hypergraphs. While avoiding traditional graph augmentation methods that corrupt the hypergraph topology, the proposed method provides a simple and efficient learning augmentation function by adding noise to node features. Furthermore, we expands beyond the traditional dichotomous relationship between positive and negative samples in contrastive learning by introducing a new relationship of weak positives. It demonstrates the importance of fine-graining positive samples in contrastive learning. Therefore, HyFi is able to produce high-quality embeddings, and outperforms both supervised and unsupervised baselines in average rank on node classification across 10 datasets. Our approach effectively exploits high-dimensional hypergraph information, shows significant improvement over existing graph-based contrastive learning methods, and is efficient in terms of training speed and GPU memory cost. The source code is available at https://github.com/Noverse0/HyFi.git . I Introduction Hypergraphs surpass simple pairwise connections, capturing complex interactions in the real world [ 34 , 10 , 36 , 18 , 32 , 45 , 21 , 13 , 37 ] . Although recent advances in graph-based learning have primarily focused on these simple relationships, they often fail to account for the intricate group dynamics inherent in real-world data. In contrast, hypergraphs can go beyond pairwise connections to capture high-order data correlations. Their application across diverse fields such as social network analysis [ 35 , 25 , 26 ] , bioinformatics [ 22 , 41 , 39 , 15 ] , and complex system modeling is increasingly prevalent, as they can effectively represent the depth of relationships within these domains. These applications showcase the advantages of hypergraphs in capturing high-order data correlations from real-world scenarios [ 14 , 29 , 31 , 8 , 16 ] . (a) Tranditional HGCL (b) HyFi Fig. 1 : Example of tranditional hypergraph contrastive learning vs. HyFi. In (a), contrastive learning only learns postive or negative pairs between graphs augmented by randomly dropping hyperedges or nodes. In (b), HyFi preserves the topology of the hypergraph by adding noise to the node features, while adding weak postive pair relationships for fine-grained contrastive learning. (a) Co-citation (b) Co-authorship (c) Computer Vision and Graphics (d) Machine Learning Repository Fig. 2 : The average of the cosine similarity of the node features over the number of commonalities between two nodes, where commonality, defined as a common group, means common hyperedges. The higher the number of common hyperedges, the higher the similarity of the two node features. Despite its potential, research on hypergraph-based learning has been relatively sparse, with even fewer studies exploring contrastive learning, although the possibility of using a hypergraph has recently gained momentum. The complex structure of hypergraphs, which includes nodes and hyperedges, differs significantly from traditional homogeneous graphs, requiring new approaches tailored specifically to hypergraphs for effective learning. Traditional hypergraph contrastive learning (HGCL) relies on contrastive learning between graphs augmented with random variations in nodes or hyperedges. Consequently, it depends heavily on the embedding of the augmented opposite view. In contrast, we propose Hy pergraph Fi ne-Grained contrastive learning (HyFi), a novel method that identifies and contrastively learns new positive pairs within the original view without perturbing the topology of the original graph. Furthermore, our model does not rely on the quality of the augmented view, as it generates positive pairs by simply adding some noise to the node features. Fig. 1 illustrates the difference between trainditional HGCL and HyFi. Traditional graph contrast learning (GCL) typically generates two augmented views of an existing graph and then contrasts them using positive and negative pairs [ 28 , 19 , 9 , 38 , 43 ] . However, these traditional approaches do not adequately capture the nature of hypergraphs, especially their ability to represent complex group interactions and higher-order correlations represented by commonality. The dichotomous relationship represented by the traditional positive pair and negative pair makes sense for homogeneous graphs with one relation, but cannot capture the higher-order correlations present in hypergraphs with many different relations. Furthermore, efficient contrastive learning is sensitive to the augmentation of the graph, which mostly relies on the randomness of the graph, which can lead to loss of important information in the graph. Therefore, we propose a new relation, called a weak positive pair, which shows how group sharing can be exploited in contrastive learning. We show that a weak positive pair is a relationship between nodes that share the same group relative to an anchor node, and that we see significant performance gains just by introducing weak positive pairs. Moreover, weak positive pairs can be found within the original view, so there is little dependence on augmenting the graph. These new relationships are based on the idea that we can define ourselves by the people around us who are in the same group as us. In reality, we are strongly influenced by the people around us and relate to similar people. Furthermore, our approach to augmenting the graph by adding noise to the node features to generate positive samples differs from typical graph augmentation techniques that corrupt the original topology and increase model complexity through random modifications. However, we show that this approach is still sufficient to generate positive samples and is an efficient graph augmentation technique. Therefore, we propose a new form of HGCL method that emphasizes the importance of shared hyperedges and shared nodes while maintaining the structural integrity of the hypergraph. Properly exploiting this commonality is very important in HGCL because hypergraphs are well suited to represent these different relationships through hyperedges. Distinguishing these types of relationships allows us to capture complex intricacies more accurately. This approach is based on the assumption that the more two nodes share a common group, the more similar they are. In other words, we define higher-order correlations in a hypergraph as “commonality,” which is the property of sharing a common group between two nodes. Our assumption is confirmed in Figure 2 , where we see that the cosine similarity of two node features increases as the number of hyperedges shared by the two nodes increases. For example, two people belonging to the same group could mean that they have the same disposition, or they could belong to the same group and have similar dispositions. Therefore, the assumption of common group membership is important to exploit the high-dimensional correlations in the hypergraph. Also, the model implements group unit contrastive learning to efficiently learn homophily trends within the hypergraph. In previous HGCL, contrastive learning is based on nodes; however, we use group-based contrastive learning. Thus, nodes that belong to the same group are able to contrasted multiple times. Our proposed HyFi method enhances the classification