Node Classification Method Based on Hierarchical Hypergraph Neural Network Authors: Feng Xu, Wanyue Xiong, Zizhu Fan, Licheng Sun, Liang-Jian Deng Published: 2024 ABSTRACT AbstractHypergraph neural networks have gained widespread attention due to their effectiveness in handling graph-structured data with complex relationships and multi-dimensional interactions. However, existing hypergraph neural network models mainly rely on planar message-passing mechanisms, which have limitations: (i) low efficiency in encoding long-distance information; (ii) underutilization of high-order neighborhood features, aggregating information only on the edges of the original graph. This paper proposes an innovative hierarchical hypergraph neural network (HCHG) to address these issues. The HCHG combines the high-order relationship-capturing capability of hypergraphs, uses the Louvain community detection algorithm to identify community structures within the network, and constructs hypergraphs layer by layer. In the bottom-level hypergraph, the model establishes high-order relationships through direct neighbor nodes, while in the top-level hypergraph, it captures global relationships between aggregated communities. Through three hierarchical message-passing mechanisms, the HCHG effectively integrates local and global information, enhancing the multi-resolution representation ability of node representations and significantly improving performance in node classification tasks. In addition, the model performs excellently in handling 3D multi-view datasets. Such datasets can be created by capturing 3D shapes and geometric features through sensors or by manual modeling, providing extensive application scenarios for analyzing three-dimensional shapes and complex geometric structures. Theoretical analysis and experimental results show that the HCHG outperforms traditional hypergraph neural networks in complex networks.Keywords: hypergraph neural networks, hierarchical representations, Nnode classification 1. Introduction Graph neural networks (GNNs) have garnered significant attention recently, emerging as powerful tools for processing graph-structured data. They are widely applied in various domains such as social networks [1,2], Photogrammetry [3,4], 3D object classification [5,6], the Internet of Things [7], and bioinformatics [8,9]. GNNs can effectively capture local relationships between nodes within a graph by aggregating information from neighboring nodes, enabling tasks such as node classification and link prediction [10,11]. For instance, in 3D object classification, GNNs utilize point cloud and depth data from sensors like LiDAR and RGB-D cameras, leveraging spatial relationships among nodes to enhance classification accuracy by capturing geometric features, especially in complex scenes. Classic GNN models, including GCN [12], GAT [13], and GraphSAGE [8], have achieved substantial advances in representation learning for graph data. However, these models exhibit limitations when handling complex graph structures and long-range dependencies among nodes. Specifically, the flat message-passing mechanism of traditional GNNs makes it difficult to capture relationships between distant nodes effectively [14,15]. Furthermore, existing graph structures are often overly simplistic, primarily designed for binary relationships, which limits their ability to express multi-relational interactions fully. This directly results in traditional graph neural networks performing poorly in capturing global and local graph information, affecting classification effectiveness. Lastly, GNNs face memory and GPU memory constraints when handling complex graphs, making it challenging to scale to practical applications such as community detection [8]. The introduction of hypergraph structures presents a new approach to addressing these issues. Hypergraphs can capture high-order relationships among multiple nodes, transcending superficial binary relationships, thus better representing multilateral interactions in complex networks [16]. For example, hypergraphs are embedded into a low-dimensional space for clustering analysis, revealing the underlying group structures within the data. However, traditional hypergraph structures may have limitations when handling dynamically changing datasets, as they cannot adapt to rapidly evolving relationships, leading to delayed classification results [17]. At the same time, although hyperedge convolution layers can learn higher-order relationships in complex data, their high computational complexity affects the practicality of the model [18]. The hierarchical mechanism offers a new approach to addressing long-range dependencies and expressing hierarchical information. The hierarchical message-passing mechanism, which progressively aggregates local and global information, can effectively enhance the robustness and expressiveness of node representations [19]. For instance, hierarchical graph pooling methods, such as G-U-Net and DiffPool, have significantly improved in graph classification tasks [20,21]. Although some studies have combined hierarchical structures with graph learning models, there remains a lack of research on integrating hierarchical mechanisms with hypergraph neural networks for node classification. To address key challenges in traditional GNNs and hypergraph neural networks, we introduce the Hierarchical Hypergraph Neural Network (HCHG). While GNNs struggle with long-range dependencies and global context, hypergraph neural networks excel at capturing higher-order relationships but are computationally expensive. HCHG constructs hypergraphs layer by layer, with the first layer capturing local relationships and subsequent layers aggregating community nodes to model global relationships, enhancing the model’s ability to represent local and global interactions. Additionally, HCHG uses a multi-layer message-passing mechanism, including bottom-up, lateral, and top-down flows, which strengthens node representations and reduces the computational burden, efficiently handling complex networks. The main contributions of this paper are as follows: 1.We propose the HCHG model. This novel approach combines hierarchical structures with hypergraph neural networks to effectively capture local and global relationships in node classification and link prediction tasks, improving performance on complex graphs. We propose the HCHG model. This novel approach combines hierarchical structures with hypergraph neural networks to effectively capture local and global relationships in node classification and link prediction tasks, improving performance on complex graphs. 2.The HCHG model introduces a hierarchical construction method, using the Louvain community detection algorithm to build higher-order relationship networks, enhancing the model’s ability to represent complex network structures. The HCHG model introduces a hierarchical construction method, using the Louvain community detection algorithm to build higher-order relationship networks, enhancing the model’s ability to represent complex network structures. 3.Our method performs excellently on six classification datasets and three link prediction datasets, achieving significant performance improvements across multiple tasks. Our method performs excellently on six classification datasets and three link prediction datasets, achieving significant performance improvements across multiple tasks. 2. Related Work Node classification is a core task in graph representation learning, aiming to predict a node’s category based on its structure and attributes. Although Graph Neural Networks (GNNs), such as GCNs [12] and GraphSAGE [8], have achieved significant progress in node classification tasks, they still face challenges in capturing long-range dependencies and handling sparse graph structures, which are critical for node classification in complex networks. In recent years, hypergraph representation learning has provided new solutions by modeling higher-order relationships between nodes. For example, end-to-end hypergraph convolution [22] and Dynamic Hypergraph Neural Networks (DHGNN) [23] effectively capture complex node interactions. While simplifying computation, HyperGCN [24] may lose some high-order structural information. Furthermore, HyperSAGE [25] enhances generalization capabilities through an inductive message-passing mechanism. However, these methods still face limitations in integrating global and local information, particularly in dynamic and complex network scenarios. Researchers have introduced hierarchical structures into node classification tasks to enhance the capacity for multi-granularity semantic modeling. Methods such as DiffPool [21] and ASAP [19] significantly improve representation through node aggregation, but their applications in node-level tasks remain limited by the shortcomings of single-layer models. We propose the HCHG, which leverages a multi-layer structure and diverse message-passing mechanisms to effectively integrate local and global information while enhancing adaptability and generalization. Experiments demonstrate that HCHG achieves outstanding performance across multiple node classification datasets, particularly excelling in modeling higher-order relationships and complex node interactions. 3. Motivation and Background Given a hypergraph structure HG=(V,E,H), the objective is to construct a mapping function F:HG→Z∈R|V|×d that captures the features of node vi and its relationships within the hypergraph. The effectiveness of F will be evaluated through tasks such as node classification and link prediction. In hypergraph neural networks, the node update mechanism differs from traditional Graph Neural Networks. A hypergraph consists of nodes and edges (hyperedges); each can connect multiple nodes. Below, we will detail the fundamental mechanism of node updates in hypergraph neural networks. Consider the hypergraph HG=(V,E,H), where V is the set of nodes, E is the set of edges, and H is the set of hyperedges. Each hyperedge hi∈H connects multiple nodes. The node update process in hypergraph neural networks typically involves the following two steps: 1. Message Aggregation At layer l, the message aggregation for node v is completed through all hyperedges connected to v. The aggregation can be represented as follows: where AggregateN(·) is a differentiable aggregation function, Wkv(l) is the association matrix between node k and node v, hk(l) represents the features of node k at layer l, and N(v) is the set of neighbor nodes directly connected to node v. 2. Node Feature Update Using the aggregated message magg(l), the feature of node v is updated as follows: where Combine(·) is a nonlinear fusion function, AggregateI(·) is another aggregation function, and hv(l−1) refers to the features of node v from the previous layer. 4. Hierarchical Hypergraph Neural Networks We propose the HCHG framework to enable node representations to receive long-range messages and multi-granularity semantics through a hierarchical hypergraph structure. As illustrated in Figure 1, this framework first creates a progressively refined hierarchical structure, processing the input hypergraph in layers. Next, hypergraphs are constructed to facilitate message-passing between supernodes based on the connectivity among hierarchical nodes. To ensure adequate information flow, we design three message propagation mechanisms: bottom-up, intra-layer, and top-down. These mechanisms ensure information exchange both within the same level and across different levels. Finally, we train the model using task-specific loss functions and gradient descent algorithms, optimizing node representations and overall performance. Hierarchical Hypergraph Neural Network Framework (Different colors represent different types of nodes). 4.1. Hierarchical Structure Partitioning For complex multi-node relational systems, we first represent the raw data as a graph G=(V,E), where V is the set of nodes representing different entities, and E is the set of edges depicting relationships between these entities. To capture the higher-order relationships among nodes more effectively, we introduce hyperedges H, defined as h={v1,v2,…,vn}, where vi∈V. This constructs a hypergraph HG=(V,E,H). On this basis, our study employs a hierarchical mechanism that simplifies the graph’s structure through layer-wise abstraction and aggregation. In each layer, we convert the node-set V into a higher-level set of supernodes by partitioning the nodes into communities. For instance, the supernodes in the first layer arise from the community partitioning of the original nodes. In contrast, subsequent layers’ supernodes are formed by combining the supernodes from the preceding layer. This approach allows the hierarchical structure to evolve progressively from the lower to the upper layers, facilitating higher-level analysis and modeling. 4.2. Hierarchical Hypergraph Construction In constructing the hypergraph, the first layer hypergraph starts from the original. We utilize the Louvain community detection algorithm to identify communities within the node set V through modularity optimization. Each identified community Ci⊆V forms a supernode, resulting in a supernode set S1={SC11,SC21,…,SCp1}, considered the first layer. Once the supernodes are established, we create edges between them. Suppose an edge exists between two communities, Ci and Cj (for example, through common original nodes or connecting hyperedges). In that case, we create an edge eij between their corresponding supernodes SCi and SCj. We view the original nodes within each community as components of the hyperedges for hyperedge construction. Specifically, for the set of original nodes VCi={vk∣vk∈Ci} within each community Ci, we define a hyperedge hi that includes all original nodes within community Ci, i.e., hi=VCi. Thus, the set of hyperedges H1 of the first layer hypergraph HG1 consists of all hyperedges corresponding to the communities: H1={hi∣i=1,2,…,p}. Ultimately, the first layer hypergraph can be represented as HG1=(S1,E1,H1), where E1 is the set of edges between supernodes, and H1 is the collection of hyperedges within S1. When generating the second layer hypergraph, we again apply the Louvain community detection algorithm to aggregate the first layer supernodes, forming the second layer supernode set S2={SC12,SC22,…,SCm2}. During this process, if there exists an edge between the second layer supernodes SCk2 and SCl2, we establish an edge ekl between them. Additionally, we construct hyperedges for the second layer supernodes, defining each hyperedge hk formed by the supernodes in community Ck. Specifically, each hyperedge hk in the second layer consists of all first layer supernodes SCi1 that belong to community Ck, i.e., hk={SCi1∣SCi1∈Ck}. Ultimately, the second layer hypergraph is represented as HG2=(S2,E2,H2), where H2 is the collection of hyperedges within S2. 4.3. Hierarchical Information Propagation The hierarchical message-passing mechanism enhances node representations through long-range interaction and neighborhood aggregation. This mechanism does not interfere with the process of learning planar node representations, thereby effectively preserving the original information of the nodes. The hierarchical message-passing mechanism consists of the following three methods. After obtaining the node representations of the (t−1)-th layer hypergraph hsjt−1(l) using the node update mechanism, these representations are aggregated to update the supernode representations in the t-th layer. A schematic illustration is shown in Figure 2, with the mathematical expression for aggregation given by: where SCit is the supernode in the t-th layer, sjt−1 represents the nodes belonging to SCit in the (t−1)-th layer, |SCit| is the number of nodes belonging to SCit in the (t−1)-th layer, and hSCit(l−1) represents the node representations of the supernode SCit in the t-th layer of the (l−1)-th layer. Schematic Diagram of Bottom-Up Propagation. 4.4. Inter-Layer Propagation Inter-layer propagation primarily relies on hypergraph neural networks’ planar message-passing mechanism to aggregate neighboring information and update node representations within the same layer. A schematic illustration is shown in Figure 3. Based on the bottom-up propagation, the aggregation process of information from higher-layer supernodes is represented as follows: where au(l) is the representation of supernode u after bottom-up propagation, and bv(l) is the updated feature representation of node v in layer l. The meanings of the remaining parameters are consistent with those in Section 3. Schematic Diagram of Inter-Layer Propagation. The node representations from the hypergraphs G2,…,GT are used to update the node representations in the original graph G. The importance of information from different layers varies depending on the specific task. Therefore, an attention mechanism proposed by Veličković et al. is employed to adaptively learn the weights of the information during the top-down integration process [26]. A schematic illustration is shown in Figure 4, represented as follows: where αuvl is a trainable attention coefficient that represents the connection weight between nodes v and u across different layers. Here, bu is the bias term, MEAN denotes the element-wise average operation, and ReLU is the activation function. Ultimately, the node information representation from the last layer L is output using the following formula [27]: where σ is the Euclidean normalization function that adjusts values to the range of [0,1]. The final generated node representations Z∈Rn×d are used for classification, with each row zv∈Z representing the representation of a node v. Schematic Diagram of Top-Down Propagation. 4.5. Model Training In the experimental section, HCHG is applied to the training and prediction of semi-supervised node classification. The designed cross-entropy loss function is defined as follows: where yvT is the one-hot encoded label vector representing node v. The loss function L can be specifically modified based on different tasks. The computational complexity analysis presented in this paper consists of three main components: the hierarchical construction of graphs, the construction of hypergraphs, and the information propagation mechanism. The time complexity of the Louvain algorithm during the hierarchical construction process at each layer is O(mtlognt). The complexity of hypergraph construction is O(nt+et). The complexity of the information propagation mechanism is O(ntdt+et). Ultimately, the overall computational complexity can be expressed as: where T is the number of layers in the graph, and mt, nt, et, and dt represent the number of edges, nodes, hyperedges, and the average degree of nodes in layer t, respectively. The following Algorithm 1 provides a brief summary of the construction process of the HCHG model. Algorithm 1: Hierarchical Hypergraph Neural Network 5. Experimental Analysis 5.1. Datasets To verify the model’s overall performance, several commonly used datasets were used in the experiments, including graph-structured and multiview datasets. The graph-structured datasets contain rich node and edge relationships. In contrast, multi-view datasets can be generated by creating images from 3D models or using sensors to capture data from different angles, providing a comprehensive representation of the objects. Table 1 summarizes all the datasets used in the experiments. Table 1Categorical Dataset.DatasetNodes/FeatureTrain/(val)/TestClassCora2708/1433140/500/10007Citeseer3312/3703140/500/10006Pubmed19,717/50060/500/10003Zoo101/1666/357Grid400--ModelNet4012,311/(2048/4096)9843/246844NTU20122012/(2048/4096)1640/37267 Categorical Dataset. 1. Graph-structured Datasets Cora and Citeseer are citation network datasets introduced by Sen et al. [28]. Cora consists of 2708 scientific publications and 5429 links. Each publication is represented as a node with a 1433-dimensional word vector as its feature. Citeseer consists of 3312 scientific publications and 4660 links, with each node having a 3703-dimensional word vector. Pubmed, introduced by Namata et al. [29], includes 19,717 scientific publications about diabetes from the Pubmed database, divided into three classes. Each node is represented by a TF/IDF weighted word vector consisting of 500 words. The Zoo dataset is downloaded from the UCI website. Each sample contains 17 Boolean attributes. Hyperedges are created for nodes with the same classification feature value. Grid is a synthetic 2D grid graph representing a 20×20 grid with 400 nodes and no node features. This dataset is only for link prediction. 2. Multiview Datasets The ModelNet40 dataset consists of 12,311 objects from 40 popular categories, split into training and test sets, with 9843 objects for training and 2468 objects for testing. NTU2012 (National Taiwan University (NTU) 3D Dataset) is a dataset from the computer vision/graphics field. It comprises 2012 3D shapes from 67 categories, including cars, chairs, chessboards, chips, clocks, cups, doors, frames, pens, plant leaves, etc. In the NTU2012 dataset, 80% of the data is used for training, and the remaining 20% is used for testing. In the experiments, each 3D object is represented by extracted features. Two state-of-the-art shape representation methods, Multi-View Convolutional Neural Network (MVCNN) and Group-View Convolutional Neural Network (GVCNN), are adopted here. These two methods have shown satisfactory performance in representing 3D objects. Following the experimental settings of MVCNN and GVCNN, multiple views of each 3D object are generated. 5.2. Experimental Setup and Results Applying the HCHG model to the node classification task on the dataset, multiple averaged results are preserved in the experiments. For HGNN convolutional layers {256,128,64,32}, experiments are conducted with 2 or 3 convolutional layers and a 1×10−5 learning rate. The correlation between different views is modeled for the multiview data by generating a hypergraph G. For each view’s data, an adjacency matrix Hi of the hypergraph is constructed based on the HGNN proposed by Feng et al. [22]. As shown in Figure 5, the adjacency matrices Hi of different views are concatenated to construct the adjacency matrix H of the multiview hypergraph, thus creating a hypergraph structure with multiview features. Since the macro-level graph, GT of the macro-level layer is relatively small, during the experiment, we averaged the input label information by pooling GT and added the loss function separately to calculate the edge information in the T layer. The experimental results showed no impact on the data. The possible reason is that the macro-level layer contains very little information and has minimal influence on the target nodes after top-down propagation. Therefore, the small changes in the node connection mode in GT have a negligible effect on the results. Multimodal Data Fusion. A comparison of the HCHG model with other graph neural network models for node classification was conducted. Experimental results were collected for eight models, including Hyper-Conv, HC-GNN [27], GCN [12], GAT [13], FastGCN [30], LADIES [31], and DNGNN [32], HJRL [33] on standard datasets, as shown in Table 2. For the link prediction, six models—GCN, GraphSAGE [8], GIN [14], G-U-Net [20], GXN [34], and HC-GNN—were compared, as shown in Table 3. The results with node and without node features were evaluated in the experiments with the Cora dataset. The results show that HCHG performs well in terms of node classification and link prediction accuracy. Table 2Average Test Accuracy (%) ± Standard Deviation for Node Classification Tasks.Model (Author, Year)ZooCoraPubmedCiteseerGCN [12]60.0 ± 1.580.2 ± 0.977.9 ± 1.164.8 ± 1.4GAT [13]48.5 ± 1.277.2 ± 1.077.5 ± 0.862.0 ± 1.3FastGCN [30]37.8 ± 1.678.0 ± 0.874.4 ± 1.363.5 ± 1.5LADIES [31]37.8 ± 1.778.3 ± 0.776.8 ± 1.265.0 ± 1.1Hyper-Conv [27]93.1 ± 0.482.7 ± 0.578.4 ± 0.671.2 ± 0.7LE [27]97.0 ± 0.282.3 ± 0.478.7 ± 0.570.4 ± 0.6HC-GNN [27]85.7 ± 0.579.0 ± 0.678.7 ± 0.465.9 ± 1.0HJRL [29]96.3 ± 0.377.6 ± 0.577.3 ± 0.665.1 ± 1.2HCHG (Ours)97.1 ± 0.279.8 ± 0.679.4 ± 0.566.2 ± 1.0 Average Test Accuracy (%) ± Standard Deviation for Node Classification Tasks. Table 3Average Test Accuracy (%) ± Standard Deviation for Link Prediction Tasks.Model (Author, Year)GridCora-FeatCora-noFeatGCN [12]76.3 ± 1.286.9 ± 0.978.5 ± 1.1GraphSAGE [8]77.5 ± 1.187.0 ± 0.774.1 ± 1.3GIN [14]75.6 ± 1.086.2 ± 0.878.2 ± 1.2G-U-Net [20]70.1 ± 1.590.9 ± 0.677.2 ± 1.0GXN [34]64.2 ± 1.488.9 ± 0.878.1 ± 1.1HC-GNN [27]80.1 ± 1.389.4 ± 0.777.6 ± 1.0HCHG (Ours)87.8 ± 0.982.1 ± 1.278.5 ± 1.1 Average Test Accuracy (%) ± Standard Deviation for Link Prediction Tasks. For the multiview dataset (Table 4), a comparison was made between Hyper-Conv, LADIES, HGNN, HJRL, HGNN+ [35], and HC-HGNN. HCHG showed an improvement of approximately 6% on the NTU2012 dataset compared to other models, while HCHG and HC-GNN showed improvements on the ModelNet40 dataset. The superior performance of HCHG may be attributed to its hierarchical structure, which allows the model to capture the topological information of the graph, i.e., the message propagated from distant nodes in the graph. Moreover, the intermediate and macro-level semantics reflected in the hierarchical structure are encoded through bottom-up, intra-layer, and top-down propagation. On the ModelNet40 dataset, the HCHG model achieved an accuracy of 97%, surpassing other models such as Hyper-Conv, which attained 92%, demonstrating its adaptability to diverse data structures. Table 4Average Test Accuracy (%) ± Standard Deviation for Node Classification Tasks.Model (Author, Year)NTU2012ModelNet40Hyper-Conv [27]79.4 ± 0.891.1 ± 1.2LE [27]83.2 ± 1.694.1 ± 1.3HGNN [35]84.2 ± 1.496.7 ± 1.2HGNN+ [35]84.2 ± 1.596.9 ± 1.1HC-GNN [27]83.3 ± 1.098.1 ± 0.8HJRL [29]86.1 ± 1.395.8 ± 1.4HCHG (ours)90.0 ± 1.197.4 ± 1.3 Average Test Accuracy (%) ± Standard Deviation for Node Classification Tasks. Additionally, with its ability to simultaneously aggregate information from multiple nodes, the hypergraph structure enables better capture of community structure information during the learning process. For example, on the NTU dataset, the HCHG model achieved an accuracy of 90%, a significant improvement compared to other models like HC-GNN, which achieved 85%. The HCHG model demonstrates strong generalization capabilities when handling multimodal data, effectively adapting to various datasets. Its performance across diverse datasets, including Cora, Pubmed, Citeseer, Zoo, NTU, and ModelNet40, surpasses other models. By integrating hypergraph structures and hierarchical information, the HCHG model can more effectively capture complex relationships surrounding nodes. In ablation experiments, the HCHG model consistently yielded favorable results across different numbers of node neighbors, confirming its adaptability to graphs of varying scales. In summary, by combining hypergraph structures and hierarchical information, the HCHG model efficiently captures the intricate associations among multimodal data and achieves outstanding performance in node classification across various datasets. Finally, in the experiments, HC-GNN, which is constructed using GCN, was compared to HCHG to investigate the impact of the hypergraph structure on the experimental results. It was found that the effect varies for different datasets. Not all graph community structures are suitable for the hypergraph structure, and this needs to be considered in different problem scenarios. Table 5 presents the ablation experiments on the multiview data, comparing the classification results for the same nodes under various scenarios of single-view and multiview. The results from the three models in the experiment demonstrated that multiview data carries more information, which is beneficial for classification. Finally, a comparison was made on the number of neighboring nodes using the ModelNet40 and NTU2012 datasets. As shown in Figure 6, the different performances of the HC-GNN and the proposed HCHG model with varying numbers of neighboring nodes are displayed. It can be observed that the HCHG model achieves the best results even with fewer neighboring nodes, indicating that the hypergraph structure can aggregate neighbor information more quickly and accurately. Table 5Average Test Accuracy (%) ± Standard Deviation for Multi-view Data vs. Single-view Data Comparison.ViewHC-GNN [27]HGNN [35]HJRL [29]HCHG (Ours)NTU (mvcnn)73.7 ± 1.169.8 ± 0.969.6 ± 1.270.7 ± 1.0NTU (gvcnn)69.7 ± 0.879.5 ± 0.780.3 ± 1.685.7 ± 1.2NTU (mvc. and gvc.)83.3 ± 1.084.2 ± 1.486.1 ± 1.390.0 ± 0.8ModelNet40 (mvcnn)98.1 ± 1.390.8 ± 1.092.3 ± 1.793.9 ± 1.1ModelNet40 (gvcnn)97.3 ± 1.192.8 ± 0.990.5 ± 1.481.5 ± 1.5ModelNet40 (mvc. and gvc.)98.1 ± 0.896.7 ± 1.295.8 ± 1.497.4 ± 1.3 Average Test Accuracy (%) ± Standard Deviation for Multi-view Data vs. Single-view Data Comparison. The number of neighboring node points affects the classification. 5.3. Visualization The core dataset was visualized to compare the learning abilities of graph-based and hypergraph-based methods intuitively. The t-SNE method was used to visualize the output of the last layer convolution. The results are shown in Figure 7. It can be seen from the results that compared to the graph-based method; the hypergraph-based HCHG method produces recognizable clusters, which qualitatively validates the effectiveness of the proposed method. Visualization of the clustering results. 6. Conclusions This paper proposes a novel Hierarchical message-passing Hypergraph Convolutional (HCHG) model that combines hypergraphs and hierarchical message-passing using a layered community detection algorithm. The HCHG model constructs a hierarchical structure of hypergraph neural networks and performs layered message-passing to handle multi-view data. The model structure of HCHG enables nodes to capture information-rich interactions from distant nodes effectively. Extensive experiments are conducted on five datasets, and the results are analyzed. The experiments demonstrate that HCHG performs excellently in graph-structured dataset classification and 3D model classification tasks. HCHG allows for different choices and customized designs of hierarchical structures, making it easily applicable to various task-specific data. In the future, our goal is to optimize the learning of hypergraph hierarchical structures further and extend the framework to handle complex multimodal data in real-life scenarios. 7. Limitations and Future Work Despite the impressive performance of the HCHG model on multiple datasets, there are still some limitations. Future work will focus on improving the model’s computational efficiency, particularly its scalability in complex networks, and developing more efficient algorithms to reduce computational complexity. Additionally, we plan to optimize the model’s ability to handle complex social hierarchies and nested structural networks. Finally, we will conduct an in-depth analysis of how different community detection methods impact the generation of hierarchical structures, exploring their applicability and limitations in real-world scenarios. Overall, future research will further enhance the performance and broad applicability of the HCHG model. Author Contributions Conceptualization, W.X. and F.X.; methodology, F.X. and W.X.; software, F.X. and W.X.; validation, F.X. and L.S.; formal analysis, Z.F.; resources, F.X.; writing—original draft preparation, F.X. and Z.F.; supervision, Z.F.; funding acquisition, F.X., L.S. and Z.F. All authors have read and agreed to the published version of the manuscript. Institutional Review Board Statement Not applicable. Informed Consent Statement Not applicable. Data Availability Statement The data presented in this study are available in the article. Conflicts of Interest The authors declare no conflict of interest. Funding Statement This research was funded by the Quzhou City Science and Technology Plan Project (2023K263, 2023K265, 2023K045), the General Research Project of the Zhejiang Provincial Department of Education (2023) (Y202353440, Y202353289), and Quzhou Vocational and Technical College university-level scientific research project (QZYZ2305-2023). Footnotes Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. References Associated Data Data Availability Statement The data presented in this study are available in the article.