Graph Representation Learning with Massive Unlabeled Data for Rumor Detection

Chaoqun Cui, Caiyan Jia · 2025

Read Graph Representation Learning with Massive Unlabeled Data for Rumor Detection by Chaoqun Cui, Caiyan Jia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04252.txt.

Introduction

Chaoqun Cui and Caiyan Jia detect rumors on social media using graph learning over mostly unlabeled data in a 2025 paper. Rumors spread fast online and harm society and markets. Methods that learn from a rumor's spread pattern through the network work well, but labeled rumor collections are small and costly to build.

Their method learns graph representations from massive unlabeled posts, capturing how messages travel regardless of labels. A small labeled set then fine-tunes the detector. Better generalization is the prize: new rumors rarely match old labeled ones. The approach suits platforms that must screen novel claims daily, where waiting for fresh labels would leave harmful rumors unchecked for too long.

Catalog record

CREATORChaoqun Cui, Caiyan Jia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04252

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Graph Representation Learning with Massive Unlabeled Data for Rumor Detection Chaoqun Cui, Caiyan Jia Abstract With the development of social media, rumors spread quickly, cause great harm to society and economy. Thereby, many effective rumor detection methods have been developed, among which the rumor propagation structure learning based methods are particularly effective compared to other methods. However, the existing methods still suffer from many issues including the difficulty to obtain large-scale labeled rumor datasets, which leads to the low generalization ability and the performance degeneration on new events since rumors are time-critical and usually appear with hot topics or newly emergent events. In order to solve the above problems, in this study, we used large-scale unlabeled topic datasets crawled from the social media platform Weibo and Twitter with claim propagation structure to improve the semantic learning ability of a graph reprentation learing model on various topics. We use three typical graph self-supervised methods, InfoGraph, JOAO and GraphMAE in two commonly used training strategies, to verify the performance of general graph semi-supervised methods in rumor detection tasks. In addition, for alleviating the time and topic difference between unlabeled topic data and rumor data, we also collected a rumor dataset covering a variety of topics over a decade (10-year ago from 2022) from the Weibo rumor-refuting platform. Our experiments show that these general graph self-supervised learning methods outperform previous methods specifically designed for rumor detection tasks and achieve good performance under few-shot conditions, demonstrating the better generalization ability with the help of our massive unlabeled topic dataset. I INTRODUCTION To debunk rumors, many efforts have been made. Among the existing studies, the propagation structure learning methods have made great progress with the least information and the best performance compared with other methods. In these methods, the propagation process of a rumor is built into a tree structure, with the text features of a source post and user comments as the nodes of the tree, and the reply relationship of posts as the edges of the tree (as shown in Figure 1 ). Then, the graph neural networks (GNNs) have succeeded in learning the representations of propagation trees. Typical methods all contain a carefully designed encoder or a training strategy for rumor detection with GNNs. (a) Rumor (b) Non-rumor Fig. 1: Illustration examples of propagation trees. Still, there are many problems in current rumor detection tasks. First, it is difficult to obtain enough labeled data to train a rumor detection model. This is mainly due to the fact that those online social media platforms supervise the release of rumors by users, and many rumors are deleted immediately after they are detected. Due to the lack of large-scale datasets, the current rumor detection methods based on rumor propagation tree structures can only be carried out on several existing common datasets, such as Weibo [ 1 ] , Twitter15 [ 2 ] , Twitter16 [ 2 ] , etc. The deep learning models trained on these small size datasets usually have an overfitting problem. Second, these datasets have serious time and topic difference problems. The data in these datasets are mainly from many years ago, and the internet environment has changed a lot. Using rumor data of long time ago to detect rumors of today will lead to inconsistency between training set and testing set. What’s more, newly emerged rumors are usually related to the current hot topics on the social media. It is a necessary case for making the model have semantic learning ability for recent hot topics. Recently developed self-supervised learning (SSL) is a type of unsupervised learning method, aims to learn a robust feature representation without using explicitly provided labels as inputs, enables a model learning on unlabeled and labeled data, thereby improving the generalization of the model. In our scenario, although labeled rumor data is difficult to obtain, ordinary topics and their comments on a social media platform are easy to get directly, which enables us to build large-scale unlabeled ordinary topic datasets with propagation structures. Based on the SSL techniques, we can improve the generalization performance of a model on a small-scale rumor detection dataset (labeled data) by using large-scale ordinary topics (unlabeled data). Therefore, we firstly introduce general graph SSL methods into rumor detection tasks, following a general semi-supervised graph representation learning framework without any special design for rumor detection. It should be noted that, we are not proposing some new method specific to rumor detection, but rather demonstrating that applying those general graph SSL methods can achieve comparable or even exceed the performance of those methods specifically designed for rumor detection. We constructed two unlabeled ordinary topic datasets (named Unlabeled Weibo, UWeibo 1 1 1 https://anonymous.4open.science/r/UWeibo-D405 and Unlabeled Twitter, UTwitter 2 2 2 https://anonymous.4open.science/r/UTwitter-C882 ) with massive unlabeled claims from Weibo and Twitter platform. UWeibo and UTwitter both contain approximately 200,000 claims. By minimizing the SSL loss of the ordinary topics in unlabeled datasets acquired in the latest time and minimizing the classification loss of the benchmark rumor detection datasets such as Weibo [ 1 ] , Twitter15 [ 2 ] and Twitter16 [ 2 ] , we can improve the semantic learning ability and the generalization performance of a given model. Since benchmark datasets have been collected many years ago, there is a big time gap between them and our unlabeled datasets. We constructed a new labeled binary rumor detection dataset (named Decade Rumor Weibo, DRWeibo 3 3 3 https://anonymous.4open.science/r/DRWeibo-16EB ), including 6,037 claims covering a variety of topics, by integrating the rumor information of the official Weibo rumor-refuting platform 4 4 4 https://service.account.weibo.com/?type=5 over a decade (2012-2022). In our experiments, we select three representative models of different types of graph SSL method including InfoGraph [ 3 ] , JOAO [ 4 ] and GraphMAE [ 5 ] . We adopt two commonly used training strategies, the standard pre-training and fine-tuning strategy which pre-trains on an unlabeled dataset with the SSL loss and then fine-tunes on a labeled dataset with the classification loss, the semi-supervised training strategy where SSL loss is used as the regularization term of classification loss. In addition, with the help of unlabeled data, these methods can achieve a considerable performance even with a few labeled samples. This proves that large-scale unlabeled datasets are beneficial to alleviate the overfitting and the time and topic difference problems. In summary, the main contributions of this study are as follows. • We use general graph SSL methods in rumor detection. Large-scale unlabeled dataset can be helpful for improving the models’ generalization performance. • We published two large-scale unlabeled topic datasets and a labeled rumor dataset, which may be helpful for rumor detection research. • The experimental results show that general graph SSL methods can outperform the methods specially designed for rumor detection. • Our few-shot experiments show that with the help of unlabeled data, the graph SSL methods can achieve good performance under few-shot scenario. II RELATED WORK In this section, we review the related works on rumor detection and graph SSL. II-A Rumor Detection Early studies in rumor detection used traditional classification with hand-crafted features [ 6 , 7 ] . Deep learning’s success has spawned numerous methods that significantly enhance rumor detection performance. These methods

Read the complete text