Quantifying correlations between information overload and fake news during COVID-19 pandemic: a Reddit study with BERT model approach

Jan Rawa, Julian Sienkiewicz · 2026

Read Quantifying correlations between information overload and fake news during COVID-19 pandemic: a Reddit study with BERT model approach by Jan Rawa, Julian Sienkiewicz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00496.txt.

Introduction

Jan Rawa and Julian Sienkiewicz look for an automatic way to track information overload in social media, and test it on Reddit during the COVID-19 pandemic. Overload is known to tire readers and push them toward avoiding news, which can help false posts spread. Yet few tools can measure overload in very large datasets.

Their candidate measure uses topic modeling: a language model groups posts into topics, and a Gini index summarizes how unevenly attention spreads across those topics. Across Reddit communities about the pandemic, that index correlated significantly with the share of posts a fake-news classifier flagged as false. Within single communities, though, the results were mixed. The authors present the measure as a promising global signal rather than a settled local tool.

Catalog record

CREATORJan Rawa, Julian Sienkiewicz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-00496

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quantifying correlations between information overload and fake news during COVID-19 pandemic: a Reddit study with BERT model approach Jan Rawa, Julian Sienkiewicz Abstract Information overload (IOL) is a well-known and devastating phenomenon that alters the performance of carrying out all types of tasks. It has been shown that in the media space, IOL can contribute to news fatigue and news avoidance, which often leads to the proliferation of fake news posts on social networks. However, there is a lack of automatic methods that can be used to track IOL in large datasets. In this study, we investigate whether the Gini index calculated from the distribution of topics obtained via the BERTopic model can be considered a proxy for IOL. We test our assumptions on a set of Reddit communities related to the COVID-19 pandemic and obtain a significant global correlation between the Gini index and the fraction of fake news detected by the FakeBERT classifier. However, at the community level, the correlation analysis results are ambiguous. Introduction While the effortless availability of information revolutionized our lives in recent years, another major outcome of this information revolution—realized via rapid technological advances and increased global digital connectivity — is the increasingly large volume of information encountered daily. ChatGPT, vaccines against COVID-19 and the war in Ukraine are very different examples of topics still generating masses of information from multiple sources, often non-experts. Through all sources the individual has a constant flow of personal and professional information. Presumably, some is retained, some is used, and some is forwarded without being fully read. This “dark side” of information [ 1 ] entails the abundance of data beyond one’s capacity to process it, leading to the information overload (IOL) problem. This issue had troubled humanity long before print was invented [ 2 ] and has been examined from different points of view, ranging from psychology [ 3 ] through business and management sciences [ 4 ] to journalism [ 5 ] . Nevertheless, the last 20 years have seen the penetration of social media by IOL, mainly due to rapid and omnipotent access to the Internet, allowing users to send billions of comments and messages every day. IOL negatively impacts individuals, and, by cascading effects, makes social circles and whole societies vulnerable and lately has been compared to environmental pollution [ 6 ] .. For example, of particular concern is the need to distinguish genuine news from fake news and manipulated messages. Social media data has been used widely in studying information overload and its consequences [ 7 , 8 , 9 , 10 , 11 , 12 , 13 ] . It is much easier to understand information overload intuitively than to actually define it. There are at least seven recognized definitions of information overload used in different studies [ 14 ] , probably one of the most useful is the one delivered by the cognitive load theory suggesting that the human working memory is limited to approximately seven units of information [ 15 ] . In this context, information overload occurs when the amount of information exceeds the working memory of the person receiving it [ 16 , 17 ] therefore suggesting a characteristic information capacity (budget). Another stylized fact connected to IOL is the relation between the performance or decision making and the information load. It is rather intuitive to assume that the goal function is low either when one receives no information or when one is flooded with data. In result, such a relation can take an “inverted U shape” [ 4 ] suggesting the existence of an optimal level of information load needed for best performance. This phenomenon was observed in the Usenet [ 18 ] as well as Internet Rely Channels (IRC) discussions [ 19 ] and lately in the case of Twitch video-streaming platform [ 7 ] . Analysis of Twitch detects information overload by measuring number of messages posted by commenters. Average user’s activity starts to decrease above 30 messages per second posted in the stream chat, above which information overload conditions are present [ 7 ] . In all these cases user activity reveals an non-monotonic behavior with respect to the number of messages present in the system. A separate, important social phenomenon that haunts current media space is the spread of misinformation [ 20 ] . Dissemination of false information has negative effect on public decision-making in public health [ 21 , 22 ] , politics [ 23 ] , climate change [ 24 ] . Especially during the COVID-19 pandemic, spread of anti-vaccine, anti-mask etc. narratives decreased the adherence to government mandates and recommendations, which could have had a negative impact on disease spread prevention [ 25 , 26 ] . This study is motivated by observations linking information overload with fake news [ 27 , 28 ] . In particular it has been suggested that IOL is connected with news fatigue that in turn leads to difficulties in processing the acquired information. The last issue can be associated with news avoidance [ 29 , 30 ] and in effect increased belief in COVID-19 misinformation [ 27 ] . On the other hand it has also been observed that IOL-induced psychological strain could increase likelihood of fake news sharing [ 28 ] . However, the mentioned studies relied on surveys conducted among the users of social media platforms in Germany [ 27 ] and Singapore [ 28 ] . Although online questionnaires can be regarded as the most reliable source of information, as they allow for asking very specific questions, instead of relying on a proxy, they are cost- and time-consuming and rarely repeated over time and different social media platforms. Therefore we stress the need to create tools that measure the correlation between information overload and fake news in large sets of data and can be applied instantly and online. While there are several automatic or semi-automatic approaches to account for fake news or misinformation [ 20 ] (i.e., knowledge-based, style-based, propagation-based, source-based), currently we lack targeted methods to track information overload. This study aims at (1) proposing a method to quantify information overload in large sets of online data, (2) examining a relation between IOL and fake news rate in such data. To follow these goals we first we describe our dataset (a large sample from the Reddit platform) and the selected threads we used in our analysis, then we give details about applied methods to detect fake news based on the the FakeBERT classifier. Following we present our original approach for quantifying information overload on the basis of topic analysis via BERTopic and Gini index. Finally we present results that reveal the level of correlations between IOL measure and fake news fraction. Methods Community name # of posts Community name # of posts Community name # of posts Coronavirus 440\,579 COVID19positive 93\,576 CoronavirusCirclejerk 69\,366 CoronavirusDownunder 60\,543 CoronavirusUS 59\,289 COVID19 52\,005 CoronavirusUK 51\,127 covidlonghaulers 47\,434 CoronavirusMemes 46\,314 CovIdiots 38\,076 CovidVaccinated 30\,648 ChurchOfCOVID 28\,377 CanadaCoronavirus 26\,164 COVID19_support 17\,388 COVID 15\,908 CoronavirusCA 13\,108 FloridaCoronavirus 12\,577 CoronavirusWA 12\,102 CoronavirusMa 11\,152 CoronaVirusTX 10\,599 CoronavirusRecession 9662 CoronavirusFOS 9425 CoronavirusMichigan 9256 Coronavirus_NZ 8831 CoronavirusColorado 8173 CoronavirusGA 7944 nycCoronavirus 7886 Coronaviruslouisiana 7598 CoronavirusCanada 7497 Coronavirus_Ireland 6699 CoronavirusIllinois 6394 CoronavirusAZ

Read the complete text