Exploring Topic Trends in COVID-19 Research Literature using Non-Negative Matrix Factorization
Divya Patel, Vansh Parikh, Om Patel, Agam Shah, Bhaskar Chaudhury · 2025
Read Exploring Topic Trends in COVID-19 Research Literature using Non-Negative Matrix Factorization by Divya Patel, Vansh Parikh, Om Patel, Agam Shah, Bhaskar Chaudhury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18182.txt.
Introduction
Divya Patel and co-authors track how COVID-19 research topics shifted over time in a 2025 study. The pandemic sparked a vast flood of papers that is hard to grasp as a whole. The team used a matrix method that splits a large text set into topics and their weights.
They cleaned the CORD-19 data set with care to keep phrase context, then weighted words by how rare and telling they are. A stability check picked the best topic count for the model. Tracking those topics over time showed how the field's focus moved as the crisis evolved. The map gives later researchers a clear view of what was studied and when.
Catalog record
| CREATOR | Divya Patel, Vansh Parikh, Om Patel, Agam Shah, Bhaskar Chaudhury |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-18182
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring Topic Trends in COVID-19 Research Literature using Non-Negative Matrix Factorization Divya Patel, Vansh Parikh, Om Patel, Agam Shah, Bhaskar Chaudhury Abstract In this work, we apply topic modeling using Non-Negative Matrix Factorization (NMF) on the COVID-19 Open Research Dataset (CORD-19) to uncover the underlying thematic structure and its evolution within the extensive body of COVID-19 research literature. NMF factorizes the document-term matrix into two non-negative matrices, effectively representing the topics and their distribution across the documents. This helps us see how strongly documents relate to topics and how topics relate to words. We describe the complete methodology which involves a series of rigorous pre-processing steps to standardize the available text data while preserving the context of phrases, and subsequently feature extraction using the term frequency-inverse document frequency (tf-idf), which assigns weights to words based on their frequency and rarity in the dataset. To ensure the robustness of our topic model, we conduct a stability analysis. This process assesses the stability scores of the NMF topic model for different numbers of topics, enabling us to select the optimal number of topics for our analysis. Through our analysis, we track the evolution of topics over time within the CORD-19 dataset. Our findings contribute to the understanding of the knowledge structure of the COVID-19 research landscape, providing a valuable resource for future research in this field. 1 Introduction The COVID-19 pandemic has had a profound impact on global health, economies, societies, and politics [ 27 , 37 , 19 ] . In response, a substantial volume of research and evidence has been published, addressing diverse aspects of the pandemic. As highlighted in [ 32 ] , the extensive body of literature on COVID-19 necessitates specialized approaches for literature search, synthesis, and collaboration across a broad network of researchers. Various methodologies have been employed to address this challenge, including text mining techniques for managing the rapidly growing body of COVID-19 research [ 52 ] , the development of COVID-19 knowledge graphs [ 11 , 38 ] , global analyses of early COVID-19 literature to examine research trends and geographic variations [ 47 ] , claim extraction from academic papers on COVID-19 research [ 43 ] , COVID-19 question-answering system [ 40 ] , and scientometric as well as bibliometric studies focused on COVID-19 publications [ 7 , 12 ] . Understanding the evolving trends and topics within the scientific literature related to COVID-19 offers valuable insights into real-world developments and advancements in research. Topic modeling is a powerful tool for uncovering latent structures and trends within large text corpora [ 20 ] . The COVID-19 Open Research Dataset (CORD-19) is a freely available resource of scientific papers on COVID-19 and related historical coronavirus research [ 53 ] . CORD-19 has a rich collection of metadata and structured full text papers. The CORD-19 dataset is particularly useful for researchers interested in performing topic modeling on COVID-19 related research as it provides a vast amount of data for analysis. By applying topic modeling techniques to the CORD-19 dataset, we can identify key themes and trends in scientific research related to COVID-19. Analyzing these trends can provide valuable insights into how the research community responds to the pandemic. Understanding the trends in the CORD-19 dataset can have far-reaching implications. Firstly, it allows us to identify active research areas and emerging topics within the scientific community [ 3 ] . This knowledge can guide future research efforts and resource allocation to address critical areas related to COVID-19. Secondly, by examining the shifts in research trends over time, we can gain insights into how the understanding and priorities surrounding the pandemic have evolved [ 20 ] . This can inform policy-making, healthcare strategies, and decision-making processes in future epidemics. Several studies have successfully applied topic modeling and temporal trend analysis to various domains [ 6 ] , [ 15 ] , [ 42 ] , [ 46 ] . For instance, Greene et al. [ 17 ] employed Non-Negative Matrix Factorization (NMF) to analyze temporal trends in the political agenda of the European Parliament. Similarly, Mishra et al. [ 30 ] conducted a temporal analysis of thematic evolution in computational economics over two decades. Several attempts have been made at topic modeling and trend analysis on scientific literature related to COVID-19. For example, Meaney et al. [ 29 ] applied Non-Negative Matrix Factorization (NMF) temporal topic models to clinical text data to identify the effects of the COVID-19 pandemic on primary healthcare and community health in Toronto, Canada. Agade et al. [ 1 ] explored the non-medical impacts of COVID-19 using Natural Language Processing (NLP). Crane et al. [ 8 ] developed a new approach to identify the main topics within the COVID-19 research corpus. Urru et al. [ 48 ] conducted a topic trend analysis on COVID-19 literature using Structural Topic Modeling (STM). While previous efforts have contributed significantly to the field, there is still scope for enhancement, particularly concerning the size of the datasets, the stability of topic models, and clustering effectiveness. For instance, Meaney et al.’s approach resulted in some highly similar topics, with identical words appearing in the highest frequency lists of multiple topics, making it sometimes difficult to label topics. Agade et al.’s NMF model could have benefited from improved clustering of topics. Crane et al.’s methodology could have been expanded to include more than 10 topics and to utilize full text articles instead of only abstracts of articles from the CORD-19 dataset. Similarly, Urru et al. could have also considered full text articles instead of solely relying on abstracts for the analysis. To the best of our knowledge, very little to no effort has been made in the past to handle, firstly, n-grams while data cleaning, and secondly, provided a numerical stability proof of the applied model for selecting the number of topics associated with COVID-19 literature. Additionally, previous attempts are limited to the use of the most frequent words for representing topics without emphasizing on a relevance metric. This work is aimed at providing a more comprehensive view of the entire corpus while addressing the above mentioned limitations of previous works in this area. The key contributions of this article are as follows: • We utilize a vast dataset of nearly 260,000 documents and apply topic modeling to the full body text of articles, enabling us to capture crucial details and nuances that previous approaches may have overlooked. • We employ meticulous data cleaning techniques and stability checks to ensure the reliability and qualitative interpretability of the generated topic model. • The words associated with each topic are carefully selected using a relevance metric, ensuring that the identified terms are not only frequent but also highly relevant to their respective topics. • We analyze the trends of each topic, providing a comprehensive understanding of the discourse surrounding COVID-19 and its evolution over time. The remainder of the article is organized as follows. In Section 2 , we discuss the process of data preparation, specifically, the data filtering criteria and the data preprocessing steps aimed at preparing the dataset for topic modeling. In Section 3 , we describe the application of NMF for identifying topics in a set of documents. We also