Real-time News Story Identification
Tadej Škvorc, Nikola Ivačič, Sebastjan Hribar, Marko Robnik-Šikonja · 2025
Read Real-time News Story Identification by Tadej Škvorc, Nikola Ivačič, Sebastjan Hribar, Marko Robnik-Šikonja (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08272.txt.
Introduction
Tadej Skvorc and co-authors identify news stories in real time in a 2025 paper. News sites group articles into stories about single events. Monitoring systems must assign each new article as it appears. General topic labels are too coarse for event-level grouping.
The approach mixes text representations, clustering, and online topic modeling. Named entities and event cues anchor the representations. Three online methods were adapted for story discovery. Evaluation used a month of Slovene media coverage. Human judges rated the resulting groupings as sensible. Articles are assigned on arrival, not in batches. That streaming requirement shapes every design choice. The authors combine methods rather than betting on one. Event, place, and person signals outweigh raw text similarity. Newsrooms and monitoring firms are the intended users. The work shows real-time story tracking is practical.
Catalog record
| CREATOR | Tadej Škvorc, Nikola Ivačič, Sebastjan Hribar, Marko Robnik-Šikonja |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08272
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Real-time News Story Identification Tadej Škvorc, Nikola Ivačič, Sebastjan Hribar, Marko Robnik-Šikonja Abstract To improve the reading experience, many news sites organize news into topical collections, called stories. In this work, we present an approach for implementing real-time story identification for a news monitoring system that automatically collects news articles as they appear online and processes them in various ways. Story identification aims to assign each news article to a specific story that the article is covering. The process is similar to text clustering and topic modeling, but requires that articles be grouped based on particular events, places, and people, rather than general text similarity (as in clustering) or general (predefined) topics (as in topic modeling). We present an approach to story identification that is capable of functioning in real time, assigning articles to stories as they are published online. In the proposed approach, we combine text representation techniques, clustering algorithms, and online topic modeling methods. We combine various text representation methods to extract specific events and named entities necessary for story identification, showing that a mixture of online topic-modeling approaches such as BERTopic, DBStream, and TextClust can be adapted for story discovery. We evaluate our approach on a news dataset from Slovene media covering a period of 1 month. We show that our real-time approach produces sensible results as judged by human evaluators. 1 Introduction The ever-increasing amount of global news presents an overwhelming challenge for individuals and organizations striving to keep abreast of relevant information. The sheer volume of unstructured text data makes it nearly impossible for users to consume and comprehend all the information pertinent to their interests. News monitoring and analysis systems can help us by employing advanced algorithms to address the problems of size and opinionated views, as well as misinformation. Sensible grouping of news, such as identifying common reported events or clustering, allows users to quickly glean essential information from a set of articles, saving time and reducing cognitive load. Figure 1: The distribution of languages in all samples (Serbian, Slovene, Bosnian, Macedonian, Croatian, English, Albanian, Russian, and Hungarian). The overall targeted news monitoring system archive comprises over 85 million articles from eight countries (Serbia, Slovenia, Bosnia and Herzegovina, Croatia, Macedonia, Montenegro, Kosovo, and Albania) in more than seven languages (see Figure 1 ) spanning over twenty years. The current system performs dynamic clustering over short time intervals, leveraging text embeddings generated by an information retrieval Transformer encoder. This process operates on result sets defined by client-selected queries and filters. While this approach offers advantages, such as the ability to cluster a specific subset, adjust clustering thresholds per query, and choose between different embedding models, it also presents notable limitations. Specifically, the resulting clusters are unstable over time and are constrained by the size of the retrieved result set, resulting in inconsistent and arbitrary clustering outcomes. Our objective is to develop a method for global, archive-wide clustering that remains independent of individual client searches (i.e., static concerning query context), while continuously expanding over time as new articles are added to the archive. To address this problem, our approach is anchored in clustering of articles based on reported events, a process we refer to as story identification. We model this as the task of identifying news stories that persist over time and grouping related articles accordingly. This approach enables us to construct a coherent, high-level view of the extensive archive, supporting meaningful analysis of the development and impact of specific events. The main contribution of our work is the creation of a story identification system that combines different text representation methods, named entity recognition, summarization, hierarchical clustering, and topic modeling to identify news stories in real time, as they appear in the targeted media monitoring system. Additionally, we present a comprehensive evaluation showing how different components of the story identification system impact the results. The structure of our paper is as follows. In Section 2 , we present an overview of past work related to clustering, topic modeling, and text representation methods. Section 3 contains the description of the dataset used for our research, as well as an overview of several problems that make this task more challenging than general text clustering or classification. We follow with an overview of the developed methodology in Section 4 . We first present our approach to optimizing text representation for story identification, followed by an overview of our approach to online clustering. Section 5 contains the evaluation of our approach, comparing different components of our algorithm. We conclude our work in Section 6 and present directions for further work. 2 Related work We split the overview of the related work into four subsections, presented below. We present related work on clustering, topic modeling, and general text representations. We end the section with a discussion on the problems of existing approaches for story identification. 2.1 Clustering and online clustering Although not an established task in the field of natural language processing, story identification can be viewed as a subset of text clustering. Text clustering aims to generate clusters that contain similar texts, while story identification aims to generate clusters of articles addressing the same news story. Many general-purpose approaches for clustering have been proposed in the past, generally aiming to minimize differences between texts that occur within the same cluster and maximize distances of texts from different clusters. Most often, this is tackled through iterative minimization algorithms such as K-means [ 16 ] , which minimizes inter-cluster variance, or density-based algorithms such as DBSCAN [ 10 ] and MEAN SHIFT [ 8 ] . More complex approaches can also be used, such as modeling clusters using Gaussian mixtures [ 27 ] , which allow for more complex cluster representations (i.e., modeling them as Gaussian distributions rather than simple cluster centers). While such algorithms may be employed for general story identification, our use case requires identifying stories in real-time, as the articles are published. General clustering approaches require the entire dataset to be present in advance, making them incompatible with this task. Instead, several approaches capable of online clustering have been proposed. For example, STREAMKmeans [ 18 ] modifies the original k-means algorithm to perform clustering iteratively, DBSTREAM [ 13 ] performs online clustering using a shared density graph in combination with a variant of the DBSCAN algorithm, and CluStream [ 2 ] first groups points into micro clusters that are merged into larger clusters using k-means after a set number of points have been processed. However, such approaches are generally not fine-tuned for story identification and may not take into account important information (e.g., the fact that articles from the same story need to refer specifically to the same events, people, and places). 2.2 Story identification and topic modeling Story identification is a more specific task than general-purpose clustering. Instead of clustering texts with similar content, we want to identify texts that describe the same news story or event. This means that two texts with relatively similar content can describe a completely different event. For example, a news article describing a sports event taking place in Paris would probably have similar content to one describing a sports event in Berlin, even though the event is different. Likewise, articles describing