Addressing Cold Start For next-article Recommendation DOI: TBD Conference: TBD; RecSys ’25. ; CCS: Information systems Recommender systems

Omar Elgohary, Trenton Marple, Nathan Jorgenson · 2025

Read Addressing Cold Start For next-article Recommendation DOI: TBD Conference: TBD; RecSys ’25. ; CCS: Information systems Recommender systems by Omar Elgohary, Trenton Marple, Nathan Jorgenson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01036.txt.

Introduction

Omar Elgohary and co-authors adapt a music recommender to news in a 2025 paper. Cold start is the hard case: new articles have no reading history. The team reworks a model that maps content features into the same space as reader taste, now reading news as last-article, next-article pairs from a public click dataset.

Text features came from word counts and from a language model. The word-count version proved more accurate and robust than two baseline recommenders in cold-start tests. The authors also judge that the model, barely modified, still fits news poorly in some ways. Readers get an honest replication with a working pipeline.

Catalog record

CREATOROmar Elgohary, Trenton Marple, Nathan Jorgenson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01036

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Addressing Cold Start For next-article Recommendation DOI: TBD Conference: TBD; RecSys ’25. ; CCS: Information systems Recommender systems Omar Elgohary, Trenton Marple, Nathan Jorgenson Abstract . This replication study modifies ALMM, the Adaptive Linear Mapping Model constructed for the next song recommendation, to the news recommendation problem on the MIND dataset. The original version of ALMM computes latent representations for users, last-time items, and current items in a tensor factorization structure and learns a linear mapping from content features to latent item vectors. Our replication aims to improve recommendation performance in cold-start scenarios by restructuring this model to sequential news click behavior, viewing consecutively read articles as (last news, next news) tuples. Instead of the original audio features, we apply BERT and a TF-IDF (Term Frequency-Inverse Document Frequency) to news titles and abstracts to extract token contextualized representations and align them with triplet-based user reading patterns. We also propose a reproducibly thorough pre-processing pipeline combining news filtering and feature integrity validation. Our implementation of ALMM with TF-IDF shows relatively improved recommendation accuracy and robustness over Forbes and Oord baseline models in the cold-start scenario. We demonstrate that ALMM in a minimally modified state is not suitable for next news recommendation. 1. Introduction Automated content recommendation is a sophisticated attribute of advanced information systems that assists users in identifying articles they are interested in, which are dynamically updated. Most traditional collaborative filtering approaches exploit user preferences through social connections but suffer from cold start limitations, especially when content that is newly available or infrequently engaged is proposed, such as in ( Hu et al. 2008 ; Koren et al. 2009 ) . Content based approaches partially mitigate the problem considering article attributes, however, they do not capture fully user behavior’s sequential and contextual aspects as suggested in ( Wang and Wang 2014 ) . To solve the problem, we replicate and adapt the ALMM developed for next-song recommendation ( Chou et al. 2016 ) to news recommendation. ALMM performs tensor factorization while integrating cold-start capable dynamically adjusted mapping of content-feature representative items with their latent descriptions. In the original work, song transition was sequentially modeled with audio features. In our case, we change the data model to sequential news reading data from MIND dataset ( Wu et al. 2020 ) , where users’ impressions are regarded as a time-ordered sequence of interacting with articles. Another aspect of our approach is using contextualized language representations from BERT ( Devlin et al. 2019 ) and TF-IDF in place of audio features. These embeddings facilitate more expressive modeling of article content, which enhances generalization for unseen news. We improve the triplet generation scheme using user sequential clicks (last_news, next_news), estimating missing article publication dates, and ensuring cross-component data consistency. Our findings demonstrate that TF-IDF-augmented ALMM yields better recommendation quality than Forbes and Oord specifically in cold-start performance. Though, general scores for all algorithms were undesirable. 2. Dataset Construction We build our next-article recommendation dataset using the Microsoft News Dataset (MIND) ( Wu et al. 2020 ) , a large-scale benchmark for personalized news recommendation. MIND contains rich textual metadata (title, abstract, entities) and user behavior logs in the form of impression sessions. 2.1. Preprocessing and Filtering We first process the news.tsv and behaviors.tsv files. Articles containing duplicate or missing IDs have been removed, and all URLs are deleted because of being frequently dead. Each article is uniquely identified by its news ID, which corresponds to the stored title and abstract. In behaviors.tsv , we obtain click streams for every user and reorganize them into time-aligned reading sessions. In order to maintain transition quality, we only keep consecutive pairs of articles where the time interval between the two clicks does not exceed half an hour, as in prior work ( Chou et al. 2016 ) . Additionally, quite short sessions and self-transitions are eliminated. This creates a transition-inclusion filtered dataset in which each user-article interaction is described as a triplet: user u , last-clicked article i , and next-clicked article j . 2.2. Triplet Dataset Generation We create training data in the form of triplets (u,i,j) such that u corresponds to the User ID, i corresponds to the previous article read which is an input to the model, and j corresponds to the next article that was clicked on. These are extracted from filtered click sequences using a sliding window and within certain temporal bounds, self-transitions are removed. Instead of applying the same score of confidence to all transitions, we assign a score based on the specific transition for article i and j . Each article is first assigned the base confidence of 1.0. Then for every user specific move of going from i to j in document is seen once, this raises the document specific confidence by 0.1. We preferred this new confidence configuration as it focuses on repeated article rotations happening with all users unlike single user based one in the original ALMM paper. This is mostly due to a domain difference: Music listeners often play the same exact song multiple times while news users usually read an article once. We devise train/test splits so that test triplets have at least one article which has not been trained on, enabling evaluation in cold start scenarios. 2.3. Feature Extraction (1) TF-IDF Embeddings: We first tokenize and clean each article’s title and abstract, and apply standard TF-IDF vectorization over the texts. The resulting sparse vectors capture surface-level term importance and are used as input to content-based baselines for comparison. (2) BERT Embeddings: For richer semantic representation, we use a pre-trained BERT encoder. Each article’s title and abstract are concatenated, tokenized, and passed through BERT. We extract the final hidden states and compute a mean-pooled vector over the token embeddings. This yields a dense contextualized vector \mathbf{A}_{i}\in\mathbb{R}^{m} for article i , which serves as input for the ALMM and content-aware matrix factorization models. 3. Next-Article Recommendation 3.1. Formalization The goal of next-article recommendation is to select and recommend a relevant news article to the user based on their latest click. Let \mathcal{U}=\{u_{1},u_{2},...,u_{|\mathcal{U}|}\} be the user set and \mathcal{N}=\{n_{1},n_{2},...,n_{|\mathcal{N}|}\} be the set of news articles. For each user u , there is a reading sequence R^{u}=(r^{u}_{1},r^{u}_{2},...,r^{u}_{T}) , where each r^{u}_{t}\in\mathcal{N} is a news article that was clicked at time t . To model sequential patterns, for each user reading log, we form transition pairs (r^{u}_{t-1},r^{u}_{t}) and filter out self-transitions, taking into account that the time interval between two consecutive clicks is no greater than thirty minutes. This creates a transition tensor P\in\mathbb{R}^{|\mathcal{U}|\times|\mathcal{N}|\times|\mathcal{N}|} , where P^{u}_{i,j} shows the count of observed transitions, for user u , from article n_{i} to n_{j} . We build a user-centric transition tensor that encodes pairwise article transitions based on user’s click streams. Our method, in contrast to the ALMM formulation ( Chou et al. 2016 ) which captures transitions on grouped songs in sequential playlists, focuses on individual article click timestamps and strict order. A transition (i,j) is counted only if it satisfies the following criteria: • Article i was clicked immediately before article j , • The time interval between the two clicks is less than or equal to 30 minutes, • The articles are distinct: i\neq j . The formal

Read the complete text