LLM Reasoning for Cold-Start Item Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06
Shijun Li, Yu Wang, Jin Wang, Ying Li, Joydeep Ghosh, Anne Cocos · 2025
Read LLM Reasoning for Cold-Start Item Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 by Shijun Li, Yu Wang, Jin Wang, Ying Li, Joydeep Ghosh, Anne Cocos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18261.txt.
Introduction
Shijun Li, Yu Wang, Jin Wang, Ying Li, Joydeep Ghosh, and Anne Cocos use language model reasoning for the cold-start problem in recommendations. The problem is how to suggest items that are new or rarely touched, where the usual method of learning from shared user history has almost nothing to work with. Their setting is the Netflix catalogue, and their method leans on the model's built-in knowledge and reasoning to infer what a user might like.
The team systematically compares three training routes: supervised fine-tuning, reinforcement learning fine-tuning, and a hybrid of both. Experiments on real-world data judge which route lifts recommendation quality most for cold items. The study gives platform teams a practical comparison for a problem that every growing catalogue faces whenever fresh content arrives.
Catalog record
| CREATOR | Shijun Li, Yu Wang, Jin Wang, Ying Li, Joydeep Ghosh, Anne Cocos |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-18261
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM Reasoning for Cold-Start Item Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 Shijun Li, Yu Wang, Jin Wang, Ying Li, Joydeep Ghosh, Anne Cocos Abstract . Large Language Models (LLMs) have shown significant potential for improving recommendation systems through their inherent reasoning capabilities and extensive knowledge base. Yet, existing studies predominantly address warm-start scenarios with abundant user-item interaction data, leaving the more challenging cold-start scenarios, where sparse interactions hinder traditional collaborative filtering methods, underexplored. To address this limitation, we propose novel reasoning strategies designed for cold-start item recommendations within the Netflix domain. Our method utilizes the advanced reasoning capabilities of LLMs to effectively infer user preferences, particularly for newly introduced or rarely interacted items. We systematically evaluate supervised fine-tuning, reinforcement learning-based fine-tuning, and hybrid approaches that combine both methods to optimize recommendation performance. Extensive experiments on real-world data demonstrate significant improvements in both methodological efficacy and practical performance in cold-start recommendation contexts. Remarkably, our reasoning-based fine-tuned models outperform Netflix’s production ranking model by up to 8% in certain cases. 1. Introduction The application of Large Language Models (LLMs) to recommendation systems has emerged as a promising research direction, drawing significant interest from both academia and industry ( 1 ; 3 ; 8 ) . Recent studies highlight the potential of LLM reasoning to further enhance recommendation quality ( 6 ; 4 ) . However, these approaches have mainly been evaluated in warm-start scenarios with sufficient historical interactions available for the recommended items. In practical settings, cold-start scenarios pose a significant challenge for recommender systems, as classic collaborative filtering methods typically underperform due to limited interactions. In contrast, LLMs which equipped from extensive world knowledge and advanced reasoning abilities, are particularly well-positioned to address these challenges by inferring user preferences for new or infrequently interacted items. Despite this potential, current research on LLM for recommendation largely focuses on direct reasoning or reasoning adjusted by supervised fine-tuning, leaving reinforcement learning-based strategies, which are typically considered as more promising and flexible, relatively underexplored. To address these gaps, we develop and validate novel reasoning strategies for cold-start item recommendation within the Netflix domain. We first assess the direct performance of the proposed approaches, and then systematically evaluate supervised fine-tuning, reinforcement learning-based methods, and their combined efficacy. Through extensive experiments on real-world data, we demonstrate that LLM reasoning delivers significantly superior performance in cold-start recommendation scenarios, where they can outperform Netflix’s production ranking model by 8% in certain cases. In conclusion, our contributions can be summarized as follows: • We propose novel reasoning strategies for cold-start item recommendation. While previous work has primarily focused on warm-start scenarios with sufficient user-item interactions, our approach leverages the inherent reasoning capabilities and extensive world knowledge of LLMs to better infer user preferences toward new or underrepresented items where classic collaborative filtering methods struggle due to limited interaction data. • We conduct a comprehensive investigation of fine-tuning methodologies that goes beyond existing approaches by systematically examining both supervised fine-tuning and reinforcement learning fine-tuning strategies, as well as their combinations. This represents a significant advancement over current research that has largely focused on direct reasoning approaches or supervised methods alone, providing valuable insights into the comparative and combined effectiveness of different fine-tuning paradigms for LLM-powered recommendation systems. Figure 1. Workflow of Structural Reasoning. 2. Methodology 2.1. Problem Definition We focus on the scenario of cold-start item recommendation. Specifically, we take the cold-start items as those launched after the latest interaction of all user historical interactions used in our experiments. Also, the launch of cold-start items is later than the training time of the base LLMs we used. We evaluate all methods on the re-ranking task. Specifically, we selected the top 40 titles from the ranking model used in the production environment at Netflix. We then further sample 10 cold start titles including the target title, to form a total of 50 candidates. The final task is to re-rank these candidates for recommendation. 2.2. Reasoning for Recommendation In this project, we proposed two reasoning strategies: Structural Reasoning and a variant of the Self-Consistency approach, targeting to infer users’ preferences towards cold-start items with minimal prior knowledge. Both strategies are designed to decompose user interaction history into multiple reasoning paths, enabling a more accurate analysis of user preferences towards cold-start items. 2.2.1. Structural Reasoning Structural Reasoning instructs the LLM to systematically decompose structural information from a user’s interaction history (e.g., watching history related to preference factors) into distinct reasoning paths. Then the model evaluates compatibility between each path and candidate items by computing match scores, which are then aggregated using weights based on factors like path prominence and recency. This enables the LLM to recommend the item with the highest overall score. In summary, Structural Reasoning consists of three main steps: Reasoning Paths Construction. We first construct a graph of reasoning paths from the user’s viewing history and provide it as an exemplar to guide the LLM in automatically generating similar structures during inference. Specifically, as illustrated in Figure 1 .1, we construct three reasoning paths based on the user’s preferred actors, movie genres, and directors. During inference, we prompt the LLM to identify the most significant factors influencing the user’s current preferences, then construct a reasoning path for each factor by sequentially extracting relevant events from the user’s interaction history. Factor Match Calculation. Second, for each candidate item, we instruct the LLM to compute a match score with respect to each constructed reasoning path. Specifically, we provide relevant candidate attributes, such as title, launch date, and genre, to guide the LLM in determining alignment and subsequently computing match scores against corresponding reasoning paths. As the case in Figure 1 , for a candidate that is an action movie starring Anna and directed by Tom, the reasoning path derived from the user’s viewing history of movies starring Anna should receive the highest match score. Importance Weights and Aggregation. Finally, we instruct the LLM to assign importance weights to each reasoning path by explicitly considering factors such as factor prominence, action type, and recency. Using these importance weights, the LLM aggregates match scores for each candidate item, computing a weighted sum to generate an overall relevance score. Ultimately, the LLM ranks all candidate titles based on these aggregated scores, thereby producing the final recommendation list. 2.2.2. Soft Self-Consistency The second strategy we proposed adapts the Self-Consistency approach ( 2 ) , which generates multiple parallel reasoning paths and aggregates them for final recommendations. In our implementation, the LLM autonomously constructs diverse reasoning paths based on key aspects of user preferences, deciding which aspects to prioritize. These paths are then synthesized into a final decision. However, rather than employing the classic self-consistency method’s strict majority voting mechanism, we employ a soft summarization strategy, called Soft Self-Consistency, that allows the model to integrate and reconcile its reasoning paths before reaching a conclusion. This modification provides greater autonomy in leveraging reasoning capabilities and can yield performance gains over rigid aggregation policies that risk overlooking nuanced interactions between reasoning perspectives. It is noteworthy that our Soft Self-Consistency approach can be viewed as the simplest variant of the proposed