Learning User Interests via Reasoning and Distillation for Cross-Domain News Recommendation Mengdan Zhu, Yufan Zhao, Tao Di, Yulan Yan, Liang Zhao Abstract News recommendation plays a critical role in online news platforms by helping users discover relevant content. Cross-domain news recommendation further requires inferring user’s underlying information needs from heterogeneous signals that often extend beyond direct news consumption. A key challenge lies in moving beyond surface-level behaviors to capture deeper, reusable user interests while maintaining scalability in large-scale production systems. In this paper, we present a reinforcement learning framework that trains large language models to generate high-quality lists of interest-driven news search queries from cross-domain user signals. We formulate query-list generation as a policy optimization problem and employ GRPO with multiple reward signals. We systematically study two compute dimensions: inference-time sampling and model capacity, and empirically observe consistent improvements with increased compute that exhibit scaling-like behavior. Finally, we perform on-policy distillation to transfer the learned policy from a large, compute-intensive teacher to a compact student model suitable for scalable deployment. Extensive offline experiments, ablation studies and large-scale online A/B tests in a production news recommendation system demonstrate consistent gains in both interest modeling quality and downstream recommendation performance. 1 Introduction Personalized news recommendation plays a central role in modern online news platforms 1 ; 10 by helping users efficiently discover relevant content under severe information overload. Large-scale news services stream tens of thousands of articles from diverse sources every day, far exceeding what users can manually consume. As a result, effective recommendation systems are critical for matching user interests, improving engagement, and enabling scalable content discovery in online news ecosystems 8 . Recent advances in large language models (LLMs) have further expanded the design space of recommendation systems 22 . Owing to their strong reasoning ability 20 , rich world knowledge, and semantic generalization capacity 17 , LLMs offer new opportunities to move beyond traditional collaborative filtering and embedding-based approaches that primarily rely on historical interaction similarity. In contrast, LLMs can reason over heterogeneous user signals and generate semantically meaningful representations that capture higher-level interests, enabling more flexible, diverse, and potentially long-term-oriented recommendation strategies 25 . The limitations of the traditional embedding-based cross-domain recommendation methods are that they are hard to learn reasonable and personalized embeddings for all users 27 , and collaborative filtering methods often fail to capture deeper sequential signals 4 . However, cross-domain recommendation demands deeper user understanding beyond shallow behavior patterns. Our approach that leverages LLMs to reason over heterogeneous user signals could effectively addresses these limitations. We reformulate cross-domain interest discovery as a query-list generation problem for news recommendation. Given heterogeneous user signals from multiple user interaction domains, we train an instruction-tuned LLM to generate lists of news search queries that represent reusable user interests. The model is optimized using Group Relative Policy Optimization (GRPO) with five reward signals, including retrieval alignment, interest coverage, query specificity, intra-list diversity, and structural validity. We systematically study the effect of additional compute along two dimensions: inference-time sampling and model capacity . Increasing either dimension consistently improves interest quality and downstream retrieval performance, exhibiting clear scaling-like behavior. To make the approach practical for online serving, we further apply on-policy distillation. This transfers the learned policy from a large teacher model to a compact student model with low latency and high throughput. This work makes the following contributions: • Scaling properties of LLMs for interest modeling under noisy signals. We show that, when trained with multiple product-aligned reward models, our models can effectively infer reusable user interests from heterogeneous and noisy cross-domain signals. Moreover, both increasing model capacity (space scaling) and inference-time sampling (time scaling) lead to consistent, scaling-law–like improvements in interest quality and downstream retrieval performance. • On-policy distillation for scalable interest generation. We propose an on-policy distillation framework that transfers the learned, compute-intensive LLM policy into a compact student model that performs lightweight reasoning to generate query lists. The distilled model preserves most of the interest modeling and retrieval gains while enabling low-latency, high-throughput serving in production systems. • Validation on offline evaluations and online A/B tests. We demonstrate the effectiveness of the proposed approach through comprehensive offline evaluation and controlled online A/B tests, showing consistent improvements in interest modeling quality and downstream recommendation performance. To the best of our knowledge, this work represents a pioneering deployment of a reasoning-driven reinforcement learning framework for user interest modeling in a large-scale commercial news recommendation system. 2 Related Work User Interest Modeling and Sequential Recommendation. User interest modeling typically learn user preferences from historical interactions such as clicks, queries, or browsing histories. The field has transitioned from traditional collaborative filtering to deep sequential modeling. Early approaches utilized RNN architectures 14 ; 5 to capture temporal patterns. The adoption of self-attention mechanisms marked a significant shift, enabling models to capture long-range item dependencies 9 ; 18 . In the context of news recommendation, models like NRHUB 21 and hierarchical frameworks 16 were developed to capture multi-level user interests. For large-scale industrial graphs, PinSage 15 demonstrated the power of random-walk graph convolutions. More recently, the HSTU 24 framework, have scaled these concepts to trillion-parameter generative transducers for industry-scale recommendations. LLMs for RecSys. LLMs have recently been explored for recommendation systems (RecSys) 22 . LLMs for RecSys can be categorized into non-generative and generative paradigms 19 . Non-generative approaches keep the conventional "score-then-rank" structure but use LLMs for feature engineering 23 , or representation learning 6 . Generative approaches instead generate recommendations directly. This paradigm typically involves prompting, which utilizes prompt engineering to leverage the LLM’s zero-shot or few-shot capabilities 7 , and fine-tuning, where models are fine-tuned on recommendation datasets to align their generative outputs with user preferences 11 . Unlike traditional fine-tuning, our work explores using GRPO to optimize the reasoning trajectories for a query-list deep user interest generation in recommendation systems. 3 System Overview Figure 1: Overview of the Reasoning-driven User Interest Generation for News Search Queries (Teacher Model) and On-policy Distillation for Online Serving (Student Model) in the large-scale RecSys. Our system operates on multiple streams of user behavioral data collected across search logs, click logs, browsing interactions, and news engagements. Each user is represented using anonymized hashed identifiers to ensure privacy. These heterogeneous data sources capture a broad spectrum of user behaviors and thus provide strong signals for generating high-quality lists of interest-driven news search queries for downstream retrieval. Our framework consists of three stages as illustrated in Fig. 1 : • Data Cleaning: Raw behavioral logs are inherently noisy, mixed with malformed or irrelevant search queries (e.g., random strings, phone numbers, navigational inputs), and behaviors that are less correlated with users’ underlying interests. Consequently, it is essential to filter out these irrelevant or non-informative signals prior to the user interest modeling. • User Interest Generation: Cleaned behaviors are fed into a strong teacher LLM, which generates a list of interest-driven news search queries under a reinforcement learning framework with multiple reward signals. • On-Policy Distillation: In practice, one key challenge for LLM-based recommendation is compute-intensive. While the teacher LLM can generate high-quality interests, its inference is computationally heavy, incurring substantial serving cost that are incompatible with large-scale online recommendation. To bridge this deployment gap, we distill the teacher policy into a lightweight student model for production. In online serving, the student generates a list of interest queries, which is then used to retrieve candidate news articles via ANN-based retrieval. 4 Method Our goal is to infer a list of news search queries that represent reusable deep user interests from noisy cross-domain behavioral logs in a large-scale commercial news recommendation system. We begin by formalizing the problem (Section 4.1 ), then describe the noise cleaning pipeline (Section 4.2 ), followed by our interest-generation model trained with multi-reward reinforcement learning (Section 4.3 ). Finally, we present our on-policy distillation procedure that distills the teacher’s reasoning capability to an efficient student model for online serving (Section 4.4 ). 4.1 Problem Formulation Let u denote a user and \mathcal{B}_{u}=\{b_{1},b_{2},\dots,b_{t}\}_{u} denote the multiset of raw behavioral signals observed for that user across various platforms. Our objective is to infer a list of user interests as news search queries: \mathcal{Z}_{u}=\{z_{1},z_{2},\dots,z_{n}\}_{u}, (1) where each z_{i} is a short natural-language phrase describing a user interest. We model interest generation as a policy optimization problem: \pi_{\theta}(\mathcal{Z}_{u}\mid\mathcal{B}_{u}), (2) where \pi_{\theta} outputs a list of n queries given cross-domain signals. We adopt a three-stage training strategy: (1) filter out noisy user signals, (2) optimize a teacher policy with GRPO to directly align generated interest queries with retrieval utility and desired interest properties, and (3) distill the learned policy into a student model that is efficient for online serving. 4.2 Noise Cleaning Real-world raw behavioral logs often contain substantial noisy and irrelevant information that does not reflect a user’s underlying interest. To mitigate the impact of this noise on the downstream reasoning process, we employ a lightweight binary classifier f_{\phi} . We obtain supervision by annotating a subset of behavioral signals using GPT5 with a designed prompt (see Appendix B ), and train a RoBERTa-based classifier to distinguish informative behaviors from irrelevant noise. For each raw behavioral signal b_{t} , the classifier assigns a label y_{t}\in\{0,1\} , where y_{t}=1 indicates a signal that should be retained for interest modeling, and y_{t}=0 indicates noise to be discarded. The refined behavioral set \tilde{\mathcal{B}}_{u} is formally defined as: \tilde{\mathcal{B}}_{u}=\{b_{t}\mid f_{\phi}(b_{t})=1\}_{u}. (3) 4.3 Interest Generation with Multi-Reward Reinforcement Learning To derive high-quality interest queries from cleaned cross-domain behaviors \tilde{\mathcal{B}}_{u} without ground-truth labels \mathcal{Z}^{*}_{u} , we formulate the interest discovery process as a policy optimization problem with a composite reward that reflects downstream retrievability and desired interest properties. Policy Formulation. Inspired by the self-evolution capabilities observed in DeepSeek-R1-Zero 3 , we adopt Dr.GRPO 12 , an improved variant of GRPO, to guide the policy towards maximizing our multi-dimensional rubric objectives, using the group average as a baseline. Formally, given a user u with cleaned behaviors \tilde{\mathcal{B}}_{u} , the policy \pi_{\theta} generates a group of G candidate interest lists \{\mathcal{Z}_{u}^{(1)},\mathcal{Z}_{u}^{(2)},\dots,\mathcal{Z}_{u}^{(G)}\}, (4) where each \mathcal{Z}_{u}^{(g)}=\{z_{u,1}^{(g)},\dots,z_{u,n}^{(g)}\} is a list of n interest queries sampled from the old policy \pi_{\theta_{\text{old}}} . Each list \mathcal{Z}_{u}^{(g)} receives a scalar reward r_{g}=\mathcal{R}(u,\mathcal{Z}_{u}^{(g)}) , and the objective maximizes the expected return over the sampled group. The objective function is defined to maximize the expected return: \displaystyle\mathcal{J}_{\text{Dr.GRPO}}(\theta) \displaystyle=\mathbb{E}\Bigg[\frac{1}{G}\sum_{g=1}^{G}\ell_{g}(\theta)\Bigg]-\beta D_{KL}(\pi_{\theta}\,\|\,\pi_{\text{ref}}), (5) where \ell_{g}(\theta)=\min\Big(\rho_{g}\hat{A}_{g},\;\operatorname{clip}(\rho_{g},1-\epsilon,1+\epsilon)\hat{A}_{g}\Big), (6) the probability ratio for the g -th sampled interest list is defined as \rho_{g}=\frac{\pi_{\theta}(\mathcal{Z}_{u}^{(g)}\mid\tilde{\mathcal{B}}_{u})}{\pi_{\theta_{\text{old}}}(\mathcal{Z}_{u}^{(g)}\mid\tilde{\mathcal{B}}_{u})}, (7) with \mathcal{Z}_{u}^{(g)} denoting the g -th sampled interest query list for user u . The advantage term is computed using a group-relative baseline: \hat{A}_{g}=r_{g}-\frac{1}{G}\sum_{j=1}^{G}r_{j}. (8) Reward Design. We decompose the quality of the generated interest list \mathcal{Z}_{u} into five complementary criteria: \mathcal{R}(u,\mathcal{Z}_{u})=\sum_{m=1}^{5}\lambda_{m}R_{m}(u,\mathcal{Z}_{u}), (9) where: • Retrieval Alignment ( R_{\text{align}} ) : Ensures that each generated query can successfully retrieve relevant articles from our internal ANN-based index. • Interest Coverage ( R_{\text{cov}} ) : Encourages the generated query set to collectively reflect the diverse latent interests inferred from user behaviors. • Query Specificity ( R_{\text{spec}} ) : Encourages content-rich and non-generic queries that better capture personalized user intent. • Intra-list Diversity ( R_{\text{div}} ) : Promotes semantic non-redundancy among generated queries within the same list. • Structural Validity ( R_{\text{struct}} ) : A binary reward verifying whether the output satisfies predefined structural constraints. In practice, R_{\text{align}} is computed by retrieving, for each query, its top- K articles ( K=10 ) from our internal ANN-based news index and averaging the embedding similarities as a soft alignment score. R_{\text{div}} is calculated as the average pairwise cosine distance between query embeddings obtained from Qwen3-Embedding-8B 26 . Both R_{\text{cov}} and R_{\text{spec}} are implemented using Rubrics as Rewards 2 , where an LLM evaluator assesses interest coverage and query specificity based on the prompt template provided in Appendix A . R_{\text{struct}} is a binary rule-based score verifying adherence to the required output format. All R_{m} are normalized before computing the overall reward \mathcal{R} . 4.4 On-Policy Distillation of Interest Models While the GRPO-trained teacher produces high-quality interest lists, direct online serving is often infeasible due to latency and high compute cost. We therefore transfer the teacher’s policy into a compact student model via on-policy distillation 13 , which combines (i) the exploration coverage of student rollouts with (ii) dense token-level supervision from the teacher. We formulate the distillation objective as minimizing the expected reverse Kullback-Leibler (KL) Divergence between the student \pi_{\psi} and teacher \pi_{\theta} distributions: \mathcal{L}_{distill}(\psi)=\mathbb{E}_{y_{, "R_cov": , "spec_per_query": [0 or 1, ...], "themes": ["...", "...", "..."], "covered": [0 or 1, ...] } Appendix B Prompt for Noise Cleaning Prompt for Behavioral Noise Filtering System Prompt You are a strict classifier for filtering user behavioral signals in a large-scale news recommendation system. Your task is to determine whether a single user behavior reflects a meaningful informational interest that can contribute to long-term news interest modeling. Be conservative. Platform navigation, login actions, generic website visits, or utility queries should be filtered out. Return JSON only. User Prompt Input: A single user behavioral signal {USER_BEHAVIOR} Label Definition Assign y\in\{0,1\} : • 1 (Keep) : The behavior reflects a meaningful informational interest, topic, event, entity, or issue that could correspond to reusable news interests. • 0 (Filter) : The behavior is navigational, transactional, login-related, platform-related, generic browsing, random strings, or utility-oriented (e.g., “google”, “youtube”, “facebook login”, “bank account login”, “weather today”, URL-only visits). Examples Keep (1): • “Ukraine Russia conflict latest updates” • “NVIDIA earnings report Q4” • “electric vehicle battery technology” • “US Federal Reserve interest rate decision” Filter (0): • “google” • “youtube” • “bank login” • “facebook sign in” • “www.amazon.com” • “weather” Output Format Return a JSON object only: { "label": 0 or 1 } Reward Setting Recall@10 NDCG@10 Full rewards 0.271 0.241 w/o R_{\text{align}} 0.162 0.141 w/o R_{\text{cov}} 0.115 0.093 w/o R_{\text{spec}} 0.196 0.184 w/o R_{\text{div}} 0.179 0.144 w/o R_{\text{struct}} 0.193 0.184 Table 5: Reward-level ablation study of the multi-reward GRPO objective. Appendix C Reward Decomposition. We perform reward-level ablation by removing each component individually. As shown in Table 5 , all rewards are necessary but serve distinct roles. Removing retrieval alignment ( R_{\text{align}} ) significantly degrades performance, as the model generates overly fine-grained interests that are semantically plausible but weakly supported by the news index. Excluding interest coverage ( R_{\text{cov}} ) causes the largest drop: without anchoring queries to major user themes, the model exploits other rewards and drifts toward disconnected interests, leading to severe reward hacking. Removing query specificity ( R_{\text{spec}} ) produces overly coarse and generic interests, weakening personalization and ranking quality. Intra-list diversity ( R_{\text{div}} ) prevents redundancy, while structural validity ( R_{\text{struct}} ) ensures stable downstream execution. Appendix D Inference Efficiency Comparison Model Users/sec Teacher (Qwen2.5-32B) 2 Student (Qwen2.5-0.5B) 67 Table 6: Inference efficiency comparison using vLLM on a single NVIDIA A100 GPU. Table 6 compares the inference efficiency of the RL-trained teacher model and the distilled student model ( N =1) under identical hardware settings using vLLM on a single NVIDIA A100 GPU. The teacher model (Qwen2.5-32B) achieves only 2 users per second due to its large parameter size and expensive decoding cost. In contrast, the distilled student model (Qwen2.5-0.5B) reaches 67 users per second, representing over a 30× improvement in throughput. This significant reduction in computational overhead makes it more suitable for the low-latency and high-concurrency requirements of large-scale online recommendation systems.