Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation

Keyu Zhao, Fengli Xu, Yong Li · 2025

Read Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation by Keyu Zhao, Fengli Xu, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05069.txt.

Introduction

Keyu Zhao, Fengli Xu, and Yong Li teach language models, in a 2025 preprint, to reason their way to a recommendation. Recommender systems suggest items to users, and language models bring strong language sense to the task. Reasoning tricks that shine in math and code transfer poorly here. User feedback is silent about the steps behind a choice. The authors supply those missing steps by mining the graph of user and item links. Past interaction chains become step-by-step thought traces.

Their framework, R2Rec, builds these traces with a masked prompting scheme that reveals context step by step. Training runs in two stages: fine-tuning on good traces, then reinforcement learning with rewards. Across three real datasets, the method beat both classic and language-model rivals. Top-rank hits rose by about ten percent on average. The reasoning chains also let users see why an item was picked.

Catalog record

CREATORKeyu Zhao, Fengli Xu, Yong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-05069

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation Keyu Zhao, Fengli Xu, Yong Li Abstract Driven by recent advances in Large Language Models (LLMs), their integration into recommendation tasks has attracted growing interest, owing to their strong semantic understanding and prompt-based flexibility. Prior studies have encoded user–item interactions or metadata into prompts to enable recommendations. In parallel, LLM reasoning capabilities, empowered by test-time scaling technologies and reinforcement learning, have achieved remarkable success in domains such as mathematics and code, where well-defined reasoning traces and objective correctness signals are available, enabling both high performance and strong interpretability of LLM’s outputs. However, directly transferring these reasoning techniques to recommendation tasks has proven ineffective, due to the implicit nature of user feedback and the lack of supervision for reasoning over interaction data. To bridge this gap, we propose a reasoning-enhanced recommendation framework, R2Rec , which introduces interaction chains sampled from the user–item graph and transforms them into structured interaction-of-thoughts using a progressive, masked prompting strategy, where each thought represents a stepwise reasoning grounded in user–item interaction context. This transformation enables LLMs to simulate step-by-step decision-making based on implicit interaction patterns. To internalize this reasoning ability, we design a two-stage training pipeline to improve the LLM’s recommendation capability: supervised fine-tuning imparts basic reasoning skills from high-quality annotated traces, while reinforcement learning provides scalable supervision to refine the reasoning process based on reward signals, further refining the reasoning process and alleviating the scarcity of explicit interaction-reasoning data. Experimental results on three real-world datasets demonstrate the effectiveness of our approach: it outperforms both classical and LLM-based baselines with an average 10.48% improvement in HitRatio@1, and achieves an average 131.81% performance gain over the original LLM. Furthermore, the explicit reasoning chains offer enhanced interpretability by revealing the LLM’s decision process. Our code is open-source at https://anonymous.4open.science/r/R2Rec-7C5D for reproducibility. 1 Introduction The integration of Large Language Models (LLMs) into recommendation tasks has recently garnered substantial research interest [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] , owing to their strong semantic understanding, contextual reasoning capabilities, and extensive world knowledge acquired through large-scale pretraining. In parallel, enhancing the reasoning capabilities of LLMs has emerged as a key objective [ 15 , 16 , 17 , 18 , 19 ] , with increasing efforts devoted to equipping LLMs with the ability to perform structured, multi-step inference, which is a property that not only improves task performance but also brings enhanced interpretability by making the decision-making process more transparent. LLM-based recommendation approaches typically involve either adapting LLMs as standalone recommenders through prompt tuning [ 20 , 21 , 22 ] and fine-tuning [ 1 , 23 , 24 , 25 ] or leveraging them to enrich traditional models with semantic features derived from textual metadata. Concurrently, advances in LLM reasoning, which is driven by reinforcement learning [ 26 , 27 , 28 , 29 ] , have enabled complex multi-step inference primarily in structured domains like mathematics and programming. Despite significant progress in both LLM-based recommendation and LLM reasoning, effectively integrating robust reasoning capabilities into recommendation remains a largely underexplored challenge. Directly applying existing Large Reasoning Model (LRM, such as OpenAI o1 [ 30 ] , Deepseek-R1 [ 31 ] ) to recommendation tasks often yields suboptimal results, largely because these LLMs are primarily developed for domains like mathematics and code, which provide abundant and explicit supervision. In contrast, recommendation involves implicit user behaviors and lacks explicit reasoning data or supervision in natural language, creating a critical gap that motivates the need for new approaches capable of eliciting reasoning over user-item interactions. To effectively equip LLMs with the ability to reason over user–item interactions and make informed recommendations, we propose a reasoning-augmented framework that transforms local interaction structures into interpretable reasoning traces and internalizes this reasoning ability through post-training. Our approach consists of three key components. First, we construct interaction chains by sampling from a user’s neighborhood in the user–item interaction graph and transform these chains into structured reasoning chains via a progressive, masked prompting strategy. This process enables the LLM to explicitly capture and represent complex interaction patterns in a stepwise reasoning format, producing a high-quality reasoning chain to explain the interaction between sampled users and items, i.e., Interaction-of-thought. Second, to teach the LLM how to autonomously generate such reasoning chains, we design a supervised fine-tuning (SFT) stage using high-quality annotated reasoning traces, which serves as a warm start by enabling the LLM to learn step-by-step inference over user-item data. Finally, recognizing the limited availability and high cost of supervised data, we introduce a reinforcement learning (RL) stage [ 32 , 28 ] that provides scalable supervision through reward signals, allowing the LLM to further refine and self-improve its reasoning and recommendation capabilities beyond the SFT initialization. We evaluate our method on three real-world recommendation datasets [ 33 , 34 ] , achieving an average improvement of 10.48% in HitRatio@1 over state-of-the-art baselines. This performance gain stems from the LLM’s enhanced ability to reason over interaction chains. Our reasoning-augmented training pipeline substantially enhances LLM performance in recommendation tasks by effectively aligning their reasoning capabilities with task objectives. This is achieved through the integration of structured interaction representations and explicit reasoning supervision. Comprehensive ablation studies demonstrate the critical role of each component—interaction chains, reasoning transformation, supervised fine-tuning, and reinforcement learning—showing that each stage contributes uniquely and significantly to the overall improvement. In summary, the main contributions of this work include: • We propose a novel reasoning-augmented recommendation framework that leverages user-item interaction chains transformed into structured reasoning chains via a progressive, masked prompting strategy, significantly unlocking the reasoning capabilities of LLMs and enabling them to model user preferences more accurately and interpretably. • We develop a two-stage post-training pipeline that first employs supervised fine-tuning to teach the LLM step-by-step reasoning over interaction chains, and then introduces reinforcement learning to enable self-improvement through reward-driven optimization, effectively overcoming the limitations of scarce annotated reasoning data. • We conduct experiments on three widely used datasets from different domains of recommendation. Our method consistently outperforms both classical and LLM-based methods, achieving an average improvement of 10.48% HitRatio@1. 2 Related Works 2.1 Graph-based recommendation Graph-based methods have demonstrated strong potential in recommendation by modeling user–item interactions as graphs, capturing both direct and high-order relationships [ 35 , 36 ] . A key approach leverages Graph Neural Networks (GNNs) such as GraphSAGE [ 37 ] , NGCF [ 35 ] , and LightGCN [ 38 ] to aggregate neighborhood information for enhanced user and item embeddings. These techniques have also been extended to sequential recommendations, modeling interaction sequences as session or dynamic graphs [ 39 , 40 , 41 , 42 ] . While effective, GNN-based methods lack inherent reasoning capabilities and interpretability. Inspired by these approaches, we instead extract interaction chains as structured reasoning paths, enabling LLMs to conduct dynamic, explainable recommendations through sequence-aware reasoning. 2.2 LLM reasoning As Large Language Models (LLMs) are increasingly deployed across various domains [ 43 , 44 , 45 ] , recent advances demonstrate that they can significantly enhance reasoning capabilities through reinforcement learning (RL) [ 26 , 27

Read the complete text