Every Preference Has Its Strength: Injecting Ordinal Semantics into LLM-Based Recommenders Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809929 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems
Jiwon Jeong, Donghee Han, Sungrae Hong, Woosung Kang, Mun Yong Yi · 2026
Read Every Preference Has Its Strength: Injecting Ordinal Semantics into LLM-Based Recommenders Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809929 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems by Jiwon Jeong, Donghee Han, Sungrae Hong, Woosung Kang, Mun Yong Yi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10323.txt.
Introduction
Jiwon Jeong and four colleagues improve how language models recommend items by respecting how strongly a user likes something. Hybrid systems feed collaborative filtering signals, patterns from many users' behavior, into language models through prompting. Most collapse explicit ratings into positive-only feedback, throwing away the graded strength of preferences. Their 2026 paper proposes Ordinal Semantic Anchoring, or OSA, to keep that strength.
OSA turns each graded preference level into a numeric text token, and treats the token vectors as anchors that line up user-item patterns inside the model's hidden space. Strength-aware alignment across levels preserves preference meaning while merging collaborative signals with the language model. On multiple real-world datasets OSA consistently beat existing baselines, with the clearest edge in pairwise preference evaluation, where the model must judge which of two items a user prefers.
Catalog record
| CREATOR | Jiwon Jeong, Donghee Han, Sungrae Hong, Woosung Kang, Mun Yong Yi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10323
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Every Preference Has Its Strength: Injecting Ordinal Semantics into LLM-Based Recommenders Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809929 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems Jiwon Jeong, Donghee Han, Sungrae Hong, Woosung Kang, Mun Yong Yi Abstract . Recent work has shown that large language models (LLMs) can enhance recommender systems by integrating collaborative filtering (CF) signals through hybrid prompting. However, most existing CF–LLM frameworks collapse explicit ratings into implicit or positive-only feedback, discarding the ordinal structure that conveys fine-grained preference strength. As a result, these models struggle to exploit graded semantics and nuanced preference distinctions. We propose O rdinal S emantic A nchoring ( OSA ), a hybrid CF–LLM framework that explicitly incorporates preference strength by modeling interaction-level user feedback. OSA represents ordinal preference levels as numeric textual tokens and uses their token embeddings as semantic anchors to align user–item interaction representations in the LLM latent space. Through strength-aware alignment across ordinal levels, OSA preserves preference semantics when integrating collaborative signals with LLMs. Experiments on multiple real-world datasets demonstrate that OSA consistently outperforms existing baselines, particularly in pairwise preference evaluation, highlighting its effectiveness in modeling fine-grained user preferences over prior CF–LLM methods. † † cc-license: by 1. Introduction Figure 1 . Comparison between existing CF–LLM recommenders and the proposed OSA framework. Recent work has shown that large language models (LLMs) can significantly improve recommender systems by leveraging rich textual information and strong generalization capabilities ( 1 ; 3 ; 4 ; 20 ; 19 ) . A prominent line of this research adopts hybrid prompting ( 14 ; 23 ; 12 ) , which integrates collaborative filtering (CF) signals into the LLM’s input or latent space. This integration is typically achieved by projecting or aligning user or item representations from CF models within the LLM, allowing the LLM to jointly leverage textual semantics and collaborative information. Most existing approaches frame this integration primarily as a representation mapping or projection problem ( 15 ; 13 ) , for example by injecting embeddings from CF models as additional tokens ( 23 ; 14 ) or applying distillation ( 5 ) and binarization ( 22 ) techniques. These works have shown that injecting collaborative information into LLM-driven recommendation can yield substantial improvements over purely textual ( 9 ; 2 ) or purely collaborative baselines ( 8 ; 17 ; 11 ) . Despite these advances, current hybrid LLM–CF integration frameworks often overlook fine-grained user preference signals, such as explicit ratings, which are essential for capturing nuanced individual tastes. Rather than serving as mere numeric labels, ratings encode both whether a user liked or disliked an item and the strength of that preference. For instance, a 5-star rating reflects a substantially stronger preference than a 4-star rating, while a 1-star rating indicates stronger dislike than a 2-star rating. As such, ratings provide an ordinal semantic signal that captures fine-grained variations in preference intensity. However, in most hybrid LLM–CF approaches, ratings are commonly binarized using a rating threshold ( 14 ; 12 ) or reduced to positive-only interactions ( 23 ; 22 ) . As a result, these models tend to capture coarse preference signals that suffice for identifying generally liked items, but are less effective at modeling the fine-grained preference strength required to resolve subtle distinctions among closely related candidates. While rating simplification has been a reasonable design choice in existing recommender systems ( 7 ) , it becomes a suboptimal one when LLMs are employed as recommendation predictors. LLMs are particularly well suited to modeling graded semantics and nuanced comparisons, and can therefore benefit from supervision signals that preserve fine-grained preference information ( 18 ; 24 ; 21 ) . When ratings are reduced to implicit or positive-only feedback, this opportunity is largely missed, and the LLM is used as a generic predictor rather than as a semantic model. To overcome these challenges (Figure 1 ), we propose O rdinal S emantic A nchoring (OSA) , a hybrid CF–LLM framework that incorporates fine-grained user preference strength into LLM-based recommender using explicit ratings. OSA represents rating levels as numeric textual tokens and uses their token embeddings as semantic anchors to align interaction-level user–item representations from a CF model in the LLM latent space. During training, OSA applies strength-aware alignment in proportion to preference intensity, pulling interactions more strongly toward anchors for extreme ratings while maintaining separation across ordinal levels. This anchoring introduces an inductive bias that preserves the ordinal structure of preference strength when integrating collaborative representations with the LLM, enabling OSA to capture not only whether an item is preferred, but also how strongly it is preferred. Our contributions are as follows: (1) We identify ordinal semantics in explicit ratings as an overlooked objective in hybrid LLM–CF recommendation, highlighting the importance of preserving fine-grained user preferences. (2) We propose Ordinal Semantic Anchoring, which enables strength-aware alignment by grounding interaction representations to rating-level semantic anchors within the LLM latent space. (3) We empirically and qualitatively show that this anchored alignment improves both fine-grained preference modeling and overall recommendation performance. 2. Method We propose O rdinal S emantic A nchoring (OSA) , a CF–LLM hybrid framework for sequential recommendation that incorporates fine-grained preference strength by aligning interaction representations with ordinal semantic anchors derived from explicit ratings. As illustrated in Figure 2 , OSA operates under a next-item prediction setting, where the model predicts the most likely next item based on a user’s interaction history and a set of candidate items. Figure 2 . Overview of Ordinal Semantic Anchoring (OSA). 2.1. Interaction Representation OSA builds on a standard CF model (e.g., SASRec) to encode user–item interactions. For each user u\in\mathcal{U} , let \mathcal{H}_{u}^{<t}=(i_{1},\dots,i_{t-1}) denote the interaction history up to time t-1 , where i_{k}\in\mathcal{I} . The CF encoder maps \mathcal{H}_{u}^{<t} to a latent user representation (1) \mathbf{u}_{<t}=f_{\text{CF}}\!\left(\mathcal{H}_{u}^{<t}\right)\in\mathbb{R}^{d_{\text{rec}}}, which captures the user’s preference context prior to time t . The CF model also maintains a shared item embedding table learned across all users, where each item i is associated with an embedding (2) \mathbf{e}_{i}\in\mathbb{R}^{d_{\text{rec}}}, which encodes item-level collaborative signals shared across users. We construct an interaction representation \mathbf{z}_{u,i} by concatenating the user and item representations, (3) \mathbf{z}_{u,i}=[\mathbf{u}_{<t-1}\,;\,\mathbf{e}_{i}]\in\mathbb{R}^{2d_{\text{rec}}}, which corresponds to user u ’s interaction with item i at time t_{u,i} . Each \mathbf{z}_{u,i} is associated with an explicit rating signal r_{u,i}\in\{1,\dots,5\} , reflecting the observed preference strength. By modeling representations at the level of interactions, rather than at the user or item level, OSA establishes a direct correspondence between interaction-level representations and the individual preference expressed in each interaction. 2.2. Projector and Hybrid Prompting To interface CF representations with the LLM, OSA applies a learnable projector (4) f_{\text{proj}}:\mathbb{R}^{2d_{\text{rec}}}\rightarrow\mathbb{R}^{d_{\text{llm}}}, implemented as a two-layer MLP with GELU. For each interaction representation \mathbf{z}_{u,i} , we obtain a projected vector \mathbf{v}_{u,i}=f_{\text{proj}}(\mathbf{z}_{u,i}) , which is used as an input to the LLM. We adopt a pretrained LLM and fine-tune it with LoRA ( 10 ) to adapt the model to the recommendation task. Following the template in Figure 3 , the