Token-level Collaborative Alignment for LLM-based Generative Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender syste
Fake Lin, Binbin Hu, Zhi Zheng, Xi Zhu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Tong Xu · 2026
Read Token-level Collaborative Alignment for LLM-based Generative Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender syste by Fake Lin, Binbin Hu, Zhi Zheng, Xi Zhu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Tong Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18457.txt.
Introduction
Fake Lin and seven colleagues tackle a clash at the heart of smart shops that use language models to pick goods. Old shop tools learn from what users clicked and bought in the past. That past gives rich signs of taste. Language models, in turn, learn word by word. The two ways of learning do not line up in a neat way.
Their plan aligns the two at the level of single words and word parts. Shop signs are fed in so the model can use them as it picks each next word. A tight fit should give picks that feel both apt and in line with what like users chose. The work aims at shop tools that learn taste from text and from clicks at once. Such tools could serve each user a list that fits them more.
Catalog record
| CREATOR | Fake Lin, Binbin Hu, Zhi Zheng, Xi Zhu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Tong Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18457
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Token-level Collaborative Alignment for LLM-based Generative Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems Fake Lin, Binbin Hu, Zhi Zheng, Xi Zhu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Tong Xu Abstract . Large Language Models (LLMs) have demonstrated strong potential for generative recommendation by leveraging rich semantic knowledge. However, existing LLM-based recommender systems struggle to effectively incorporate collaborative filtering (CF) signals, due to a fundamental mismatch between item-level preference modeling in CF and token-level next-token prediction (NTP) optimization in LLMs. Prior approaches typically treat CF as contextual hints or representation bias, and resort to multi-stage training to reduce behavioral–semantic space discrepancies, leaving CF unable to explicitly regulate LLM generation. In this work, we propose Token-level Collaborative Alignment for Recommendation (TCA4Rec), a model-agnostic and plug-and-play framework that establishes an explicit optimization-level interface between CF supervision and LLM generation. TCA4Rec consists of (i) Collaborative Tokenizer, which projects raw item-level CF logits into token-level distributions aligned with the LLM token space, and (ii) Soft Label Alignment, which integrates these CF-informed distributions with one-hot supervision to optimize a soft NTP objective. This design preserves the generative nature of LLM training while enabling collaborative alignment with essential user preference of CF models. We highlight TCA4Rec is compatible with arbitrary traditional CF models and generalizes across a wide range of decoder-based LLM recommender architectures. Moreover, it provides an explicit mechanism to balance behavioral alignment and semantic fluency, yielding generative recommendations that are both accurate and controllable. Extensive experiments demonstrate that TCA4Rec consistently improves recommendation performance across a broad spectrum of CF models and LLM-based recommender systems. Our code is available at https://github.com/critical88/TCA4Rec . 1. Introduction With the advance of large-scale pre-training, Large Language Models (LLMs) ( 1 ; 42 ; 37 ; 46 ) have demonstrated a strong capacity to encode rich and diverse world knowledge, providing semantic enhancement for user profiles and item attributes and thus revealing their great potential in recommender systems ( 39 ; 45 ; 34 ; 2 ) . Nevertheless, while LLMs excel at semantic modeling and reasoning, they struggle to capture the collaborative filtering (CF) structure embedded in user behavior sequences that traditional CF models explicitly exploit ( 2 ; 13 ; 41 ; 22 ; 17 ) . This structural tension between behavior modeling (CF) and knowledge modeling (LLMs) often forces models to compromise between semantic plausibility and behavioral consistency, emerging as a core challenge in existing LLM-based recommendations ( 9 ) . Motivated by this observation, many efforts have been devoted to a fundamental question: how to effectively inject the essential CF signals into LLMs, enabling them to go beyond generic semantic understanding and better adapt to the recommendation task itself. The first line of works injects CF signals into LLMs as soft prompts ( 41 ; 13 ; 15 ; 4 ) , e.g., by transforming user/item representations into LLM-compatible embeddings via adapter module ( 41 ; 13 ) . However, these methods not only suffer from the structural mismatch between behavioral and semantic spaces, but also resort to multi-stage training ( 41 ) and curriculum training ( 13 ) to alleviate this gap, leading to reduced training controllability and increased computational overhead. Alternatively, quantization-based approaches compress items into discrete token sequences as semantic IDs (SID) ( 23 ; 43 ; 35 ) . While this strategy ensures semantic reconstruction, the resulting codebooks predominantly reflect semantic similarity among items, rather than collaborative structures that differentiate user preferences. Consequently, the desired user-specific and context-dependent preference patterns are substantially depressed, or even lost, during quantization, rendering them insufficient for aligning the CF signals required by the recommendation task. These limitations call for rethinking the role of CF signals: Should CF be passively embedded as semantic enhancer, or explicitly imposed as learning signals to actively shape model optimization? Along this line, we shift our attention to how CF signals should effectively guide the LLM generation. On the one hand, many approaches incorporate CF either as an contextual hints or as a representation-level inductive bias, where it primarily serves as a conditioning variable when conducting reasoning ( 13 ) . When CF signals are excluded from the training objective, they can only passively affect model learning through forward propagation, leaving them unable to directly steer or correct the optimization trajectory ( 32 ) . More fundamentally, traditional CF models learn user preference through item-level ranking objectives, whereas LLMs are optimized under token-level next-token prediction (NTP). This inherent mismatch in optimization granularity and supervision form leaves no natural objective-level interface for collaborative alignment. These observations motivate us to rethink the optimization coupling between CF and LLM generation: How can item-level preferences be effectively projected into a token-level objective, enabling CF signals to participate in LLM training and generation in a controllable manner? In this paper, we present Token-level Collaborative Alignment for Recommendation (TCA4Rec), a model-agnostic and plug-and-play framework that establishes a principled token-level interface between CF signals and LLM generation for generative recommender systems. TCA4Rec consists of two tightly coupled components. (1) Collaborative Tokenizer. This module bridges the granularity gap between item-level CF supervision and token-level language modeling. Specifically, we extract raw CF logits from any pretrained CF model and transform them—via normalization and aggregation—into token-level distributions aligned with the LLM token space over valid candidate items. This transformation enables item-level preference signals to seamlessly align with token-level objectives, while maintaining information integrity. (2) Soft Label Alignment. Building upon the CF-informed token distributions, we construct soft labels by combining them with one-hot supervision, and optimize a soft next-token prediction (NTP) loss to guide LLM generation. This design preserves the intrinsic generative nature of LLMs, while explicitly injecting CF signals to reflect essential user preference, thereby enabling collaborative alignment with LLM generation. Notably, TCA4Rec is model-agnostic and plug-and-play. It seamlessly integrates CF signals from arbitrary traditional CF models (e.g., SASRec, BERT4Rec), and is compatible with any decoder-based generative recommender architectures (e.g., TallRec, LLaRA, CoLLM, and MSL). Moreover, by operating directly at the token level, TCA4Rec provides an explicit mechanism to trade off collaborative alignment and semantic fluency, yielding controllable generative recommender systems. In summary, the technical contributions of this paper could be summarized as follows: • We present a novel perspective to impose CF signals to regulate LLM learning process, which effectively bridges the gap between CF models and LLMs. • We introduce a model-agnostic and plug-and-play framework TCA4Rec, which features a Collaborative Tokenizer for item-to-token CF projection and a Soft-label Alignment mechanism for collaborative-guided LLM optimization. • Extensive experiments are conducted on three public datasets to demonstrate that our proposed approach are superior over baselines and further validate that our method enhances alignment with CF signals. Table 1. Prompt Template for Generative Recommendation Instruction Given the user interaction history, please recommend the toys that the user is most likely to view. Input User Interaction Histories: "Magna-Tiles ICE, 32 Piece Set", "Fisher-Price Octonauts Launch and Explore Octo-Lab", … Then the toys that user is most likely to view: Output Crayola 3CT Color Foam Toy 2. Preliminaries 2.1. Sequential Recommendation Task Sequential recommendation task aims to predict the next item that a user