BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation

Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai · 2025

Read BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation by Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06636.txt.

Introduction

Kaiyuan Li and co-authors fix how shop models turn goods into code in a 2025 paper. A model that picks the next buy from a user trail can lean on text and photo marks of each good. Past work codes each kind of mark apart, which breaks their shared sense.

Worse, those codes drift from the true aim, which is to match how users act. Their plan binds the coding to acts, so text and photo marks land in one shared space that fits the trail. The joined code keeps the cross-talk between marks alive. Shop teams gain picks that read both the look and the tale of a good.

Catalog record

CREATORKaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06636

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai Abstract . Multi-modal sequential recommendation systems leverage auxiliary signals (e.g., text, images) to alleviate data sparsity in user-item interactions. While recent methods exploit large language models to encode modalities into discrete semantic IDs for autoregressive prediction, we identify two critical limitations: (1) Existing approaches adopt fragmented quantization, where modalities are independently mapped to semantic spaces misaligned with behavioral objectives, and (2) Over-reliance on semantic IDs disrupts inter-modal semantic coherence, thereby weakening the expressive power of multi-modal representations for modeling diverse user preferences. To address these challenges, we propose a B ehavior- B ind multi-modal Q uantization for Sequential Rec ommendation (BBQRec for short) featuring dual-aligned quantization and semantics-aware sequence modeling . First, our behavior-semantic alignment module disentangles modality-agnostic behavioral patterns from noisy modality-specific features through contrastive codebook learning, ensuring semantic IDs are inherently tied to recommendation tasks. Second, we design a discretized similarity reweighting mechanism that dynamically adjusts self-attention scores using quantized semantic relationships, preserving multi-modal synergies while avoiding invasive modifications to the sequence modeling architecture. Extensive evaluations across four real-world benchmarks demonstrate BBQRec ’s superiority over the state-of-the-art baselines. DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems 1. Introduction Sequential recommendation, which aims to model evolving user preferences through behavior sequences, has become a cornerstone of modern recommender systems ( Huang et al., 2018 ; Wang et al., 2019 ; Xie et al., 2021 ) . Although existing studies ( Chang et al., 2021 ; Choi et al., 2021 ) demonstrate that the capture of sequential dependencies significantly improves intention prediction, their effectiveness is heavily based on sufficient interaction data, an assumption frequently violated in real-world scenarios. The inherent sparsity of user behavior data forces current approaches to depend on coarse-grained sequential patterns creating a fundamental bottleneck that limits recommendation performance. Figure 1. A simple diagram illustrates the key differences between our proposed method and existing approaches. To alleviate the sparsity problem of recommendation, many research efforts have been devoted to exploiting context information such as textual descriptions ( Li et al., 2019 ) , visual images ( He and McAuley, 2016b ) , etc. A common paradigm of these solutions is to transform these heterogeneous information into generic feature vectors, which are fed into a supervised learning model ( Zhang et al., 2019 ; Hou et al., 2022 ) together with sequential representations to predict the user’s next interest. Inspired by the success of generative models in the field of large language models (LLMs), generative recommendation has been a common strategy for sequential recommendation ( Rajput et al., 2023 ; Wang et al., 2024a ; Zhu et al., 2024 ; Wang et al., 2024c ) . Unlike traditional matching methods, this paradigm employs end-to-end generative models to directly predict next-item’s semantic IDs in an autoregressive manner. Specifically, this approach consists of two stages: item tokenization and autoregressive generation. The purpose of item tokenization is to learn the discrete semantic IDs of items. For the autoregressive generation task, the encoder-decoder architecture is the most widely used backbone due to its excellent capabilities in sequence modeling and generation ( Rajput et al., 2023 ; Wang et al., 2024a ; Zhu et al., 2024 ) . Despite achieving impressive results, these methods often rely on quantifying items using only a single type of content information during the item tokenization stage ( Rajput et al., 2023 ; Wang et al., 2024a ; Zhu et al., 2024 ) , lacking the application of multi-modal information. Meanwhile, most of these methods overlook the inconsistency of these content information in behavior generation tasks. Two items that are similar in images or texts may have completely unrelated behavioral pattern (such as mobile phones from various brands). This misalignment limits further advances in generative recommendation. To address this issue, recent works attempt to introduce collaborative signals ( Wang et al., 2024a ) and multi-modal information ( Wang et al., 2024c ; Liu et al., 2024b ) aiming to alleviate these problems. Although effective, we argue that there remain several critical challenges for multi-modal utilization in generative sequential recommendation: (1) Behavior-Semantic Alignment: Current research ( Wang et al., 2024c ; Liu et al., 2024b ) overlooks quantization strategy for effectively aligning multi-modal information with behavioral signals. Prior studies ( Xv et al., 2024 ; Yu et al., 2023 ; Li et al., 2022a ; Liu et al., 2024a ) reveal that modalities often contain behavior-irrelevant noise. Therefore, disentangling behavior-irrelevant information is crucial but few works in generative sequential recommendation address this challenge; (2) Non-Invasive Sequence Modeling: Most existing approaches ( Rajput et al., 2023 ; Zhu et al., 2024 ; Wang et al., 2024c ; Liu et al., 2024b ) retain only semantic IDs while discarding semantic representations in the generation stage, leading to the loss of semantic signals learned from pre-trained representations. However, directly integrating pre-trained representations in attention mechanisms has been repeatedly shown to limit recommendation performance ( Liu et al., 2021 ; Xie et al., 2022 ; Wang et al., 2024b ) . A suitable non-invasive methodology for incorporating such information remains unresolved in generative sequential recommendation. To tackle these challenges, we propose a novel B ehavior- B ind multi-modal Q uantization for Sequential Rec ommendation ( BBQRec ) and Figure 1 shows the key difference between BBQRec and traditional methods. Firstly, to enhance the alignment between the semantic IDs and the behavioral generation task, a mutual information minimization module is designed to decouple behavior-aligned signals from modality-specific features. These aligned features are then encoded through a shared behavior-dominated codebook, and subsequently optimized via sequence-item contrastive learning while jointly reconstructing with modality-specific representations. Secondly, to preserve behavior-aligned signals, we develop a similarity-enhanced self-attention mechanism that avoids discarding or directly inheriting quantized representations by discretizing pairwise item similarities from learned embeddings, then dynamically reweighting standard self-attention scores through these semantic relationships. This design enhances sequence modeling capabilities in a non-invasive manner while maintaining the original attention architecture. We construct extensive experiments on four datasets and experimental results show that our proposed BBQRec can significantly outperform all the baselines. To summarize, the contributions of this paper are listed as follows. • We propose a novel framework for multi-modal quantization and focus on the two key challenges of generative sequential models: behavior-semantic alignment and non-invasive sequence modeling. • To align the multi-modal information with behavior information, we propose a quantization strategy that decouples behavior-aligned features from modality-specific noise. • To preserve the behavior-aligned information learned from item tokenization stage, we propose a novel auxiliary module within the self-attention through a non-invasive manner. • Extensive experiments on four real-world datasets demonstrate that our model obtains a significant performance improvement over the state-of-the-art sequential recommendation models. 2. Related Work In this section, we provide a brief overview of the related work from two perspectives, including sequential recommendation, multi-modal recommendation, respectively. Sequential Recommendation . The goal of sequential recommendation is to identify meaningful patterns within sequences efficiently. Early research in this area mainly employed Markov chain models (

Read the complete text