Modeling User Preferences as Distributions for Optimal Transport-based Cross-domain Recommendation under Non-overlapping Settings
Ziyin Xiao, Toyotaro Suzumura · 2025
Read Modeling User Preferences as Distributions for Optimal Transport-based Cross-domain Recommendation under Non-overlapping Settings by Ziyin Xiao, Toyotaro Suzumura (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16210.txt.
Introduction
Recommenders like to borrow taste from a data-rich domain to help a sparse one, but most methods need users who appear in both. Ziyin Xiao and Toyotaro Suzumura drop that requirement entirely. Their framework, DUP-OT, first turns reviews into shared embeddings, then models each user's taste as a mixture of Gaussians over item space, a cloud rather than a point.
Optimal transport then matches those clouds across domains, letting taste transfer without any shared users. On Amazon review data, the method beat single-domain baselines even with no source data in training. It also cut the large errors that plague cold-start users. The 2025 paper makes cross-domain help possible between strangers.
Catalog record
| CREATOR | Ziyin Xiao, Toyotaro Suzumura |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-16210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modeling User Preferences as Distributions for Optimal Transport-based Cross-domain Recommendation under Non-overlapping Settings Ziyin Xiao, Toyotaro Suzumura Abstract Cross-Domain Recommender(CDR) Systems are designed to transfer knowledge from dense to sparse domain, alleviating data sparsity and cold-start problems in conventional single-domain recommendation methods. While many existing cross-domain methods rely on overlapping users or items to establish connections between domains, this assumption is not always satisfied in real-world recommendation systems. This leads to the need for non-overlapping cross-domain recommendation systems, which do not require any overlapping users or items between domains. Conducting non-overlapping cross-domain recommendation is challenging due to the following issues: 1) the absence of overlapping information like same users or items prevents us from building bridge between domains directly. 2) the discrepancy between the distribution of different domains heavily affects the performance of cross-domain recommendation. Furthermore, most existing recommender systems represent user preferences with discrete vectors, which struggle to capture the fine-grained and multi-faceted nature of user interests. To address these challenges, we propose DUP-OT (Distributional User Preferences with Optimal Transport), a novel framework for non-overlapping CDR problem. DUP-OT comprises three stages: (1) a Shared Preprocessing stage that encodes users and items from both domains via review-based embeddings and reduces dimensionality using an autoencoder; (2) a User GMM Weight Learning stage that models user preferences as weighted combinations over a set of Gaussian components in each domain; and (3) a Cross-domain Rating Prediction stage, where optimal transport is applied to align Gaussian components across domains, enabling user’s preference transfer from source to target domain. Extensive experiments on Amazon review datasets demonstrate that DUP-OT is effective in mitigating domain discrepancy and outperforms state-of-the-art baselines under the non-overlapping CDR setting. Code is available at https://github.com/XiaoZY2000/DUP-OT . Keywords Cross-Domain Recommendation \cdot Non-overlapping Users \cdot Gaussian Mixture Model (GMM) \cdot Optimal Transport \cdot Cold-start Problem 1 Introduction These days, with the rapid expansion of the Internet, it is increasingly important to utilize recommender systems to filter the abundant information R_Lü_2012 . However, conventional single-domain recommender systems often encounter cold-start and data-sparsity problems, which prevent them to achieve higher performance T_He_2024 ; L_Liu_2024 ; A_Zang_2023 . Considering these problems, cross-domain recommender(CDR) systems are proposed to transfer knowledge from the dense source domain to the sparse target domain to alleviate the cold start user problem and improve the recommendation performance in the target domain A_Zhu_2018 . However, most existing cross-domain recommender systems assume the existence of overlapping users or items to build the bridge between domains, which is not usually satisfied in real-world scenarios. Besides, these methods usually represent users’ preferences using discrete vectors, which lacks the ability to capture users’ multi-aspect preferences. In this paper, we focus on the non-overlapping CDR scenario and propose to model user preferences using Gaussian Mixture Models (GMMs) to capture fine-grained, multi-aspect representations. Our goal is to predict target-domain item ratings for source-domain users, thereby alleviating the cold-start problem. This problem is challenging due to the following reasons: (1) different domains have discrepancy H_Guerraoui_2017 which can be inferred as figure 1, and there’s no direct shared information like shared users or items between domains in our setting to align them directly D_Guo_2024 ; C_Liu_2023 . (2) Modeling user preferences with GMMs enables more fine-grained representations, but significantly increases computational cost. Moreover, this representation differs from conventional settings in optimal transport. Designing an efficient distributional representation that both reduces computational overhead and is compatible with optimal transport remains an important problem. Figure 1: Visualization of domain discrepancy between Amazon CDs & Vinyl and Video Games. The embeddings of 100 randomly sampled items from each domain are projected via t-SNE. Although many existing CDR methods address domain discrepancy using techniques such as contrastive learning and graph neural networks A_Zang_2023 , they typically rely on overlapping users or items to bridge domains. Though several existing works have explored cross-domain recommendation (CDR) in non-overlapping scenarios, they typically represent users and items as discrete vectors and adopt techniques such as distribution alignment L_Liu_2024 or domain discriminator-based adversarial training R_Wang_2020 ; C_Perera_2019 . However, we argue that discrete representations are insufficient to fully capture the multi-aspect nature of user preferences. On the other hand, some recent CDR studies have attempted to model users and items as probability distributions. Yet, these approaches either use simple Gaussian distributions or adopt Gaussian Mixture Models (GMMs) while still relying on overlapping information across domains M_Zhu_2024 . Thus how to represent users’ preferences with GMM to naturally capture users’ multiple aspects of preferences in a strict non-overlapping CDR setting remains to be solved. To deal with the above mentioned problem, we propose a novel framework for non-overlapping CDR called DUP-OT(Distributional User Preferences with Optimal Transport). The idea of DUP-OT is to represent each user’s preference with Gaussian Mixture Model(GMM) distributions over items’ representations and conduct optimal transport to transfer users’ distributions from source domain to target domain. It’s important to mention that to reduce computational cost and enable optimal transport between two domains, we make an important simplification that users in the same domain share a same set of gaussian distribution terms which are extracted from items’ representations, and give each user different weights on these distributions to form different GMM distributions. This simplification severely reduces computational cost and makes it possible to conduct optimal transport only on the limited number of gaussian distribution terms in each domain. Specifically, our proposed framework can be divided into three stages: (1) Shared Preprocess Stage: To keep both domains’ users and items’ representations in the same feature space, we first utilize a shared sentence encoder to embed both domains’ users and items’ representation vectors from reviews. Then, to prepare for the following stages, we conduct a shared auto-encoder to reduce the dimensionalities. (2) User GMM Weights Learning Stage: In this stage, we first fit a GMM distribution on each domain’s items’ representations to get the unified gaussian distribution terms for each domain. Then we conduct a supervised learning process on each domain to train two MLPs separately for getting users’ weights on these gaussian distribution terms from their representations and obtaining the predicted rating according to target item’s Mahalanobis distances on every gaussian distribution terms. (3) Cross Domain Rating Prediction Stage: In this final stage, we conduct optimal transport on each domain’s unified gaussian distribution terms between source domain and target domain to obtain the optimal transport matrix. Then we use this matrix to transfer user’s GMM weights from source domain to target domain to build user’s distribution on target domain to achieve cross domain rating prediction. To summarize, our main contributions are as follows: • We identify the limitations of discrete vector representations in modeling multi-faceted user preferences and highlight the lack of distributional modeling in strictly non-overlapping CDR scenarios. • We propose DUP-OT (Distributional User Preference and Optimal Transport), a novel framework that combines GMM-based user preference modeling with optimal transport to enable effective cross-domain alignment without any overlapping users or items. • We validate the effectiveness of DUP-OT through experiments on Amazon Review datasets, demonstrating consistent performance improvements over competitive baselines. 2 Related works Cross Domain Recommendation. Cross Domain Recommendation(CDR) aims to transfer knowledge from dense source domain to sparse target domain to alleviate cold-start and data sparsity problem D_Li_2021 ;