Multi-modal Adaptive Mixture of Experts for Cold-start Recommendation Conference: Proceedings of the 34th ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Korea Proceedings of the 34th ACM International Conference on Information and Knowledge Management (CIKM ’25), November 10–14, 2025, Seoul, Korea CCS: Information systems Recommender systems Van-Khang Nguyen, Duc-Hoang Pham, Huy-Son Nguyen, Cam-Van Thi Nguyen, Hoang-Quynh Le, Duc-Trong Le Abstract . Recommendation systems have faced significant challenges in cold-start scenarios, where new items with a limited history of interaction need to be effectively recommended to users. Though multimodal data (e.g., images, text, audio, etc .) offer rich information to address this issue, existing approaches often employ simplistic integration methods such as concatenation, average pooling, or fixed weighting schemes, which fail to capture the complex relationships between modalities. Our study proposes a novel Mixture of Experts (MoE) framework for multimodal cold-start recommendation, named MAMEX, which dynamically leverages latent representation from different modalities. MAMEX utilizes modality-specific expert networks and introduces a learnable gating mechanism that adaptively weights the contribution of each modality based on its content characteristics. This approach enables MAMEX to emphasize the most informative modalities for each item while maintaining robustness when certain modalities are less relevant or missing. Extensive experiments on benchmark datasets show that MAMEX outperforms state-of-the-art methods in cold-start scenarios, with superior accuracy and adaptability. For reproducibility, the code has been made available on Github. 1 1 1 https://github.com/L2R-UET/MAMEX . † † cc-license: by 1. Introduction Recommendation systems have become indispensable in modern digital ecosystems, enabling personalized content delivery in e-commerce, streaming services, and social media ( Liu et al. 2024a ; Nguyen et al. 2024 ; Malitesta et al. 2025 ) . However, these systems often face the cold-start problem ( Volkovs et al. 2017 ; Du et al. 2020 ; Bai et al. 2024 ; Bui et al. 2025 ) , particularly in item cold-start scenarios, where recommendations must be made for new items with little or no interaction data. In these cases, traditional collaborative filtering methods usually do not work well because they depend on user-item interaction history to make accurate suggestions ( Bui et al. 2025 ; Bai et al. 2024 ) . To address this issue, recent research ( Bai et al. 2024 ; Liu et al. 2024b ; Wei et al. 2021 ; Chen et al. 2022 ) has explored the integration of multimodal data, such as product images, textual descriptions, and audio features, which offer complementary information that can enrich item representations and improve the precision of the recommendation, especially in item cold-start scenarios. For example, the image of a fashion product can convey a visual style, while its textual description provides semantic attributes such as material or brand. Using such diverse modalities, models can make more informed predictions even when behavioral data are sparse. Despite this potential, effectively fusing multimodal information remains a nontrivial task. Many existing methods ( Bai et al. 2023 ; Liu et al. 2024b ; Zhou et al. 2023a ; Zhou et al. 2023b ; Nguyen et al. 2025 ) rely on straightforward fusion techniques, such as concatenation or averaging, which treat each modality equally and independently. These approaches often overlook the inherent differences in modality characteristics and fail to capture complex cross-modal relationships effectively. Moreover, they lack adaptability in assigning importance to different modalities across varying items, which is crucial in heterogeneous data environments and even more so in item cold-start scenarios. These limitations motivate the need for a more adaptive and content-aware fusion strategy. In this work, we propose MAMEX ( Multimodal Adaptive Mixture of Experts ), a novel recommendation framework that addresses the limitations of conventional multimodal fusion by leveraging the Mixture of Experts (MoE) paradigm. Our model introduces a multi-stage expert architecture that dynamically adapts to the content structure of each item, allowing it to selectively emphasize the most informative modalities. 2. Related Work Cold-start recommendation is challenging due to the scarcity of user-item interaction ( Xu et al. 2024 ; Bui et al. 2025 ) . To mitigate this, multimodal methods incorporate heterogeneous data such as images and text ( Ganhör et al. 2024 ; Malitesta et al. 2025 ; Nguyen et al. 2025 ; Zhou et al. 2023b ) . Yet, conventional fusion approaches, like simple concatenation ( Nguyen et al. 2023 ; Zhou et al. 2023b ) or averaging ( Nguyen et al. 2025 ) , often fail to adequately capture the complex relationships among different modalities ( Bai et al. 2023 ; Liu et al. 2024a ) . Although attention mechanisms improve fusion, they struggle with variable quality or missing modalities, limiting effectiveness. The Mixture of Experts (MoE) framework, which adaptively combines specialized networks via a gating function ( Mu and Lin 2025 ) , has shown promise in multi-task learning ( Zhang et al. 2024 ) and sequential recommendation ( Bian et al. 2023 ) but remains underexplored for multimodal cold-start recommendation ( Bui et al. 2025 ; Zhang et al. 2025 ; Bian et al. 2023 ) . Some methods apply MoE to handle each modality independently, demonstrating its potential in modeling sequential and modality-specific signals. However, these works typically treat modalities in isolation and lack effective cross-modal interaction modeling. Thus, the integration of MoE to jointly fuse multiple modalities, especially under cold start conditions, remains underexplored. Our work addresses this gap with a dual-level MoE framework combining modality-specific experts and cross-modal interaction via a dynamic gating mechanism. Furthermore, we introduce a balance regularization term to prevent modality collapse and enhance robustness in diverse cold-start scenarios. 3. Methodology The MAMEX architecture, as shown in Fig. 1 , consists of 2 key modules: a Modality Extraction Module that processes and aligns individual modality features; and a Modality Fusion Module that adaptively combines these features leveraging a gating mechanism. Figure 1. The overview architecture of our proposed framework MAMEX. 3.1. Preliminaries Let \mathcal{U},\mathcal{I} denotes the sets of users and items, respectively. Each item i\in\mathcal{I} has modality-specific raw features \{x_{i}^{1},x_{i}^{2},\ldots,x_{i}^{|\mathcal{M}|}\} , each from a distinct modality. Within \mathcal{I} , we identify a subset \mathcal{I^{\prime}}\subset\mathcal{I} comprising newly added items with little or no user feedback. User-item interactions are represented by a sparse matrix \mathcal{X}\in\mathbb{R}^{|\mathcal{U}|\times|\mathcal{I}|} , where each entry x_{u,i} denotes the presence or intensity of interaction between user u and item i . The objective is to learn a multimodal recommendation function g:\mathcal{U}\times\mathcal{I^{\prime}}\rightarrow\mathbb{R} that estimates the relevance score between users and cold-start items: (1) y_{u,i^{\prime}}=g(u,i^{\prime},\{x_{i^{\prime}}^{1},x_{i^{\prime}}^{2},\ldots,x_{i^{\prime}}^{|\mathcal{M}|}\},\mathcal{X}) where y_{u,i^{\prime}} is the predicted relevance between u and i^{\prime}\in\mathcal{I^{\prime}} . 3.2. Modality Extraction Module We process each modality with specialized extractors and refine them via a MoE to align and enhance features. 3.2.1. Feature Extraction Each modality m is extracted initial feature representations through modality-specific pre-trained models: (2) h_{m}=E_{m}(x_{m}) where E_{m} represents the feature extractor for modality m (e.g., CLIP ( Radford et al. 2021 ) for image and text, wav2vec ( Baevski et al. 2020 ) for audio), and x_{m} denotes the raw for that modality. After extraction, the input data x_{m} is transformed into a modality representation h_{m}\in\mathbb{R}^{{d}} . 3.2.2. Modality-Specific Adaptation To better adapt the extracted features for recommendation, we introduce a modality-specific MoE layer with K expert networks and a gating mechanism that dynamically weights experts based on the input: (3) z_{m}=\sum_{k\in\mathcal{T}}\bigg(\hat{g}_{m}^{k}(h_{m})E_{m}^{k}(h_{m})\bigg) where E_{m}^{k}(h_{m})\in\mathbb{R}^{d} denotes the k -th expert network, implemented as a linear transformation. The sparse gating weights \hat{g}_{m}^{k} select only the top- k experts with indices in \mathcal{T} , where \mathcal{T} represents the indices of experts with the highest gating value. To mitigate the challenge of expert underutilization in MoE framework, we propose a load balancing loss that encourages more uniform data allocation across experts: (4) \mathcal{L}_{\text{adapter}}=\sum_{m\in\mathcal{M}}D_{\text{KL}}\left(\frac{1}{N}\sum_{i=1}^{N}g_{m}^{k}(h_{m}^{i})\bigg\|\frac{1}{K}\mathbf{1}\right) where D_{\text{KL}}(P\parallel Q) is the Kullback-Leibler divergence, which quantifies the discrepancy between two probability distributions. The first term inside the divergence denotes the empirical average of the gating function outputs across a batch of input samples, effectively capturing the actual routing probability distribution over K experts. The target \frac{1}{K}\mathbf{1} is a uniform distribution over experts, ensuring equal expert utilization. 3.3. Mixture of Modality Fusion The second component of MAMEX combines the representations of aligned modality adaptively through a dynamic fusion mechanism. 3.3.1. Adaptive Fusion Mechanism We form unified item representations by weighted-summing embeddings from all available modalities. For image and text, weights are computed via a sparse softmax gating function G(\cdot) over their concatenation: (5) \displaystyle\alpha \displaystyle=G\Big(z_{\text{image}}\parallel z_{\text{text}}\Big) Based on the modality features and their corresponding weights, the final representation of item is calculated as follow: (6) \displaystyle e_{i}=\sum_{m\in\mathcal{M}}\alpha_{m}\cdot z_{m} where \mathcal{M} denotes the set of modalities (e.g., \{\text{image},\text{text}\} ), z_{m}\in\mathbb{R}^{d} are modality-specific embeddings, and \alpha_{m}\in\mathbb{R}^{m} are the corresponding sparse softmax gating weights. 3.3.2. Balanced Fusion Regularization To mitigate modality collapse, characterized by the predominance of one modality over another, we introduce a balance regularization term: (7) \displaystyle\mathcal{L}_{\text{fusion}}=D_{\text{KL}}\Bigg(\frac{1}{N}\sum_{i=1}^{N}\alpha^{(i)}\bigg\|\frac{1}{m}\mathbf{1}\Bigg), where D_{\text{KL}} is the Kullback-Leibler divergence, \alpha^{(i)} represents the fusion weights for the i -th item, and \frac{1}{m}\mathbf{1} (with m=2 for the two modalities) denotes a uniform distribution over modalities. 3.3.3. Modality Alignment Loss To ensure that the final representation i_{\text{final}} captures the semantic traits of each modality, we use a Mean Squared Error-based alignment loss is computed as: (8) \displaystyle\mathcal{L}_{\text{align}}=\sum_{m\in\mathcal{M}}||e_{i}-z_{m}||_{2}^{2} This alignment loss is added to the overall training objective without altering the aggregation formula for modality embeddings. 3.4. Recommendation Training For top-K recommendation, we employ the Bayesian Personalized Ranking loss ( Rendle et al. 2012 ) . Given a user embedding e_{u}\in\mathbb{R}^{d} and the final item embedding e_{i}\in\mathbb{R}^{d} , the prediction score is computed using dot product as follows: (9) s_{u,i}=e_{u}^{T}e_{i} The Bayesian Personalized Ranking ( Rendle et al. 2012 ) loss is subsequently adopted: (10) \mathcal{L}_{\text{BPR}}=\sum_{(u,i,j)\in\mathcal{D}}-\ln\sigma(s_{u,i}-s_{u,j}) where (u,i,j) is a training triplet with user u , positive item i , and negative item j , and \sigma is the sigmoid function. The total loss is computed by aggregating the individual loss components: (11) \mathcal{L}=\mathcal{L}_{\text{BPR}}+\lambda_{1}\mathcal{L}_{\text{align}}+\lambda_{2}\mathcal{L}_{\text{adapter}}+\lambda_{3}\mathcal{L}_{\text{fusion}}+\lambda_{4}||{\Theta}||_{2}^{2} where \lambda_{1-4} are hyperparameters weighting the cross-modal alignment, adapter balance, fusion balance, and L2 regularization losses, respectively, and \Theta represents all trainable parameters. 4. Results and Discussion This section presents the experimental results of our approach, including the setup, baseline comparisons, and ablation studies. Table 1. Overall performance on Amazon benchmark datasets from across diverse domains such as Baby, Clothing, and Sport. The ‘bold’ numbers present the most outstanding results, while the ‘ underline ’ figures depict the second best performances. Amazon Baby Amazon Clothing Amazon Sport Method Rec@10 Rec@20 NDCG@10 NDCG@20 Rec@10 Rec@20 NDCG@10 NDCG@20 Rec@10 Rec@20 NDCG@10 NDCG@20 MTPR 0.0130 0.0246 0.0066 0.0097 0.0215 0.0377 0.0110 0.0153 0.0146 0.0241 0.0076 0.0102 AlignRec 0.0224 0.0440 0.0107 0.0166 0.0425 0.0658 0.0234 0.0298 0.0274 0.0465 0.0153 0.0205 MetaEmbed 0.0264 0.0459 0.0132 0.0187 0.0352 0.0602 0.0188 0.0256 0.0349 0.0629 0.0173 0.0250 DropoutNet 0.0174 0.0315 0.0083 0.0122 0.0152 0.0277 0.0091 0.0125 0.0171 0.0301 0.0089 0.0125 CLCRec 0.0263 0.0437 0.0136 0.0180 0.0348 0.0481 0.0181 0.0221 0.0271 0.0421 0.0139 0.0177 GAR 0.0119 0.0238 0.0057 0.0090 0.0368 0.0629 0.0206 0.0276 0.0360 0.0641 0.0201 0.0278 MILK 0.0465 0.0730 0.0271 0.0344 0.0991 0.1436 0.0571 0.0691 0.0668 0.0998 0.0390 0.0483 MAMEX 0.0512 0.0771 0.0292 0.0363 0.1048 0.1501 0.0606 0.0729 0.0776 0.1152 0.0470 0.0574 % Improv. 10.11 5.62 7.75 5.52 5.75 4.53 6.13 5.50 16.17 15.43 20.51 18.84 4.1. Experimental Setup 4.1.1. Datasets We evaluate our approach on three Amazon Reviews datasets: Baby, Clothing, and Sport ( McAuley et al. 2015 ) . All datasets include product images, textual descriptions, and user reviews. Data are split into 8:1:1 ratio for training, validation, and test sets and completely remove all interactions for items in the development and test sets to simulate realistic cold-start scenarios. 4.1.2. Evaluation Metrics Inspired by previous works ( Bai et al. 2024 ) , we evaluate performance using Recall@K and NDCG@K for K\in\{10,20\} . 4.1.3. Hyperparameter Setup Our MoE adapter is tuned over expert numbers \{4,6,8\} and top- k routing with k\in\{2,3,4\} , ensuring both model expressiveness and computational efficiency. We set the learning rate to 0.001 , \lambda\in\{1,0.1,0.01\} to mitigate modality collapse, and Adam ( Kingma and Ba 2014 ) for optimization. 4.1.4. Baseline Methods We evaluate our approach against several state-of-the-art methods for cold-start recommendation, such as: MTPR ( Du et al. 2020 ) , AlignRec ( Liu et al. 2024b ) , CLCRec ( Wei et al. 2021 ) , GAR ( Chen et al. 2022 ) , MILK ( Bai et al. 2024 ) , DropoutNet ( Volkovs et al. 2017 ) , MetaEmbed ( Pan et al. 2019 ) . 4.2. Overall Performance Table 1 compares MAMEX with state-of-the-art baselines on three Amazon datasets ( McAuley et al. 2015 ) , showing consistent superiority across all metrics. Notably, MAMEX achieves outstanding performance in Recall@10 and NDCG@10: 10.11\% and 7.75\% on Amazon Baby; 5.75\% and 6.13\% on Amazon Clothing; 16.17\% and 20.51\% on Amazon Sport, respectively. These results highlight the effectiveness of our dual-level MoE architecture in capturing modality-specific information while dynamically integrating multimodal signals. The gains over all baselines confirm that balance regularization and dynamic gating help prevent modality collapse and improve representation quality, especially in cold-start scenarios. 4.3. Ablation Studies 4.3.1. Impact of Different Components To validate the effectiveness of each component in our framework, we conducted ablation studies by selectively removing key components 2 2 2 The term ‘ w/o ’ is abbreviation form of ‘ with out ’. , such as: w/o MoE : Replace the modality-specific MoE layers with standard neural networks; w/o Alignment : Remove the modality alignment loss; w/o MMF : Replace the adaptive fusion mechanism with simple averaging. Table 2. Ablation Study Results on Amazon Baby Dataset. Datasets Baby Clothing Sports Metrics Rec@20 NDCG@20 Rec@20 NDCG@20 Rec@20 NDCG@20 w/o MoE 0.0746 0.0339 0.1388 0.0647 0.0983 0.0462 w/o Align 0.0571 0.0260 0.1152 0.0545 0.0832 0.0399 w/o MMF 0.0752 0.0353 0.1429 0.0679 0.1084 0.0528 MAMEX 0.0771 0.0363 0.1501 0.0729 0.1152 0.0574 As shown in Table 2 , the results clearly indicate that the removal of any key component leads to performance degradation. In particular, omitting the MoE layers or the adaptive fusion mechanism results in significant drops in NDCG@10 (approximately 5.4% and 4.8% respectively). Notably, excluding the cross-modal alignment loss leads to the largest performance decline, emphasizing its critical role in bridging the gap between different modalities. These findings confirm that each component contributes complementarily to the overall effectiveness of our model. 4.3.2. Impact of single modality vs. multi-modalities Figure 2. The impact of different modalities on three datasets. Figure 2 shows that the textual modality performs better than the visual modality, probably due to its richer semantics and more specific details, while images struggle with abstract attributes such as style or comfort. Furthermore, multimodal information surpasses any single modality. This finding underscores that the fusion approach successfully integrates multiple modalities, thus improving the overall performance of the MAMEX model. 4.3.3. MoE Adapter Design Analysis To further investigate fusion strategies, we evaluate three Mixture of Experts approaches: (a) Joint Router : concatenates all input modalities and employs a single router with shared experts; (b) Modality-Specific Router : uses separate routers for each modality while maintaining a common set of experts; and (c) MAMEX : assigns both dedicated routers and experts to each modality, thus facilitating maximum specialization, as illustrated in Figure 3 . MAMEX consistently outperforms both modality-specific router and joint router baselines in all evaluation metrics and datasets. On the Clothing dataset, it achieves relative gains of 0.94% in Recall@20 and 1.72% in NDCG@20 over the strongest baseline. Similarly, on the Sports dataset, it yields improvements of 3.61% in Recall@20 and 5.60% in NDCG@20. These consistent gains highlight the effectiveness of MAMEX’s structure, which combines modality-sensitive input with expert selection and specialized routing. This design enables more precise modeling of modality-specific features, surpassing the performance of conventional and partially specialized methods. Figure 3. Three MoE adapter designs evaluated in our study. Table 3. Comparison of MoE Variants on Amazon Datasets. Datasets Clothing Sports Metrics Rec@20 NDCG@20 Rec@20 NDCG@20 Joint Router 0.0847 0.2206 0.0664 0.1714 Mod-Specific 0.0847 0.2207 0.0640 0.1714 MAMEX 0.0855 0.2245 0.0688 0.1810 5. Conclusion This paper presents MAMEX , a dual-level Mixture of Experts framework for cold-start recommendation. By integrating modality-specific MoE layers with a learnable gating fusion, MAMEX captures modality-specific representations while dynamically balancing their contributions. Experiments on three Amazon datasets show consistent improvements in Recall and NDCG compared to state-of-the-art baselines, highlighting the effectiveness of the proposed architecture and regularization strategies. The core concept of MAMEX can also inspire research in multi-objective recommendation and interpretability. Future work should aim at addressing missing modalities, improving cross-modal generation, adding temporal MoE layers, and optimizing expert routing to enhance scalability and adaptability to evolving user preferences.