Alibaba International E-commerce Product Search Competition DcuRAGONs Team Technical Report
Thang-Long Nguyen-Ho, Minh-Khoi Pham, Hoang-Bao Le · 2025
Read Alibaba International E-commerce Product Search Competition DcuRAGONs Team Technical Report by Thang-Long Nguyen-Ho, Minh-Khoi Pham, Hoang-Bao Le (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25428.txt.
Introduction
Thang-Long Nguyen-Ho, Minh-Khoi Pham, and Hoang-Bao Le report a competition solution. Their 2025 report covers multilingual e-commerce product search for Alibaba International. The task matches user queries to product items across languages. Their team, DcuRAGONs, used a data-centric method built on large language models. That method achieved the highest score among competing solutions. The short report details their methodology and results, and the team published its source code online for readers to inspect.
Catalog record
| CREATOR | Thang-Long Nguyen-Ho, Minh-Khoi Pham, Hoang-Bao Le |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-25428
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Alibaba International E-commerce Product Search Competition DcuRAGONs Team Technical Report Thang-Long Nguyen-Ho, Minh-Khoi Pham, Hoang-Bao Le Abstract This report details our methodology and results developed for the Multilingual E-commerce Search Competition. The problem aims to recognize relevance between user queries versus product items in a multilingual context and improve recommendation performance on e-commerce platforms. Utilizing Large Language Models (LLMs) and their capabilities in other tasks, our data-centric method achieved the highest score compared to other solutions during the competition 1 1 1 Final leaderboard is publised at https://alibaba-international-cikm2025.github.io 2 2 2 The source code for our project is published at https://github.com/nhtlongcs/e-commerce-product-search . 1 Introduction Generative Recommendation, the cornerstone of modern e-commerce, directly impacts user satisfaction and commercial success. The challenge in the recommendation systems lie in aligning the target user’s product with the recommended product by assessing the relevance of the query and other product features. In the context of this technical report, two key tasks are outlined: (1) Multilingual Query-Category Relevance Task , which measures the semantic alignment between a user’s search query and a candidate product category, and (2) the Multilingual Query-Item Relevance Task , which evaluates whether a multilingual query is pertinent to a specific product listing. The dataset was aggregated from real-world multilingual search logs across Alibaba AIDC’s global e-commerce platforms (AliExpress, Lazada, Daraz, Trendyol, and Mirivia), serving millions of users in over 100 countries and over 20 languages. While domain experts provided annotations where possible, queries are frequently noisy, ambiguous, and code-mixed, and several languages lack sufficient expert coverage. Consequently, building models that generalize strongly and can deliver accurate, efficient retrieval on languages with little or no labelled training data is essential. Successfully tackling these tasks requires overcoming several challenges : (i) queries may come from multiple languages, including low-resource ones unseen during training ; (ii) real-world queries often contain noise such as misspellings, abbreviations, or mixed-language tokens; and (iii) the hierarchical nature of product categories requires models to capture both fine-grained semantics and structural consistency. Our primary approach can be summarized as follows: 1. Systematically compared small-to-large multilingual LLMs to identify architectures that balance performance and computational efficiency . We leveraged translation augmentation (TA) to boost cross-lingual alignment and established a robust baseline for multilingual e-commerce relevance tasks. 2. Demonstrated the effectiveness of a two-stage training, showing that task-adaptive pre-training (TAPT) on a related, large-scale dataset significantly enhances the model’s performance compared to direct fine-tuning on the target task alone. 3. Proposed a category-aware, query-grouped cross-validation split strategy (CA split) that prevents identical queries from appearing across folds and balances hierarchical category distributions. This ensures a more accurate assessment of a model’s ability to generalize. 2 Our methodology Our approach is built upon the hypothesis that a multilingual Large Language Model (LLM), further adapted to the e-commerce domain, is essential for tackling the challenges of noisy, multilingual search queries and generalizing to unseen languages. In Section 2.1 , we describe our choice of multilingual LLM architectures and our translation augmentation (TA) approach to form a semantically enriched representation. Section 2.2 details our supervised TAPT method, in which the model is first pretrained on a related auxiliary task before being fine-tuned on the final target task. Finally, Section 2.3 introduces our CA split strategy, which groups identical queries and category prefixes to provide a robust estimate of real-world generalization. 2.1 Model Architecture Given the multilingual nature of the dataset, which includes numerous unseen and low-resource languages, we hypothesize that a foundational model pre-trained on a vast corpus of cross-lingual data will yield superior performance. Consequently, we select a transformer-based multilingual LLM as the backbone of our solution. These models are designed to learn shared representations across multiple languages. They are inherently suitable for zero-shot or few-shot generalization to languages not explicitly seen during the fine-tuning phase. To address language variability and potential sparsity, we augment each query with an English-translated version . Formally, let q_{\text{orig}} denote the original user query and M_{\text{trans}} a high-quality machine translation model. The English translation is obtained as: q_{\text{en}}=M_{\text{trans}}(q_{\text{orig}}). We then construct the input sequence x as: x=[\text{CLS}]\;q_{\text{orig}}\;-\;q_{\text{en}}\;[\text{SEP}]\;t\;[\text{SEP}], where t is the target text (either the category path or item details), and - represents concatenation with a separator token. The motivations behind this design include (1) q_{\text{en}} serves as a universal pivot , guiding the model when it encounters unseen or low-resource languages by grounding the meaning in a high-resource, semantically rich representation (2) Retaining q_{\text{orig}} ensures that the model preserves fine-grained linguistic cues and avoids performance degradation on languages where it has sufficient training coverage. The concatenated sequence x is fed into the multilingual encoder M_{\text{enc}} to obtain contextual embeddings: H=M_{\text{enc}}(x),\quad H=[h_{\text{CLS}},h_{1},h_{2},\dots,h_{n},h_{\text{emb}}], where h_{\text{emb}} represents the hidden state of the last non-padding token. This vector is then passed through a classification head f_{\theta} to produce the predicted relevance score: \hat{y}=f_{\theta}(h_{\text{emb}}). To enhance training efficiency and stability, we apply parameter-efficient fine-tuning via LoRA adapters ( Hu et al. 2022 ) , enabling the model to specialize for this task while preserving its pretrained multilingual knowledge. 2.2 Task-Adaptive Pre-training While general-purpose multilingual LLMs possess extensive world knowledge, they often lack familiarity with the domain-specific terminology, abbreviations, and semantic patterns that occur in e-commerce search logs. To bridge this gap, we introduce an intermediate task-adaptive pretraining (TAPT) stage prior to final fine-tuning. Specifically, given two related tasks—Query-Category (QC) relevance prediction and Query-Item (QI) relevance prediction—we first perform supervised pretraining on the auxiliary task with its available labeled data, using a classification objective. This allows the model to understand better domain-specific entities, abbreviations, and the semantic relationships prevalent in online shopping environments, thereby improving its effectiveness on the target relevance tasks. Formally, given a set of training pairs \{(x_{i},y_{i})\}_{i=1}^{N} from the auxiliary task or the targeted task, we minimize the same supervised cross-entropy loss for both stage: \mathcal{L}=-\frac{1}{N}\sum_{j=1}^{N}y_{j}\log p_{\theta}(y_{j}\mid x_{j}). This two-stage process effectively specializes the model to the e-commerce domain, mitigating overfitting, improving generalization on low-resource languages, and yielding more stable convergence even in the presence of noisy or imbalanced data. 2.3 Cross-validation Strategy A naive random or even stratified split of the training data is insufficient for this competition due to the nature of the dataset. Such methods can lead to data leakage, where the model learns superficial correlations rather than generalizable patterns, resulting in an overestimation of its actual performance. To address this, we designed a custom cross-validation strategy tailored to the specific characteristics of each task. 2.3.1 Query-Item (QI) Task Splitting In the QI dataset, we observed that the same query often appears multiple times with different items and relevance labels. We enforce a strict query-based grouping to prevent information leakage, where the model might learn to recognize a query seen in the training set rather than understand its semantics. Specifically, we ensure that all data points sharing the exact query text are assigned to the same fold. Forcing the model to generalize to entirely unseen queries during validation provides a more sensible estimate of its performance on the hidden test set. The data is first grouped by query, and then these query groups are stratified by language and label distributions across the folds. 2.3.2 Query-Category (QC) Task Splitting For the QC task, a similar leakage risk exists, compounded