Alibaba International E-commerce Product Search Competition DILAB Team Technical Report

Hyewon Lee, Junghyun Oh, Minkyung Song, Soyoung Park, Seunghoon Han · 2025

Read Alibaba International E-commerce Product Search Competition DILAB Team Technical Report by Hyewon Lee, Junghyun Oh, Minkyung Song, Soyoung Park, Seunghoon Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18499.txt.

Introduction

Hyewon Lee and her four co-authors report on the search system their DILAB team built for an Alibaba competition on multilingual online shopping search. Shoppers type queries in many languages, and the system must match them to the right product categories and items. The team's entry finished fifth on the final leaderboard, with steady, strong scores across the evaluation measures.

Their pipeline worked in stages. First, careful data cleaning improved consistency and category coverage, while language tagging and noise removal raised input quality. Then several model designs and fine-tuning plans were tried, with settings tuned on curated validation sets to balance the query-category and query-item tasks. The authors credit the system's robustness across languages and product areas to disciplined data curation and repeated evaluation rather than to any single model, and they released the code publicly.

Catalog record

CREATORHyewon Lee, Junghyun Oh, Minkyung Song, Soyoung Park, Seunghoon Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-18499

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Alibaba International E-commerce Product Search Competition DILAB Team Technical Report Thanks: Presented at the 34th ACM International Conference on Information and Knowledge Management (CIKM’25), November 10–14, 2025, Seoul, Republic of Korea. © 2025 DILAB. Licensed under CC BY 4.0 . CCS: Information systems Retrieval effectiveness CCS: Computing methodologies Supervised learning by classification CCS: Computing methodologies Information extraction Hyewon Lee, Junghyun Oh, Minkyung Song, Soyoung Park, Seunghoon Han Abstract . This study presents the multilingual e-commerce search system developed by the DILAB team, which achieved 5th place on the final leaderboard with a competitive overall score of 0.8819, demonstrating stable and high-performing results across evaluation metrics. To address challenges in multilingual query–item understanding, we designed a multi-stage pipeline integrating data refinement, lightweight preprocessing, and adaptive modeling. The data refinement stage enhanced dataset consistency and category coverage, while language tagging and noise filtering improved input quality. In the modeling phase, multiple architectures and fine-tuning strategies were explored, and hyperparameters optimized using curated validation sets to balance performance across query-category (QC) and query–item (QI) tasks. The proposed framework exhibited robustness and adaptability across languages and domains, highlighting the effectiveness of systematic data curation and iterative evaluation for multilingual search systems. The source code is available at https://github.com/2noweyh/DILAB-Alibaba-Ecommerce-Search . 1. Introduction Alibaba International Digital Commerce (AIDC) 1 1 1 https://www.alibabagroup.com operates AliExpress, Lazada, Daraz, Trendyol, and Mirivia, serving users in over 100 countries and 20 languages. The search engine is a core component for product discovery, and optimizing multilingual search quality is critical for user satisfaction and competitiveness. We address the problem of Multilingual E-commerce Product Search , focusing on two key tasks: the Query-Category (QC) relevance task , which determines whether a query matches a product category, and the Query-Item (QI) relevance task , which evaluates whether a query corresponds to a specific product listing. Together, these tasks form the foundation of multilingual e-commerce search. Table 1 . Per-language sample counts in the QC and QI train and test datasets, illustrating the distribution of data across languages for multilingual relevance evaluation. Language Code QC QI Train Test Train Test English en 50k 10k 50k 10k Spanish es 50k 10k 50k 10k French fr 50k 10k 50k 10k Japanese ja 50k 10k 45k 10k Korean ko 50k 10k 45k 10k Portuguese pt 50k 10k 50k 10k Thai th – – 50k 10k Arabic ar – 10k – 10k German de – 10k – 10k Italian it – 10k – 10k Polish pl – 10k – 10k Indonesian id – – – 10k Vietnamese vn – – – 10k Meanwhile, the datasets used in this competition — namely, the QC and QI datasets — were constructed from multilingual search logs and annotated by domain experts. Each dataset includes the query language, original query text, a corresponding element (either a category path or an item title), and a binary relevance label. Table 1 summarizes key statistics of the QC and QI datasets, indicating that some languages appear only in the dev and test sets but not in the training data. Figure 1 further illustrates a mild label imbalance and variations in language distribution across the datasets; however, neither issue was severe enough to require correction ( Ghosh et al. 2024 ; Johnson and Khoshgoftaar 2019 ; Van den Goorbergh et al. 2022 ) . Figure 1 . Label ratio distribution across languages in the QC and QI training datasets. This finding underscores the importance of multilingual processing and the ability to generalize to unseen languages. To address this challenge, large language models (LLMs) with strong cross-lingual transfer and generalization capabilities have proven particularly effective. However, the performance of LLMs depends not only on the quantity of available data but, more critically, on its quality. Prior studies have emphasized that massive amounts of high-quality data are essential for effective LLM training ( Zhang et al. 2024 ) , and have further shown that systematic data filtering can yield better performance than using raw data indiscriminately ( Li et al. 2024 ) . In line with these findings, our study highlights that data quality management and refinement are not optional but indispensable for successful model development. To address this, our team applied lightweight preprocessing and modeling strategies, including Quality Refinement (QR) to filter out low-quality data and enhance overall dataset quality, and Language Tagging (LT) for explicit multilingual signals. Task-specific strategies, such as Hierarchical Category Tagging (HCT) in QC, and Semantic Item Tagging (SIT) and Description Generation (DG) in QI, were also deployed. In addition, we incorporated advanced modeling techniques such as In-context Learning (ICL) and Chain-of-Thought (CoT) reasoning to strengthen the model’s ability to generalize across languages and complex query structures. Together, these strategies are designed to enhance the model’s cross-lingual relevance prediction, consistent with prior studies showing the effectiveness of query augmentation for improving multilingual search performance ( Cakir and Gurkan 2023 ; Wang et al. 2025 ) . We focus on developing and applying LLMs that can handle multilingual data in e-commerce search. Using the QC and QI datasets, we leverage the multilingual capabilities of a pre-trained LLM with lightweight preprocessing strategies to improve relevance prediction across languages and tasks, ultimately enhancing search quality in global e-commerce environments. Our team advanced to the final round and achieved 5th place on the final leaderboard. Our main contributions can be summarized as follows: • We propose an efficient multilingual search framework that combines lightweight preprocessing with LLMs to improve cross-lingual relevance prediction for both QC and QI tasks. • We introduce task-specific enhancements, including HCT for QC and SIT with DG for QI, which enhance data quality and model interpretability. • Our team’s rigorous approach to data tagging and modeling was recognized with a Special Award at the Alibaba International E-commerce Product Search Competition, highlighting the originality and impact of our work. The following sections describe our methodology and experiments in detail. Section 2 presents the proposed approach based on the insights above, Section 3 outlines the experimental setup and results, and Section 4 concludes with findings and future directions. 2. Methodology Figure 2 . Overview of the proposed DILAB framework for the QC and QI tasks. In this section, we present the overall methodology for the QC and QI tasks in multilingual e-commerce search. Our approach follows a unified pipeline. This pipeline, illustrated in Figure 2 , is composed of the following four key components: (1) Quality Refinement (QR): filters out noisy or low-quality samples to improve dataset reliability. (2) Tagging: injects explicit linguistic and structural cues to enhance representational richness. (3) In-Context Learning (ICL) and Chain-of-Thought (CoT): strengthen multilingual reasoning and generalization. (4) LLM Training and Prediction: integrates all components into a unified multilingual relevance model. This pipeline is specifically designed to improve both data quality and the generalization ability of large language models across diverse languages and product domains. 2.1. Quality Refinement (QR) To improve dataset quality, we designed a self-evaluation refinement that integrates model predictions with lexical similarity measures. The QR process operates in two steps: (1) LLM Fine-Tuning and Prediction; and (2) Self-Evaluation and Quality Cleaning. This refinement pipeline ensures that mislabeled or noisy data are filtered out before downstream training. By embedding TF-IDF/Jaccard–based lexical similarity within a self-evaluation phase, the model

Read the complete text