A Semi-supervised Scalable Unified Framework for E-commerce Query Classification

Chunyuan Yuan, Chong Zhang, Zheng Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law · 2025

Read A Semi-supervised Scalable Unified Framework for E-commerce Query Classification by Chunyuan Yuan, Chong Zhang, Zheng Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-21049.txt.

Introduction

Online shops must guess what a shopper wants from a few typed words, a job called query classification that covers both intent and product category. Yuan and co-authors note that shop queries are short and thin on context. Most training data comes from clicks after the fact, which traps the system in a cycle where already popular items gather still more data. They propose a semi-supervised framework, SSUF, that unifies the subtasks in one system.

Three pluggable modules do the work. One adds world knowledge to enrich the query. One uses label meanings and semi-supervised signals to cut the reliance on click labels. One models the complex relations among labels. Parts can be added or removed to fit each subtask. In offline tests and online A/B trials, SSUF beat the strongest existing models by a wide margin, according to the authors.

Catalog record

CREATORChunyuan Yuan, Chong Zhang, Zheng Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-21049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Semi-supervised Scalable Unified Framework for E-commerce Query Classification Chunyuan Yuan, Chong Zhang, Zheng Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law Abstract Query † † footnotetext: * Corresponding author. classification, including multiple subtasks such as intent and category prediction, is vital to e-commerce applications. E-commerce queries are usually short and lack context, and the information between labels cannot be used, resulting in insufficient prior information for modeling. Most existing industrial query classification methods rely on users’ posterior click behavior to construct training samples, resulting in a Matthew vicious cycle. Furthermore, the subtasks of query classification lack a unified framework, leading to low efficiency for algorithm optimization. In this paper, we propose a novel S emi-supervised S calable U nified F ramework (SSUF), containing multiple enhanced modules to unify the query classification tasks. The knowledge-enhanced module uses world knowledge to enhance query representations and solve the problem of insufficient query information. The label-enhanced module uses label semantics and semi-supervised signals to reduce the dependence on posterior labels. The structure-enhanced module enhances the label representation based on the complex label relations. Each module is highly pluggable, and input features can be added or removed as needed according to each subtask. We conduct extensive offline and online A/B experiments, and the results show that SSUF significantly outperforms the state-of-the-art models. 1 Introduction E-commerce platforms like Amazon, Taobao, and JD provide users with billions of diverse products and have become essential in our daily lives. Due to the wide variety of user needs and product categories, capturing users’ purchasing intentions is vital for both user experience and platform efficiency. Query classification, including intent, category, and brand prediction, plays a key role in understanding users’ shopping needs and supports the subsequent modules of the search system. The inherent characteristics of e-commerce queries, which are typically short, and ambiguous, bring significant challenges for query classification. To solve the problem of insufficient information caused by short queries, some deep learning-based models, such as XML-CNN Liu et al. 2017 , KRF Ma et al. 2020 , HiAGM Zhou et al. 2020 , and LSAN Xiao et al. 2019 have been proposed to learn the contextual information of documents to enhance the representation learning of queries. Some recent query classification models, such as HCL4QC Zhu et al. 2023 , SMGCN Yuan et al. 2024 , and HQC He et al. 2024 also explore utilizing the hierarchical category tree structure or instance hierarchy to facilitate models to learn external information beyond query information. Industrial methods for query classification typically rely on users’ click behavior to generate training samples. While using real user interactions can improve model accuracy, it also introduces a dependency cycle known as the “Matthew effect.” This cycle leads to biased training data, where popular queries receive excessive focus, skewing the model’s understanding and limiting its ability to generalize to tail queries. Moreover, existing models often handle subtasks separately, overlooking potential synergies that could enhance efficiency in model optimization and development. The lack of a unified framework further impedes the sharing of insights and improvements across different subtasks, thereby restricting overall performance. To address these challenges, we propose a semi-supervised scalable unified framework (SSUF) for e-commerce query classification. SSUF is designed to overcome the above problems by introducing a set of scalable modules: (1) Label-enhanced module, (2) Knowledge-enhanced module, and (3) Structure-enhanced module to enhance query and label representations with prior knowledge, reduce dependency on posterior labels and enhances the model’s ability to generalize from limited data. Each module within SSUF is designed to be highly pluggable, allowing for flexible adaptation to the specific needs of different subtasks. This modularity ensures that the framework can be tailored to enhance various aspects of query classification. The contributions of this paper are as follows: • We propose a novel unified framework to improve the optimization efficiency of e-commerce query classification models. • We design three scalable modules that enhance the query and label representations and break the “Matthew vicious cycle” to improve the performance of query classification. • We conduct extensive offline and online A/B experiments, and SSUF significantly outperforms existing strong baselines. It has been deployed at an e-commerce platform and brings great commercial value. 2 Related Work 2.1 Multi-label Classification Multi-label classification is a vital area in machine learning, where each instance can be linked to multiple labels. Machine learning methods address this problem by transforming the multi-label problem into several single-label tasks Tsoumakas et al. 2007 ; Tsoumakas et al. 2009 ; Read et al. 2011 . Recently, deep learning models, such as XML-CNN Liu et al. 2017 , LSAN Xiao et al. 2019 and LEAM Wang et al. 2018 utilize contextual information or label-specific attention to enhance the interaction between document and labels for classification. Figure 1: Semi-supervised Scalable Unified Framework for E-commerce Query Classification. The offline part participates in the training of the model but is not directly deployed online. The part with red dashed lines is a pluggable module. The “Text Encoder*” denotes a shared text encoder. 2.2 Query Classification Early models mainly relied on deep learning models, such as CNN Hashemi et al. 2016 , LSTMs Sreelakshmi et al. 2018 , and attention-based models Zhang et al. 2021 ; Yuan et al. 2023 to extract fine-grained features for classification. Recent works like PHC Zhang et al. 2019 explore multi-task frameworks to jointly optimize query classification and textual similarity, while DPHA Zhao et al. 2019 leverages label graph-based neural networks to model label correlations. HCL4QC Zhu et al. 2023 , SMGCN Yuan et al. 2024 , and HQC He et al. 2024 use hierarchical structures and instance hierarchy to learn information beyond query text. 3 Model In this section, we first formally define the query classification task. Then, we describe different modules of SSUF and analyze the influence of the model during the training and inference process. 3.1 Label-enhanced Module Instead of directly using the label index as label embedding, we employ BERT Kenton and Toutanova 2019 as the encoder for labels to learn the semantic representation of the label. The input of the text encoder is a character sequence of label, which is comprised of two parts: (1) the label name n=[n_{1},n_{2},\ldots,n_{L}] , and (2) the enhanced label side information m=[m_{1},m_{2},\ldots,m_{L_{m}}] , which is retrieved from (1) label description, such as product words, frequently searched query terms, etc. (2) world knowledge generated by LLM. The label’s character sequences are fed into BERT to encode label representation: \mathbf{C}_{j}=\mathbf{BERT_{CLS}}([n_{1},\ldots,n_{L},m_{1},\ldots,m_{L_{m}}])\,, (1) where \mathbf{C}_{j}\in\mathbb{R}^{1\times d} is the “CLS” representation of the last layer of BERT. In the same way, we can get the representation of query \mathbf{Q}_{i}\in\mathbb{R}^{1\times d} . 3.2 Knowledge-enhanced Module Industrial methods for query classification have relied on users’ posterior click behavior to generate training samples. However, it leads to the "Matthew vicious cycle" and results in biased training data, where popular queries receive more attention, skewing the model’s understanding and limiting its ability to generalize to less frequent queries. We propose a semi-supervised module to overcome the limitations of posterior labels. However, we found that for queries with ambiguous semantics, it is often inaccurate to directly compute semi-supervised labels for queries and labels. For example, the query “Black 16pro” refers

Read the complete text