PromotionGo at SemEval-2025 Task 11: A Feature-Centric Framework for Cross-Lingual Multi-Emotion Detection in Short Texts
Ziyi Huang, Xia Cui · 2025
Read PromotionGo at SemEval-2025 Task 11: A Feature-Centric Framework for Cross-Lingual Multi-Emotion Detection in Short Texts by Ziyi Huang, Xia Cui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08499.txt.
Introduction
Ziyi Huang and Xia Cui describe their entry to a shared task on detecting emotions in short texts across many languages. A single text can carry several emotions at once, and the task covered twenty-eight languages. Their system, PromotionGo, adjusts its recipe per language instead of forcing one setup on all.
The team compared three recipe parts: how text is turned into numbers, how those numbers are slimmed down, and which learner trains on them. Simple word counts still won in languages with little data. Richer text embeddings helped elsewhere, each with language-specific strengths. Slimming the numbers cut training time without hurting scores. The study maps which choices pay off where, a guide for building emotion tools in low-resource languages.
Catalog record
| CREATOR | Ziyi Huang, Xia Cui |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08499
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PromotionGo at SemEval-2025 Task 11: A Feature-Centric Framework for Cross-Lingual Multi-Emotion Detection in Short Texts Ziyi Huang, Xia Cui Abstract This paper presents our system for SemEval 2025 Task 11: Bridging the Gap in Text-Based Emotion Detection (Track A) ( Muhammad et al. 2025b ) , which focuses on multi-label emotion detection in short texts. We propose a feature-centric framework that dynamically adapts document representations and learning algorithms to optimize language-specific performance. Our study evaluates three key components: document representation, dimensionality reduction, and model training in 28 languages, highlighting five for detailed analysis. The results show that TF-IDF remains highly effective for low-resource languages, while contextual embeddings like FastText and transformer-based document representations, such as those produced by Sentence-BERT, exhibit language-specific strengths. Principal Component Analysis (PCA) reduces training time without compromising performance, particularly benefiting FastText and neural models such as Multi-Layer Perceptrons (MLP). Computational efficiency analysis underscores the trade-off between model complexity and processing cost. Our framework provides a scalable solution for multilingual emotion detection, addressing the challenges of linguistic diversity and resource constraints. 1 Introduction Emotion labeling in Natural Language Processing (NLP) is critical for enabling machines to better interpret human emotional expressions, fostering empathetic and context-aware AI systems. Traditional single-label emotion detection oversimplifies human affect by assigning a single dominant emotion to text, ignoring the complex spectrum of overlapping emotions often present in real-world scenarios ( Plutchik 2001 ) . In contrast, multi-label emotion detection aligns more closely with authentic human experiences, where texts may simultaneously express multiple emotions (e.g., joy and surprise, or sadness and anger). It provides ecologically valid representations of emotional complexity, better reflecting nuanced psychological states. However, multi-label emotion detection can be challenging, such as models must account for emotion co-occurrence, resolve subtle semantic ambiguities, and avoid overfitting to sparse or imbalanced label distributions ( Ekman 1992 ; Wang et al. 2016 ; Zhang et al. 2018 ) . Traditional approaches to multi-label emotion detection have predominantly relied on feature-centric frameworks that leverage handcrafted linguistic and statistical features. While effective in monolingual settings, such frameworks often required language-specific resources (e.g., lexicons for each target language ( Baccianella et al. 2010 ) ), limiting cross-lingual scalability. These features (e.g., lexicons, syntactic patterns) often fail to model the complex interdependencies and contextual nuances required for multi-label emotion detection, as they struggle to capture dynamic label correlations and contextualized affective semantics ( Baccianella et al. 2010 ; Mohammad et al. 2018 ; Bostan and Klinger 2018 ) . In this paper, we conduct a comprehensive study on the development of a feature-centric framework to address the challenges of cross-lingual adaptability and multi-label emotion detection through a three-stage methodological pipeline: (1) feature extraction/document representation, (2) dimensionality reduction and (3) model training. For (1), we unify diverse feature representations ranging from interpretable shallow features (e.g., TF-IDF, Bag-of-Words) to contextually rich embeddings (e.g., FastText, BPE) and Transformer-based semantic encodings (e.g., Sentence-BERT). For (2), we reduce the dimensionality of document representations to prevent model overfitting and accelerate the subsequent step. For (3), we systematically evaluate traditional machine learning classifiers (e.g., SVM, RF) and deep learning architectures (e.g., MLP) to optimize label dependency modeling. The modular design allows interchangeable classifier integration, balancing interpretability (via traditional models) and performance (via neural approaches) for diverse multilingual use cases. The source code for this paper is publicly available on GitHub 1 1 1 https://github.com/YhzyY/SemEval2025-Task11 . 2 Background and System Overview The development pipeline within the system comprised three distinct stages: (1) feature representation utilizing a diverse set of techniques such as TF-IDF, FastText and Sentence-Transformers, (2) dimensionality reduction of feature vectors via Principal Component Analysis (PCA), and (3) model training and prediction employing a suite of algorithms such as Decision Trees (DT) and Multi-Layer Perceptrons (MLP). 2.1 Document Representation Raw text data in human languages are sequences of variable-length symbolic representations, which challenge machine learning algorithms that require fixed-size numeric vectors ( Mikolov et al. 2013 ) . An effective document representation is essential for optimal NLP performance. To address the complexities of multi-language data, various feature representation techniques have been explored. 2.1.1 Traditional Features The traditional approaches represent a document d by creating a list of unique words and assigning each word w a numeric value, such as Bag of words (BoW) and Term Frequency-Inverse Document Frequency (TF-IDF). We use scikit-learn’s CountVectorizer to extract BoW features, which represent word occurrence in a document without considering word frequency or significance. This approach considers all words equally, including common terms like “ the ” or “ a ”, which carry minimal meaningful information. In contrast, TF-IDF adjusts for the importance of words by considering both their frequency in a document (TF) and their rarity across the corpus (IDF), reducing the impact of common words. We use scikit-learn’s TfidfVectorizer , where IDF is computed as: \mathrm{IDF}(w,d)=\log\frac{1+N}{1+\mathrm{DF}(w)}+1 (1) where N is the total number of documents and DF( w ) is the document frequency of w . Preprocessing is critical in traditional feature representations, since it directly influences feature quality and model training. To adapt our model to multilingual scenarios and capture nuanced emotional expressions, we employ GemmaTokenizer ( Shelpuk 2024 ) in the tokenization step, instantiated with the preset " gemma_2b_en ". Trained on a diverse multilingual corpus, GemmaTokenizer excels in handling linguistic diversity and demonstrates robust performance in multilingual tokenization tasks. 2.1.2 Pretrained Word Embeddings Traditional methods like TF-IDF and BoW treat words as discrete, independent units, thereby completely discarding word order and local contextual information during the encoding process, leading to high-dimensional, sparse representations that limit computational efficiency and NLP task performance ( Mikolov et al. 2013 ; Pennington et al. 2014 ) . In addition, their heavy reliance on training corpus results in their inability to handle out-of-vocabulary (OOV) words, as they lack a mechanism to infer the representation or meaning of terms that are not present in the training corpus. Pre-trained word embeddings offer substantial advantages in capturing semantic meaning, contextual dependencies, and generalization capabilities. Unlike traditional sparse representations, these dense vector embeddings encode rich linguistic features by leveraging large-scale corpora during pretraining, enabling them to model nuanced semantic relationships and syntactic patterns. FastText ( Bojanowski et al. 2017 ) can capture both syntactic and semantic relationships by effectively modeling morphological structures. Byte Pair Embeddings (BPEs) ( Heinzerling and Strube 2018 ) decompose words into subwords, while Contextual String Embeddings (CSEs) ( Akbik et al. 2018 ) provide context-sensitive representations, dynamically adapting to word meanings. We use the Flair NLP Toolkit 2 2 2 https://github.com/flairNLP/flair to extract these embeddings and DocumentPoolEmbeddings for aggregating word-level embeddings into document-level representations via mean pooling. Given that the cross-lingual representation ability of most mainstream pre-trained language models remains constrained by the limited coverage of training corpora, these models often manifest systematic representational failures when processing low-resource languages excluded from training data. This closed-corpus modeling paradigm inherently imposes significant capabilities limitations in multilingual scenarios. To address this, we leverage Large Language Models (LLMs) to assist with unseen languages by leveraging language family classification. Considering a low-resource language such as the Oromo language, it is not included in the pre-trained FastText embeddings, as outlined in the FastText documentation ( Bojanowski et al. 2017 ) . we use Baidu Qianfan