Small Stickers, Big Meanings: A Multilingual Sticker Semantic Understanding Dataset with a Gamified Approach Conference: Under Review.; ;
Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma, Min Zhang · 2025
Read Small Stickers, Big Meanings: A Multilingual Sticker Semantic Understanding Dataset with a Gamified Approach Conference: Under Review.; ; by Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma, Min Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01668.txt.
Introduction
Heng Er Metilda Chee and four co-authors study in 2025 how well machines grasp the sense of chat stickers. The small images pack much meaning and appear in chats across cultures, genders, and age groups. Yet retrieval, the search for the right sticker from a text query, has drawn scant study. Good query sets take hard hand work, and taste plays a large part. Large language models do well at broad language tasks but fail at the fine sense such queries need.
Sticktionary, a game that draws varied, apt queries from players, comes first. Next comes StickerQueries, a multilingual set with 1,115 English and 615 Chinese queries. More than 60 people built it in over 60 hours of play. Tests by counts and by close reading show gains in query quality, search hits, and sticker sense. The team shares the set and two tuned models in public.
Catalog record
| CREATOR | Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma, Min Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01668
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Small Stickers, Big Meanings: A Multilingual Sticker Semantic Understanding Dataset with a Gamified Approach Conference: Under Review.; ; Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma, Min Zhang Abstract . Stickers, though small, are a highly condensed form of visual expression, ubiquitous across messaging platforms and embraced by diverse cultures, genders, and age groups. Despite their popularity, sticker retrieval remains an underexplored task due to the significant human effort and subjectivity involved in constructing high-quality sticker query datasets. Although large language models (LLMs) excel at general NLP tasks, they falter when confronted with the nuanced, intangible, and highly specific nature of sticker query generation. To address this challenge, we propose a threefold solution. First, we introduce Sticktionary, a gamified annotation framework designed to gather diverse, high-quality, and contextually resonant sticker queries. Second, we present StickerQueries, a multilingual sticker query dataset containing 1,115 English and 615 Chinese queries, annotated by over 60 contributors across 60+ hours. Lastly, Through extensive quantitative and qualitative evaluation, we demonstrate that our approach significantly enhances query generation quality, retrieval accuracy, and semantic understanding in the sticker domain. To support future research, we publicly release our multilingual dataset 1 1 1 https://huggingface.co/datasets/metchee/sticker-queries along with two fine-tuned query generation models 2 2 2 https://huggingface.co/metchee/sticker-query-generator-en 3 3 3 https://huggingface.co/metchee/sticker-query-generator-zh . 1. Introduction Stickers have become an integral component of modern digital communication. Widely used across diverse demographics—spanning genders, cultures, and age groups—they enrich messaging experiences by conveying emotions, reactions, and humor in a compact, expressive format. While several sticker datasets have been developed, few resources focus on the task of sticker retrieval, despite its centrality in real-world applications. This gap is largely due to the intensive human effort required to create high-quality datasets, and the challenges of interpreting and formalizing the rich semantics embedded in sticker use. Despite their small size, stickers are capable of conveying deeply nuanced human emotions. For instance, expressing mild annoyance, frustration, or sarcasm might be easily achieved with a single sticker (e.g., Fig. 1 ), but would require a verbose textual explanation. Sticker queries often involve a rich interplay of modalities—such as sound (e.g., “bleh bleh bleh”), action (“ghost face”), emotion (“whatever”), culture (“nenenipoopoo”), thought (“can’t do nothing”), and tone. These phenomena are observed across both Chinese and English contexts. Generating such queries requires cultural sensitivity, contextual understanding, and linguistic precision—capabilities that even advanced vision-language models (VLMs) struggle to replicate. Sticker query generation is prone to hallucinations, and typical models often fail to grasp the subtle social and emotional layers stickers encode. Figure 1. Base VLM models are unable to understand and generate accurate sticker search queries, which requires depth and precision, oftentimes hallucinating. This persists in both English and Chinese languages. To address these limitations, we introduce StickerQueries, a multilingual sticker query dataset for understanding and retrieving stickers in context. We summarize our contributions in the following: (1) We propose Sticktionary, a gamified annotation framework that encourages contributors to create expressive, context-rich sticker queries through an engaging game-based interface. This design fosters the generation of high-quality and semantically resonant queries. (2) We construct and release StickerQueries, a dataset consisting of 1,115 English and 615 Chinese queries, annotated by over 60 contributors with more than 60 hours of effort. We also release two fine-tuned query generation models on Hugging Face. (3) Through extensive experiments, we demonstrate significant improvements in sticker retrieval and query generation performance, underscoring the effectiveness of our dataset and methodology. 2. Related Work Table 1. Comparison of sticker query datasets sorted by year. Datasets supporting English queries and publicly available are highlighted in bold. Until now, no sticker intention dataset has been publicly available except our proposed StickerQueries. Dataset Year Description Pub. Avail? Have Queries? Query Language? Native English Query? Sticker Dialogues SRS, PESRS ( Gao et al. 2021 ; Gao et al. 2020 ) 2020 Sticker dialogues. ✗ ✗ ✗ ✗ MOD ( Fei et al. 2021 ) 2021 Sticker dialogues ✓ ✗ ✗ ✗ StickerInt ( Liang et al. 2024 ) 2024 Sticker dialogues ✗ ✗ ✗ ✗ MCDSCS ( Shi and Kong 2024 ) 2024 Sticker dialogues. ✓ ✗ ✗ ✗ STICKERCONV ( Association for Computational Linguistics 2024 and Zhang 2024 ) 2024 Simulated sticker dialogues. ✓ ✗ ✗ ✗ U-Sticker ( Chee et al. 2025 ) 2025 Continuous sticker dialogues. ✓ ✗ ✗ ✗ MultiChat ( Wang et al. 2025 ) 2025 Sticker dialogues. ✓ ✗ ✗ ✗ Sticker Sentiment Analysis CSMSA ( Ge et al. 2022 ) 2022 Sticker sentiment. ✗ ✗ ✗ ✗ Sticker820K ( Zhao et al. 2023 ) 2023 Sticker sentiment. ✗ ✗ ✗ ✗ SER30K ( Liu et al. 2022 ) 2022 Sticker sentiment. ✓ ✗ ✗ ✗ Basic Sticker Collections ChineseB2B ( Zhaoolee 2024 ) 2000 Sticker images. ✓ ✗ ✗ ✗ TGIF ( Li et al. 2016 ) 2016 GIF captioning. ✓ ✗ ✗ ✗ VSD2M ( Yuan et al. 2025 ) 2025 Animated sticker dataset. ✓ ✗ ✗ ✗ Sticker Queries StickerTag ( Wang et al. 2024 ) 2024 Sticker-tag. ✗ Unknown Unknown Unknown PerSRV ( Chee et al. 2024 ) 2024 Sticker search query. ✗ ✓ ZH ✗ StickerQueries 2025 Sticker search query. ✓ ✓ EN, ZH ✓ With the onset of instant messaging, we have observed significant advancements in sticker dataset retrieval. However, given the complexity and diversity of sticker tasks, existing datasets still represent only the tip of the iceberg. We broadly categorize these datasets into four groups: sticker dialogues, sticker sentiment analysis, basic sticker collections, and sticker queries. Sticker dialogues typically consist of truncated conversations designed to support sticker retrieval or recommendation ( Gao et al. 2021 ; Gao et al. 2020 ; Fei et al. 2021 ; Liang et al. 2024 ; Shi and Kong 2024 ; Association for Computational Linguistics 2024 and Zhang 2024 ; Wang et al. 2025 ) , whereas U-Sticker ( Chee et al. 2025 ) uniquely provides continuous user information, temporal context, and domain-specific sticker conversations. Among these, several datasets are publicly available, while others remain private or unavailable. Sticker sentiment datasets focus on predicting the sentiment conveyed by stickers, either as binary positive/negative labels ( Ge et al. 2022 ) or more fine-grained classifications ( Liu et al. 2022 ) . Some, like Sticker820K ( Zhao et al. 2023 ) , also include supplementary information such as OCR text and descriptive metadata. Within this category, SER30K is publicly accessible, while others are not. Basic sticker collections mainly provide raw sticker images or GIFs for general usage or generation tasks. Examples include ChineseB2B ( Zhaoolee 2024 ) , which offers a large collection of sticker images, TGIF ( Li et al. 2016 ) for GIF captioning, and the recently introduced VSD2M ( Yuan et al. 2025 ) , an animated sticker dataset intended for sticker generation. Finally, sticker queries datasets are critical as they capture the underlying intention behind sticker usage through condensed, highly precise keywords or search queries. Unfortunately, datasets like StickerTag ( Wang et al. 2024 ) and PerSRV ( Chee et al. 2024 ) are not publicly available for analysis. Though PerSRV ( Chee et al. 2024 ) provides an open source model, their training is limited purely to Chinese queries, restricting its applicability