Curiosity Meets Cooperation: A Game-Theoretic Approach to Long-Tail Multi-Label Learning Journal: Expert Systems With Applications Corresponding author: Corresponding author
Canran Xiao 1,* , Chuangxin Zhao 2 , Zong Ke 3 , Fei Shen 4 · 2025
Read Curiosity Meets Cooperation: A Game-Theoretic Approach to Long-Tail Multi-Label Learning Journal: Expert Systems With Applications Corresponding author: Corresponding author by Canran Xiao 1,* , Chuangxin Zhao 2 , Zong Ke 3 , Fei Shen 4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17520.txt.
Introduction
Canran Xiao, with Chuangxin Zhao and two co-authors, attacks rare label neglect in a 2025 arXiv paper. Many tagging tasks assign several labels to each item, but a few common labels dominate training. Rare labels then get ignored, even though they often matter most in practice. The authors recast the task as a cooperative game, meaning players who gain by working toward one shared score.
In their design, parts of the label set go to different players. Players earn bonus rewards for rare labels and for disagreeing with each other. These bonuses push learning toward the neglected tags without hand set class weights. Tests on standard and very large datasets showed clear gains on rare labels. Separate checks confirmed the players split the work.
Catalog record
| CREATOR | Canran Xiao 1,* , Chuangxin Zhao 2 , Zong Ke 3 , Fei Shen 4 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17520
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Curiosity Meets Cooperation: A Game-Theoretic Approach to Long-Tail Multi-Label Learning Journal: Expert Systems With Applications Corresponding author: Corresponding author Canran Xiao 1,* , Chuangxin Zhao 2 , Zong Ke 3 , Fei Shen 4 Abstract Long-tail imbalance is endemic to multi-label learning: a few head labels dominate the gradient signal, while the many rare labels that matter in practice are silently ignored. We tackle this problem by casting the task as a cooperative potential game. In our uriosity-Driven Game-Theoretic Multi-Label Learning (CD-GTMLL) framework, the label space is split among several cooperating ”players” that share a global accuracy payoff yet earn additional curiosity rewards that rise with label rarity and inter-player disagreement. These curiosity bonuses inject gradient on under-represented tags without hand-tuned class weights. We prove that gradient best-response updates ascend a differentiable potential and converge to tail-aware stationary points that tighten a lower bound on the expected Rare-F1 . Extensive experiments on conventional benchmarks and three extreme-scale datasets show consistent state-of-the-art gains, delivering up to + 4.3 % +4.3\% Rare-F1 and + 1.6 % +1.6\% P@3 over the strongest baselines, while ablations reveal emergent division of labour and faster consensus on rare classes. CD-GTMLL thus offers a principled, scalable route to long-tail robustness in multi-label prediction. 1 Introduction Multi-label classification (MLC) ( Zhang and Zhou 2013 ; Liu et al. 2021b ; Vergara et al. 2025 ) assigns multiple tags to each instance, powering applications from image recognition ( Zhao et al. 2021 ; Ma et al. 2024 ; Teng et al. 2025 ) and text categorization ( Maltoudoglou et al. 2022 ; Guo et al. 2021 ) to functional genomics ( Du and Hu 2022 ) . The per-label distribution is typically long-tailed ( Tarekegn et al. 2021 ; De Alvis and Seneviratne 2024 ) : head labels dominate while tail labels appear sporadically. This imbalance is exacerbated in MLC because (i) co-occurring labels make resampling risky, and (ii) metrics like mAP favor head labels. As a result, standard optimizers ( Ridnik et al. 2021 ) often learn head-biased boundaries, achieving high scores while failing on tail labels-problematic for safety-critical applications. In practice the per-label sample counts follow a heavy-tailed distribution: a handful of head labels dominate the data, whereas the vast majority of tail labels appear only sporadically, as shown in Fig. 1 . This long-tail imbalance ( Tarekegn et al. 2021 ; De Alvis and Seneviratne 2024 ) is particularly severe in the multi-label regime because (i) multiple labels co-occur within a single instance, so naïve resampling can destroy cross-label correlations, and (ii) evaluation metrics such as mAP or micro-F1 are disproportionately influenced by head labels, starving tail classes of gradient signal. Consequently, conventional optimizers ( Ridnik et al. 2021 ) that target average loss or accuracy often learn a head-biased decision boundary, yielding high headline scores while silently failing on the tail-an outcome that is unacceptable in safety-critical or comprehensive retrieval scenarios ( Barandas et al. 2024 ) . Figure 1: Real-world multi-label scenes are long-tailed : a few frequent classes (e.g., car , pedestrian , traffic light ) dominate while many rare classes (e.g., power pole , aerial work platform ) appear sparsely (left). A conventional single model may score well overall yet often overlooks these rare labels (top-right). Our approach replaces the monolith with a small set of cooperative experts that divide the work and then fuse their opinions into a single consensus prediction (bottom-right), improving tail coverage without sacrificing head performance. Canonical imbalance remedies include (i) data rebalancing via over/under-sampling or mix-up ( Liu et al. 2024 ; Charte et al. 2015 ; Huang et al. 2021 ; Pan et al. 2024 ) , (ii) cost-sensitive objectives such as class-balanced focal losses ( Zhao et al. 2023 ; Chen et al. 2022 ; Zhang et al. 2024 ) , and (iii) label-space partition or ensemble strategies ( Xu et al. 2019 ; Zou et al. 2024 ) . However, these techniques falter when labels overlap: simplistic sampling distorts co-occurrence statistics ( Gao et al. 2024 ; Duarte et al. 2021 ) , re-weighting heuristics require brittle hyper-tunings, and global loss surrogates remain head-dominated. What is missing is a mechanism that persistently incentivizes exploration of tail labels while preserving the relational structure among labels . We view long-tail MLC as a cooperative multi-player game . The label space is decomposed into overlapping subsets handled by distinct players (sub-predictors). Each player maximizes a shared global payoff (overall multi-label accuracy) plus an intrinsic curiosity reward that grows with label rarity and inter-player disagreement. Framing the learning dynamics as a differentiable potential game ( Fudenberg 1991 ) allows gradient-based best-response updates to converge to equilibria that jointly optimize head performance and tail discovery without manual re-weighting. The main contributions of this work are: 1) We propose Curiosity-Driven Game-Theoretic Multi-Label Learning ( CD-GTMLL )-the first framework to cast long-tail MLC as a cooperative game equipped with a curiosity mechanism that systematically amplifies tail-label gradients. 2) We provide theoretical guarantees that best-response updates ascend a global potential function encompassing both accuracy and curiosity, ensuring no player can ignore tail labels at equilibrium. 3) Extensive experiments on image and tabular benchmarks and their harder long-tail variants demonstrate consistent gains over state-of-the-art baselines. Through ablations and game-behavior diagnostics, we elucidate how label-space decomposition induces specialized tail experts, accelerates rare-label correction, and yields interpretable multi-agent cooperation. 2 Related Works 2.1 Multi-label learning foundations A classical taxonomy distinguishes problem-transformation from algorithm-adaptation methods ( Tsoumakas and Katakis 2007 ; Tsoumakas et al. 2010 ) . Transformation approaches reduce MLC to single-label problems: Binary Relevance (BR) trains one independent binary classifier per label, while Label Powerset (LP) treats each observed labelset as an atomic class; ensembles such as RAkEL randomly partition labels into k -sized subsets to balance tractability and dependency capture ( Read et al. 2011a ; Tsoumakas and Vlahavas 2011 ; Yao et al. 2024 ) . To better encode inter-label correlations without incurring LP’s exponential blow-up, Classifier Chains (CC) pass earlier label predictions as features to later ones, with Ensembles of CC (ECC) improving robustness via random chain orders ( Read et al. 2011a ) . For large label spaces, HOMER hierarchically partitions the output space to address scalability and class-imbalance issues ( Tsoumakas et al. 2008 ) . These foundations remain widely used baselines and inspire many modern variants ( Yao et al. 2023 ) . Beyond transformations, MLC also adapts standard learners to multi-label outputs. A canonical example is ML-KNN, which augments k -NN with Bayesian label inference and remains a competitive non-neural baseline ( Zhang and Zhou 2007 ) . Neural precursors for text further showed that simple feed-forward architectures with sigmoid outputs already scale competitively on large corpora ( Nam et al. 2014 ; Zhang et al. 2025 ) . With deep learning, many works explicitly learn label dependencies in images. CNN-RNN frameworks model co-occurrence and sequential dependencies between labels ( Wang et al. 2016 ) . Graph-based approaches (e.g., ML-GCN) propagate information over a label graph built from semantics or co-occurrence; adaptive variants learn the label graph itself ( Chen et al. 2019a ; Li et al. 2020 ) . Transformers have become strong general-purpose MLC heads: