Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classification

Yijia Fan, Jusheng Zhang, Kaitong Cai, Jing Yang, Keze Wang, Sun Yat-sen University · 2025

Read Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classification by Yijia Fan, Jusheng Zhang, Kaitong Cai, Jing Yang, Keze Wang, Sun Yat-sen University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00812.txt.

Introduction

Yijia Fan, Jusheng Zhang, Kaitong Cai, Jing Yang, and Keze Wang tackle multi-label classification in a 2025 paper. In that task, one item can carry several labels at once, like a photo tagged with many objects. The task suffers from label imbalance, fake correlations, and shifts between datasets, which hurt rare labels most.

Their Causal Cooperative Game framework treats classification as teamwork among players. It mixes causal discovery, a counterfactual curiosity reward, and a causal invariance loss that favors features stable across settings. It also boosts rare labels on purpose. The mix aims for labels that stay right when conditions change.

Catalog record

CREATORYijia Fan, Jusheng Zhang, Kaitong Cai, Jing Yang, Keze Wang, Sun Yat-sen University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00812

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classification Yijia Fan, Jusheng Zhang, Kaitong Cai, Jing Yang, Keze Wang, Sun Yat-sen University Abstract Multi-label classification (MLC) faces persistent challenges from label imbalance, spurious correlations, and distribution shifts, especially in rare label prediction. We propose the Causal Cooperative Game (CCG) framework, which models MLC as a multi-player cooperative process. CCG integrates explicit causal discovery via Neural Structural Equation Models, a counterfactual curiosity reward to guide robust feature learning, and a causal invariance loss to ensure generalization across environments, along with targeted rare label enhancement. Extensive experiments on benchmark datasets demonstrate that CCG significantly improves rare label prediction and overall robustness compared to strong baselines. Ablation and qualitative analyses further validate the effectiveness and interpretability of each component. Our work highlights the promise of combining causal inference and cooperative game theory for more robust and interpretable multi-label learning. 1 Introduction Multi-label classification (MLC) 48 ; 60 ; 40 ; 18 ; 34 is a key task in machine learning 38 , widely applied in fields such as NLP. However, 27 ; 53 ; 58 ; 13 , real-world datasets often suffer from label imbalance, where rare labels have low representation in the training data 20 . As a result, models tend to overlook these rare labels during training 44 ; 21 , impacting prediction performance and generalization. As task complexity increases, effectively handling rare labels and improving model performance on imbalanced data remain significant challenges 45 . Mainstream multi-label classification methods rely on the statistical correlations of labels, such as resampling or adjusting loss functions to enhance focus on rare labels 5 ; 8 . However, these methods generally assume that labels are independently and identically distributed, failing to capture complex causal relationships, especially dependencies between rare labels and other labels 33 . Existing methods are primarily based on surface co-occurrence information, making it difficult to identify spurious correlations (e.g., the co-occurrence of high-frequency and rare labels 46 ). This leads to insufficient generalization in rare label prediction. For instance, when the co-occurrence of label A and label B is merely a surface statistical relationship rather than a causal one, the model might incorrectly use such relationships for prediction, resulting in inaccurate outcomes 22 . Therefore, in environments with distribution shifts, reducing the impact of spurious correlations and enhancing model robustness becomes a significant challenge in multi-label classification 24 ; 39 ; 14 . Furthermore, distribution shifts (e.g., inconsistencies between training and testing data distributions) further weaken the generalization ability of traditional models. Specifically, in rare label prediction, models often overly rely on features of frequent labels, neglecting the uniqueness of rare labels, which leads to performance degradation 62 ; 50 . Hence, constructing new methods that can capture causal relationships among labels and improve the prediction accuracy of rare labels has become a key research direction. To alleviate the rare label problem, many methods have proposed different strategies 9 ; 27 ; 53 ; 20 . Some methods balance label frequency through resampling techniques 61 or increase the training weight of rare labels by designing weighted loss functions 43 ; 26 ; 56 ; 3 . Another set of methods 55 enhances the prediction ability of rare labels via multi-task learning or label embedding. Although these approaches have shown improvements, they still rely on surface statistical correlations and lack the modeling of potential causal relationships. In recent years, causal reasoning has gained attention in machine learning as a means to eliminate spurious correlations among labels and improve model robustness under distribution shifts. However, existing studies mainly focus on single-label causal modeling, and the exploration of causal relationships in multi-label tasks remains insufficient 25 . The motivation of this study arises from the current shortcomings of multi-label classification methods in handling rare labels, particularly the insufficient utilization of causal relationships among labels, which causes models to be susceptible to spurious correlations 10 ; 59 ; 15 . To address this challenge, we introduce the concept of causal reasoning. The goal of this research is to propose a novel causal cooperative game learning framework by modeling multi-label classification as a multi-player cooperative game process. In this framework, each player is responsible for a specific subset of labels and learns the real dependencies among labels through causal discovery methods. Specifically, the main innovations of this study include: 1. Designing a causal discovery module based on Neural Structural Equation Models (Neural SEM) to construct a dynamic causal graph among labels, thereby revealing the true causal dependency structure. 2. Proposing a counterfactual curiosity reward mechanism that generates counterfactual samples and compares predictions before and after interventions. This mechanism guides the model to focus on real causal features rather than surface statistical features. 3. Introducing a confounder adjustment strategy by incorporating a causal invariance loss, ensuring consistent predictions of causal labels across different environments. 2 Related Work Multi-Label Classification (MLC) Multi-label classification (MLC) 27 ; 8 ; 20 ; 48 ; 49 is a fundamental task in machine learning with widespread applications in natural language processing (NLP) 27 ; 53 ; 19 ; 16 , computer vision, and bioinformatics. Traditional MLC methods primarily rely on statistical correlations between labels, employing techniques such as over-sampling or weighted loss functions to enhance the learning of rare labels. However, these approaches 5 ; 8 ; 33 often assume independent and identically distributed (i.i.d.) labels 61 , neglecting complex causal dependencies among them. This limitation becomes particularly problematic when dealing with label imbalance and distribution shifts, as existing methods often fail to capture the distinct characteristics of rare labels, leading to poor predictive performance. Thus, a key challenge in MLC research is effectively modeling complex causal dependencies between labels to improve the prediction accuracy of rare labels. The Rare Label Problem One of the biggest challenges in MLC is the rare label problem, especially when datasets exhibit severe label imbalance 5 ; 59 ; 10 . Traditional learning algorithms often struggle with rare label prediction due to their low frequency and insufficient training samples 2 ; 32 . To address this issue, researchers have proposed various solutions, including resampling techniques and weighted loss functions that increase the training weight of rare labels 7 . Additionally, multi-task learning and label embedding techniques have been explored to enhance rare label representation learning 42 . However, most of these methods rely on surface-level statistical relationships and fail to model the underlying causal dependencies among labels. Since causal relationships provide deeper insights into label interactions, ignoring them can lead to spurious correlations, ultimately reducing prediction accuracy. Causal Machine Learning Causal inference has recently attracted attention for reducing spurious correlations and improving robustness in machine learning 42 ; 6 ; 54 ; 28 . While effective in single-label tasks, its use in multi-label classification is still limited, with most existing work focusing only on simple label relationships. To address this, we propose a Neural SEM-based framework that builds dynamic causal graphs to better capture true label dependencies and improve rare label prediction, offering a novel approach by combining causal reasoning with cooperative game theory. 3 Method Causal reasoning and cooperative game theory are applied to solve multi-label text classification challenges. We propose four innovations:

Read the complete text