Two Birds with One Stone: Improving Rumor Detection by Addressing the Unfairness Issue ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Data mining

Junyi Chen, Mengjia Wu, Qian Liu, Ying Ding, Yi Zhang · 2024

Read Two Birds with One Stone: Improving Rumor Detection by Addressing the Unfairness Issue ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Data mining by Junyi Chen, Mengjia Wu, Qian Liu, Ying Ding, Yi Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-20671.txt.

Description

Abstract . The degraded performance and group unfairness caused by confounding sensitive attributes in rumor detection remains relatively unexplored. To address this, we propose a two-step framework. Initially, it identifies confounding sensitive attributes that limit rumor detection performance and cause unfairness across groups. Subsequently, we aim to learn equally informative representations through invariant learning.

Catalog record

CREATORJunyi Chen, Mengjia Wu, Qian Liu, Ying Ding, Yi Zhang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-20671

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Two Birds with One Stone: Improving Rumor Detection by Addressing the Unfairness Issue ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Data mining Junyi Chen, Mengjia Wu, Qian Liu, Ying Ding, Yi Zhang Abstract . The degraded performance and group unfairness caused by confounding sensitive attributes in rumor detection remains relatively unexplored. To address this, we propose a two-step framework. Initially, it identifies confounding sensitive attributes that limit rumor detection performance and cause unfairness across groups. Subsequently, we aim to learn equally informative representations through invariant learning. Our method considers diverse sets of groups without sensitive attribute annotations. Experiments show our method easily integrates with existing rumor detectors, significantly improving both their detection performance and fairness. 1. Introduction Most existing rumor detectors ( Devlin et al. 2018 ; Nan et al. 2021 ; Wang et al. 2018 ; Azri et al. 2021 ) utilize data-driven methods to learn news content representations for rumor classification. This follows an ideal causal pathway x\rightarrow y , where x denotes news content and y represents the classification label. However, they often neglect the unseen confounding effect modeled as x\leftarrow s\rightarrow y , where a sensitive attribute 1 1 1 We loosely refer to sensitive attributes as those that define groups relevant to the benefits of the rumor detector’s outcomes. s indicates group membership (e.g., domain) of the content. Taking domain-based groups as an example, x\leftarrow s manifests as domain-specific linguistic patterns shape the content (e.g., science versus politics). The path s\rightarrow y manifests through data collection biases, demonstrated by the disparate class distribution across domains ( Zhou et al. 2024 ) . This extends to other sensitive attributes (e.g., platform), where news from major agencies differs linguistically from social media streams and is stereotyped as more trustworthy. Hence, non-causal shortcuts can be learned given the confounding effect, degrading detection performance and fairness. Recent works ( Zhang et al. 2022 ; Zhu et al. 2022 ; Chen et al. 2023 ) only note dataset bias but still solely pursue detection performance gains, largely neglecting unfairness for different sets of groups. We reveal two critical challenges that impede fair, high-performing rumor detection: 1. Limited annotated but diverse sensitive attributes. Privacy constraints prevent comprehensive sensitive attribute collection (e.g., domains, platforms, authors’ certification status, political leaning, etc.), yet each attribute defines its own set of groups. 2. Variant feature learning. Limited sensitive attribute supervision produces features that remain unfairly variant to unknown sets of groups, compromising generalization of fairness and detection effectiveness. This work studies rumor detection from an underexplored fairness perspective. We present a max-min framework that can be plugged into existing rumor detectors to promote fairness while improving detection performance without requiring annotated sensitive attribute data. In the first step, we partition the training data into different subsets that lead to the worst-case performance of both detection and fairness for a rumor detector. This simulates the sensitive attributes that can cause non-causal and unfair predictions across a set of groups. In the second step, we aim to improve and balance the performance across each subset (group) created by the partitions, thereby learning invariant feature representations for rumor detection. Since the partitioning operation does not rely on annotated sensitive attributes, it results in dynamic partitions during each training epoch alongside parameter updates, allowing for the consideration of extensive sets of groups. This ensures that the learned invariant feature representations generalize across different sets of groups. Note that this study does not aim to challenge the usefulness of auxiliary (potentially sensitive) but emphasizes preventing models from unfairly over-relying on those confounding sensitive attributes when predicting. Our key contributions are: • We study rumor detection from a fairness perspective regarding multiple sets of groups, a novel angle largely overlooked in previous research. • We propose a unified fairness framework that considers various sets of groups without requiring sensitive attribute annotations. • Convincing experiments demonstrate that our method significantly improves both detection performance and fairness of existing rumor detectors across multiple sets of groups in a plug-and-play manner. Figure 1 . Schematic view of our proposed method. 2. Method In Fig. 1 , our method begins with standard training and then repeatedly performs two steps: (1) Unfair Partition and (2) Invariant Learning. Problem Formulation. Let c=\{\boldsymbol{x},y,\boldsymbol{S}\} represent a rumor detection instance, where \boldsymbol{x} denotes the initial embedded feature, y the classification label, and \boldsymbol{S}=\{\boldsymbol{s}_{1},\ldots,\boldsymbol{s}_{n}\} the sensitive attribute vectors indicating group membership of different sets (e.g., \boldsymbol{s}_{1} indicates the domain, \boldsymbol{s}_{2} indicates the platform). Given a rumor detector with a base model \Phi(\cdot) for feature extraction and a classifier f(\cdot) , we aim to optimize both for competitive binary prediction y\in\{\text{rumor},\text{non-rumor}\} while ensuring fairness across groups from all potential sets. S serves only for fairness evaluation. We omit the subscript i when the context is clear. 2.1. Unfair Partition The concept of backdoor adjustment ( Pearl et al. 2016 ) suggests statically partitioning training data to subsets based on sensitive attributes to learn fair representations. However, this approach demands comprehensive attribute annotations - impractical for social media data and risks overlooking unidentified sets of groups. Inspired by invariant learning ( Li et al. 2024 ; Zhu et al. 2024 ) , we propose dynamic data partitioning to consider multiple sets of groups during training, without requiring sensitive attribute annotations. Our method identifies "unfair partitions" where the frozen base model performs worst. Recalling the ideal causal pathway \boldsymbol{x}\rightarrow y , if the base model learns to extract causal features and is unaffected by confounding sensitive attributes, it should generally produce well-separated features based on contrastive labels y within each subset given a partition. Otherwise, it may be influenced by confounding attributes via the pathway \boldsymbol{x}\leftarrow s\rightarrow y , where the confounding effect of s varies across instances within and between subsets, leading to non-causal, non-generalizable features and thus, the worst performance within a partition. In this context, subsets in the partition can represent a set of groups conditioned on the specific type of confounding sensitive attribute (e.g., content from the domain of science versus politics). Based on the discussion above, for an instance c with its initial embedded feature \boldsymbol{x} , we first deduce the partition: (1) \boldsymbol{\hat{s}}=FC(\Phi(\boldsymbol{x})), where FC(\cdot) is a fully-connected layer with trainable parameters and \boldsymbol{\hat{s}}\in\mathbb{R}^{1\times k} indicates which subset the instance belongs to. By applying this operation across m instances, we construct a partition matrix \boldsymbol{A}\in\{0,1\}^{m\times k} , which we want to potentially reflect data distribution under a specific set of groups. Based on the objective of invariant risk minimization ( Arjovsky et al. 2019 ) , we identify unfair partitions where the base model performs worst, helping reveal confounding sensitive attributes: (2) \underset{\boldsymbol{A}}{\operatorname{argmax}}\sum_{k}\mathcal{L}_{\mathrm{con}}(\boldsymbol{A},k,\Phi(\boldsymbol{x}),y)+\lambda\operatorname{Var}\left(\left\{\mathcal{L}_{\mathrm{con}}(\cdot)\right\}_{i=1}^{k}\right), where \mathcal{L}_{\mathrm{con}} denotes the supervised contrastive loss for each subset given a partition, \operatorname{Var} measures performance variance across subsets and \lambda is a trade-off factor. In implementation, we treat the items within the same subset that share the same label y as positive pairs, while the remaining items within the same subset are treated as negative pairs. A higher value in the first term indicates the base model’s reliance on a potential confounding sensitive attribute - a non-causal correlation that limits detection performance. A higher value in the second term indicates performance disparity across subsets. Using supervised

Read the complete text