AdvSumm: Adversarial Training for Bias Mitigation in Text Summarization
Mukur Gupta Nikhil Reddy Varimalla Nicholas Deas Melanie Subbiah Kathleen McKeown Columbia University {mukur.gupta, nv2415, m.subbiah}@columbia.edu{ndeas, kathy} @cs.columbia.edu · 2025
Read AdvSumm: Adversarial Training for Bias Mitigation in Text Summarization by Mukur Gupta Nikhil Reddy Varimalla Nicholas Deas Melanie Subbiah Kathleen McKeown Columbia University {mukur.gupta, nv2415, m.subbiah}@columbia.edu{ndeas, kathy} @cs.columbia.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06273.txt.
Introduction
Mukur Gupta and co-authors train summarizers to resist bias using adversarial perturbations, in work from 2025. Large models inherit framing and association biases from their training text. Those biases leak into summaries in unfair ways.
Their framework, AdvSumm, adds a perturber that nudges word embeddings along gradient signals during training. Training against those nudges hardens the model to slanted inputs. Tests targeted name-nationality bias and political framing bias in summaries. Summary quality held steady while bias dropped. Rivals included standard transformers and back-translation data tricks. AdvSumm beat both on bias control across benchmarks. The method is domain-agnostic, so other text tasks could adopt it.
Catalog record
| CREATOR | Mukur Gupta Nikhil Reddy Varimalla Nicholas Deas Melanie Subbiah Kathleen McKeown Columbia University {mukur.gupta, nv2415, m.subbiah}@columbia.edu{ndeas, kathy} @cs.columbia.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06273
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AdvSumm: Adversarial Training for Bias Mitigation in Text Summarization Mukur Gupta Nikhil Reddy Varimalla Nicholas Deas Melanie Subbiah Kathleen McKeown Columbia University {mukur.gupta, nv2415, m.subbiah}@columbia.edu{ndeas, kathy} @cs.columbia.edu Abstract Large Language Models (LLMs) have achieved impressive performance in text summarization and are increasingly deployed in real-world applications. However, these systems often inherit associative and framing biases from pre-training data, leading to inappropriate or unfair outputs in downstream tasks. In this work, we present AdvSumm (Adversarial Summarization), a domain-agnostic training framework designed to mitigate bias in text summarization through improved generalization. Inspired by adversarial robustness, AdvSumm introduces a novel Perturber component that applies gradient-guided perturbations at the embedding level of Sequence-to-Sequence models, enhancing the model’s robustness to input variations. We empirically demonstrate that AdvSumm effectively reduces different types of bias in summarization—specifically, name-nationality bias and political framing bias—without compromising summarization quality. Compared to standard transformers and data augmentation techniques like back-translation, AdvSumm achieves stronger bias mitigation performance across benchmark datasets. 0 0 footnotetext: These authors contributed equally to this work. 1 Introduction Large Language Models (LLMs) have achieved impressive performances in text generation tasks, including summarization Zhang et al. 2024 . As a result, LLMs are being integrated into real-world applications. For example, social media platforms use them to generate personalized feed summaries based on user preferences Eg et al. 2023 ; search engines provide direct summaries of relevant documents in response to user queries 1 1 1 Perplexity AI ; and enterprise solutions employ them to summarize meeting transcripts, and emails 2 2 2 Microsoft Copilot for Sales , among other use cases. However, prior research has shown that these systems often inherit biases from their pretraining data Hovy and Prabhumoye 2021 ; Ladhak et al. 2023 ; Bommasani et al. 2021 ; Liang et al. 2023 , which can pose serious threats in downstream tasks. As shown in Figure 1 , summaries generated by existing systems can exhibit various forms of bias. For example, they may contain associative biases Dinan et al. 2020 ; Sun et al. 2019 , which reflect preferences or prejudices toward certain groups, or framing biases Lee et al. 2022 , which convey implicit political leanings. Most prior work on bias mitigation relies on domain-specific strategies, such as expert interventions Rudinger et al. 2018 ; Felkner et al. 2023 , curated word lists Garimella et al. 2021 , or the collection of additional data to improve population representation. These approaches are often expensive and do not generalize well across different types of bias. Moreover, most domain-agnostic bias mitigation techniques have been developed for classification tasks (e.g., employing Risk Minimization methods Arjovsky et al. 2020 across different target groups Adragna et al. 2020 ; Donini et al. 2020 ). However, these methods are not scalable to text generation tasks, where bias may arise from the selection of multiple tokens rather than a single output label. This highlights the need for bias mitigation strategies for text generation models that are independent of particular domains or forms of bias. Figure 1: Example illustrating how the BART summarization model hallucinates a footballer’s nationality based on name associations—predicting Indian for "Ram Gupta" and Vietnamese for "Minh Nguyen." AdvSumm mitigates these biases. Given the generalization limitations of existing bias mitigation frameworks in text generation, we propose AdvSumm: Adv ersarial Summ arization. Our approach integrates a domain-agnostic component, Perturber , into the model training process to reduce multiple forms of bias in generated summaries. We reformulate bias reduction in text summarization as a generalization problem, that can be addressed by enhancing the model’s robustness to input perturbations Yi et al. 2021 . Prior work on Adversarial Training Goodfellow et al. 2015 ; Kaufmann et al. 2022 across applications has shown its effectiveness in improving robustness. Building on this, we introduce an adversarial training strategy designed to mitigate biases originating from pre-training data by improving model robustness during fine-tuning. It is unclear, however, how adversarial training can be applied to language generation tasks. While other fields have benefited from adversarial robustness, it is difficult to apply to natural language due to the discrete nature of text data, unlike continuous modalities such as images or speech. We adopt adversarial training by introducing perturbations with the Perturber component at the embedding level of Sequence-to-Sequence (Seq2Seq) models Vaswani et al. 2023 . As illustrated in Figure 2 , the Perturber takes in the continuous embedding from the Transformer encoder, generates an adversarial embedding, and pushes the decoder output towards the same ground truth summary. This adversarial embedding helps improve robustness during training. Compared to baseline methods, our approach shows reductions in bias metrics while retaining the summarization quality. AdvSumm is designed to generalize across multiple types of bias. In this work, we demonstrate empirical improvements in mitigating two specific forms of bias: name-nationality bias Ladhak et al. 2023 and political framing bias Lee et al. 2022 . Our key contributions are as follows: • We propose a novel, robustness-based, unified training strategy that promotes less biased text generation. • We present empirical gains over both standard transformer models and data augmentation techniques such as back-translation. 2 Related Work Bias in Language Understanding. Prior research has extensively investigated various forms of bias in language understanding systems Steen and Markert 2024 ; Rudinger et al. 2018 ; Ladhak et al. 2023 ; Felkner et al. 2023 ; Lee et al. 2022 . Several studies have identified key factors contributing to such biases, including dataset quality Maynez et al. 2020 , bias in data annotation strategy Fleisig et al. 2023 ; Larimore et al. 2021 ; Sap et al. 2022 , and the level of abstractiveness Ladhak et al. 2022 . Most of this work has centered on bias identification using methods such as token-masked likelihood estimation Nangia et al. 2020 ; Nadeem et al. 2021 , simple classifier-based frameworks Wessel et al. 2023 , or open-ended prompt-based generation Dhamala et al. 2021 . However, only a limited number of benchmarks specifically address bias in the context of language summarization. Generalization for Bias Mitigation. Research in computer vision has explored contrastive learning strategies for domain transfer Ganin et al. 2016 and improved generalization Li et al. 2018 , both of which also have potential implications for bias mitigation. Nanda et al. 2021 , for instance, highlights a connection between model robustness and biases in facial recognition tasks. In the context of text generation, data augmentation techniques have been widely adopted for improving robustness Xie et al. 2020 and faithfulness in summarization Cao and Wang 2021 . Closest to our work, FRSUM Wu et al. 2022a and AdvSeq Wu et al. 2022b show how inducing robustness in language generation models encourages faithfulness on summarization tasks. We extend this line of research by introducing adversarial training for robustness specifically targeted at bias mitigation. We demonstrate that our proposed method outperforms back-translation-based data augmentation on bias mitigation benchmarks. Another line of prior work focuses on reducing model bias through Empirical Risk Minimization (ERM) and Invariant Risk Minimization (IRM) Arjovsky et al. 2020 , both of which aim to enhance generalization across samples from different target groups Adragna et al. 2020 ; Donini et al. 2020 . These methods, however effective, typically require expert-labeled