Self-Adaptive Paraphrasing and Preference Learning for Improved Claim Verifiability
Amelie Wührl, Roman Klinger · 2024
Read Self-Adaptive Paraphrasing and Preference Learning for Improved Claim Verifiability by Amelie Wührl, Roman Klinger (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-11653.txt.
Introduction
Amelie Wührl and Roman Klinger teach a language model to rewrite claims until a fact checker can judge them, in a 2024 paper. Social media posts bury claims in noise, and the phrasing that suits people may not suit the checker. Their loop needs no labeled data: a generator proposes paraphrases, a black-box checker scores them, and preference learning steers the writer toward clearer forms.
The rewrites proved more verifiable than the original posts and matched strong baselines. For claims that were later refuted, the method beat every rival. Cleaner claim extraction could raise the hit rate of automated checking across messy platforms.
Catalog record
| CREATOR | Amelie Wührl, Roman Klinger |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-11653
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Adaptive Paraphrasing and Preference Learning for Improved Claim Verifiability Amelie Wührl, Roman Klinger Abstract In fact-checking, structure and phrasing of claims critically influence a model’s ability to predict verdicts accurately. Social media content in particular rarely serves as optimal input for verification systems, which necessitates pre-processing to extract the claim from noisy context before fact checking. Prior work suggests extracting a claim representation that humans find to be checkworthy and verifiable. This has two limitations: (1) the format may not be optimal for a fact-checking model, and (2), it requires annotated data to learn the extraction task from. We address both issues and propose a method to extract claims that is not reliant on labeled training data. Instead, our self-adaptive approach only requires a black-box fact checking model and a generative language model (LM). Given a tweet, we iteratively optimize the LM to generate a claim paraphrase that increases the performance of a fact checking model. By learning from preference pairs, we align the LM to the fact checker using direct preference optimization. We show that this novel setup extracts a claim paraphrase that is more verifiable than their original social media formulations, and is on par with competitive baselines. For refuted claims, our method consistently outperforms all baselines. 1 Introduction In fact-checking, structure, length and the overall claim representation impact models’ ability to reliably predict a verdict. Despite increased resources and modeling efforts dedicated to user-generated medical content and organically occurring medical claims on social media, a performance gap remains in fact-checking across different types of claims ( Kim et al. 2021 ; Wührl and Klinger 2022 ) . Possibly, this is because naturally occurring claims are more complex and longer, and contain multiple, inter-related facts compared to claims in other fact verification settings ( Sarrouti et al. 2021 ; Zuo et al. 2022 ) . Since models do not transfer robustly to colloquial claims ( Kim et al. 2021 ) , we hypothesize that this is because such claims are not optimal input for fact checking models. Consider this tweet stating: ‘Just saw someone claiming that sipping on boiled garlic water is the magic cure for COVID-19. Anyone else heard this one?’. The checkworthy claim ‘Drinking boiled garlic water cures COVID-19’ is embedded in context, potentially distracting the fact checking model and deteriorating its performance. Given that the same model performs robustly on the concise, extracted version of the claim ( Wührl and Klinger 2022 ) , we presume that adapting these properties could enhance the fact-checking process for colloquial claims. Instead of modifying the model to accommodate colloquial input, we therefore propose to refine the input itself for better alignment with the model. Figure 1: Illustration of the self-adaptive optimization cycle using direct preference optimization (DPO) guided by a fact-checking (FC) model. Claim extraction offers an intuitive solution. Prior work explores extracting claims from long documents ( Deng et al. 2024 ) or noisy contexts ( Sundriyal et al. 2023 ) , for instance to identify checkworthy claims in discourse or to aligning the expert terminology of individual claim components with the language used in evidence documents ( Wuehrl et al. 2023 ) . Related tasks include claim detection, which identifies claim documents or sentences in argument mining ( Lippi and Torroni 2015 ; Gangi Reddy et al. 2022 ; Zaberer et al. 2023 , i.a.) , and checkworthiness detection, which identifies claims that require fact-checking ( Hassan et al. 2017 ; Wright and Augenstein 2020 ; Majer and Šnajder 2024 , i.a.) . Importantly, prior work extracts a claim representation that humans find to be checkworthy and verifiable. This has two limitations: (1) it requires annotated data to learn the extraction task from and (2) even with gold labeled data, the format may not be optimal for a fact-checking model. Optimizing the extracted claim for a downstream model, however, can not be learned end-to-end. Reinforcement learning (RL) is one way to address such problems as it allows learning from environment feedback and a reward objective as opposed to from labeled data. In conjunction with the increased access to highly fluent generative language models, RL methods that align model outputs to preferences, have grown in popularity. For instance, He et al. 2023 and Ziegenbein et al. 2024 explore RL to generate counter misinformation responses and to increase argument appropriateness. To address the unstable and computationally expensive nature of RL-based optimization, Rafailov et al. 2024 recently propose direct preference optimization (DPO). DPO is an alignment algorithm to optimize a generation policy, i.e., a language model. Learning from preference pairs, a large language model (LLM) is trained to to assign high probabilities to preferred prompt completions, while assigning lower probabilities to tokens of rejected completions. We build on this and propose a self-adaptive, iterative framework for claim extraction. We generate claim paraphrases that aligns the verification input based on a preference signal coming from a fact checking model. Figure 1 illustrates the DPO-based alignment cycle. Starting with a colloquial claim from social media and an off-the-shelf LLM, we iteratively extract the claim through paraphrasing. Each iteration updates the model using direct preference optimization, leveraging the feedback from the fact-checking model to steer the LLM generations towards a claim paraphrase that enhances verifiability. We investigate two research questions: [RQ1] How effective is self-adaptive, DPO-based claim paraphrasing to enhance verifiability? and [RQ2] Which claim properties emerge throughout the self-adaptive paraphrasing process? We show that this novel setup extracts a claim representation that is more verifiable than their original social media formulations, and is on par with competitive baselines. For refuted claims, our method consistently outperforms all baselines. A key finding form our analysis is that self-adapted claims are very concise compared to their social media variants and even shorter than human-written claims. 2 Methods Given a fact checking model trained to predict a fact checking verdict for claim-evidence pairs, and a social media post that contains a medical claim, our goal is to extract a paraphrase of the claim that constitutes the best, i.e., most checkable, input for the fact checking model. Figure 1 illustrates the iterative process we suggest to optimize the input claim. Given a generative language model, we task the model to extract the claim from a social media document using zero-shot prompting. We pass the extracted claim along with its evidence document 1 1 1 As we focus on claim extraction, we presume an oracle setting and use the gold annotated evidence from a dataset. to the fact checking model which predicts an entailment-style fact checking verdict, indicating if the evidence supports or refutes the claim or if their relation is neutral . For each claim, we compare the prediction of the fact checking model with the prediction for the claim-evidence pair from the previous iteration. This way, we obtain a preference pair: the claim which was more reliably checked, is the preferred claim; the other claim is the rejected one. Using these preference pairs, we update the language model by fine-tuning it with the DPO loss. This aims to align the language model generations to the fact checking model’s expected input, while constraining the update using a reference language model to avoid phenomena such as reward