Enhancing Relation Extraction via Supervised Rationale Verification and Feedback

Yongqi Li, Xin Miao, Shen Zhou, Mayi Xu, Yuyang Ren, Tieyun Qian · 2024

Read Enhancing Relation Extraction via Supervised Rationale Verification and Feedback by Yongqi Li, Xin Miao, Shen Zhou, Mayi Xu, Yuyang Ren, Tieyun Qian (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07289.txt.

Introduction

Yongqi Li and co-authors present a 2024 feedback loop that sharpens how language models pull relations from text. Auto feedback tricks have lifted model output in many tasks, but their goals and fix styles fit relation work poorly. A wrong relation call often hides a flawed reason chain behind it.

Their frame trains a rationale judge first, using rigged contrasts between biased and clean reason chains. The judge then vets each first pass call. Bad calls loop back with fresh, re picked demo cases, and the model tries again. Wide tests show the loop beats prior feedback frames by a clear edge. The authors pitch rationale checks as the missing piece for this task.

Catalog record

CREATORYongqi Li, Xin Miao, Shen Zhou, Mayi Xu, Yuyang Ren, Tieyun Qian
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07289

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Relation Extraction via Supervised Rationale Verification and Feedback Yongqi Li, Xin Miao, Shen Zhou, Mayi Xu, Yuyang Ren, Tieyun Qian Abstract Despite the rapid progress that existing automated feedback methods have made in correcting the output of large language models (LLMs), these methods cannot be well applied to the relation extraction (RE) task due to their designated feedback objectives and correction manner. To address this problem, we propose a novel automated feedback framework for RE, which presents a rationale supervisor to verify the rationale and provides re-selected demonstrations as feedback to correct the initial prediction. Specifically, we first design a causal intervention and observation method to collect biased/unbiased rationales for contrastive training the rationale supervisor . Then, we present a verification-feedback-correction procedure to iteratively enhance LLMs’ capability of handling the RE task . Extensive experiments prove that our proposed framework significantly outperforms existing methods. 1 School of Computer Science, Wuhan University, China 2 Intellectual Computing Laboratory for Cultural Heritage, Wuhan University, China 3 Research Institute of Nuclear Power Operation, China {liyongqi, miaoxin, shenzhou, xumayi}@whu.edu.cn, [email protected], [email protected] Code — https://github.com/NLPGM/SRVF Introduction The relation extraction (RE) task aims to extract the semantic relation between entities in the text, which is an important task in information extraction. Unlike previous fine-tuning strategies based on small language models ( Wu and He 2019 ) , recent studies ( Wan et al. 2023 ; Ma et al. 2023 ) leverage the strong instruction understanding abilities and rich intrinsic knowledge of large language models (LLMs) ( Ouyang et al. 2022 ; Touvron et al. 2023 ; Bai et al. 2022 ) to enhance the performance of RE. Despite their significant progress, LLM based methods may suffer from relation bias when performing relation extraction. For example, given a sentence “data is derived from a study” , where “data” and “study” form the “Entity-Origin” relation, LLMs may be influenced by the pre-trained knowledge and have the stereotype that “data is the product that someone produces” , thus making a biased relation prediction “Product-Producer” , which ignores that the real producer is investigators (producer of the study). Furthermore, existing LLM based RE methods focus on the pre-selection of in-context demonstrations ( Wan et al. 2023 ; Ma, Li, and Zhang 2023 ) or instruction design ( Zhang, Gutiérrez, and Su 2023 ) to improve the performance. The verification and feedback mechanism for correcting the biased prediction is still missing from current LLM based RE research. Figure 1: Comparison between current automated feedback methods (a) and ours (b). The main difference is that our rationale supervisor can verify whether the relation bias occurs and provide re-selected demonstrations as feedback. To fill this gap, in this study, we focus on exploring the verification and feedback mechanism ( Pan et al. 2023 ) of LLMs for RE. Specifically, we aim to examine whether the relation prediction of LLMs is biased by verifying the rationale (the generated explanation when LLMs perform RE) and providing feedback for correction. However, the current verification and feedback mechanism faces the following two problems when being applied to RE. Firstly, existing methods are mainly designed for other tasks, e.g., the reasoning task. The objectives of their feedback are also tailored for those tasks, e.g., correcting code, factual, or calculation errors in initial responses ( Zhang et al. 2023 ; Gou et al. 2023 ) , or choosing an optimal prefix for the next step in multi-step reasoning ( Khalifa et al. 2023 ) , as shown in Fig. 1 (a). For example, for the mathematical reasoning task, Self-Refine ( Madaan et al. 2023 ) utilizes the LLM agent to find calculation errors in the initial answer and provide error information as feedback to correct the answer. However, such feedback objectives are based on the logical properties of reasoning tasks, which are not available for RE. Secondly, existing methods ( Madaan et al. 2023 ; Nathani et al. 2023 ) do not include demonstrations in their feedback. However, the demonstrations are essential for RE even at the correction stage. This is because without demonstrations in the feedback, the RE task would degrade to zero-shot RE and is harder than the initial few-shot one. Moreover, the demonstrations in initial few-shot RE cannot be directly used in feedback since they will mislead the model back to the initial one, and thus the impact of feedback is discarded. To address the above problems, we propose a novel automated feedback framework for RE, which trains a rationale supervisor based on a BERT-like small model and utilizes it to not only verify the prediction but also provide new demonstration improved feedback for correction during the inference. As shown in Fig. 1 (b), our rationale supervisor provides re-selected demonstrations as feedback for correcting the initial prediction of LLMs. In order to train a rationale supervisor, we need to collect both unbiased and biased rationales, i.e., positive and negative samples. Though several verification methods have been proposed to collect positive and negative rationales in other tasks, both their purpose and the collection method are not suitable for our RE task. (1) Firstly, their collected positive and negative rationales are used for training the verifier, which only needs to discriminate the positive predictions from negative ones. In contrast, the rationale supervisor in our framework is designed to correct biased predictions, thus needing to further discriminate different negative rationales. (2) Secondly, the way of collecting rationales in current verification methods relies on the manually annotated golden reasoning steps as positive samples and perform rule-based perturbation ( Paul et al. 2023 ; Golovneva et al. 2023 ) or error step alignment ( Khalifa et al. 2023 ; Li et al. 2023b ) to obtain negative samples. Unfortunately, such annotated samples and rules for perturbation are not available in RE. In view of this, we propose a causal intervention and observation method to address the lack of annotated rationales and collect biased rationales for training the supervisor. Specifically, we first present a label-guided intervention strategy to collect unbiased rationales , and we also present a diversified intervention strategy to collect biased rationales . In addition, during the inference, we utilize the rationale supervisor to retrieve new demonstrations from the labeled samples and include them in the feedback, which are then used by the LLM for re-generating predictions. Since the supervisor has learned the difference among various biased rationales, the LLM gets the signal to adjust its direction for correction. This verification-feedback-correction procedure iterates until the output rationale is verified as unbiased. Overall, we make three major contributions. 1) We extend the LLM based RE research to the automated feedback paradigm, which equips LLM with the ability of correcting the biased prediction. 2) We propose a novel supervised rationale verification and feedback framework, which first collects rationales with a causal intervention and observation method for training the supervisor, and then employs the supervisor to retrieve sample-related demonstrations as feedback for guiding the LLM in correction. 3) Extensive experiments prove that our proposed method can improve the performance of LLM based RE methods and is superior to existing automated feedback methods. Related Work LLMs for Relation Extraction Recently, many studies ( Xu et al. 2023 ; Li et al. 2023a ; Wei

Read the complete text