HREF: Human Response-Guided Evaluation of Instruction Following in Language Models
Xinxi Lyu Yizhong Wang Hannaneh Hajishirzi Pradeep Dasigi · 2024
Read HREF: Human Response-Guided Evaluation of Instruction Following in Language Models by Xinxi Lyu Yizhong Wang Hannaneh Hajishirzi Pradeep Dasigi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15524.txt.
Introduction
Xinxi Lyu and co-authors build a benchmark for how well language models follow instructions, in a 2024 paper. Most tests use a strong model as judge, which can bias scores away from human judgement. The team rechecks many design choices for automatic evaluation across a wide range of tasks.
Methods that use human written responses raised agreement with human judges by up to a few percent. Human responses also gave a view that model responses lack, so they help as extra context in comparisons. Their benchmark holds more than four thousand samples across eleven task types and is kept free of contamination. A live leaderboard tracks models on a private test set.
Catalog record
| CREATOR | Xinxi Lyu Yizhong Wang Hannaneh Hajishirzi Pradeep Dasigi |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-15524
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HREF: Human Response-Guided Evaluation of Instruction Following in Language Models Xinxi Lyu Yizhong Wang Hannaneh Hajishirzi Pradeep Dasigi Abstract Evaluating instruction following in Language Models has heavily relied on using LLMs as judges. In this work, we reevaluate the common choices for automatic evaluation setup, e.g.: choice of model and prompting strategy, on a wide range of instruction-following tasks. We experiment with methods that leverage human-written responses and observe that they enhance the reliability of automatic evaluations across a wide range of tasks, resulting in up to a 3.2% improvement in agreement with human judges. We also show that human-written responses offer an orthogonal perspective to model-generated responses in following instructions and should be used as additional context when comparing model responses. Based on these observations, we develop a new evaluation benchmark, Human Response-Guided Evaluation of Instruction Following (HREF). It contains 4,258 human-written instructions spanning 11 task categories and we use the most reliable evaluation setup for each category among the choices we consider. To prevent test-set leakage, we keep a portion of our evaluation dataset hidden. We publicly release a separate development set, code 1 1 1 https://github.com/allenai/href to evaluate models on it, and host a live leaderboard 2 2 2 https://huggingface.co/spaces/allenai/href for publicly available models on our hidden evaluation set. 1 Introduction Automatic evaluations of instruction following abilities in Large Language Models (LLMs) has recently received significant attention ( Zheng et al., 2023 ; Li et al., 2023 ; Lin et al., 2024 ; Li et al., 2024 ; Chiang et al., 2024 ) . To make evaluation efficient and enable rapid iteration over modeling choices during development, prior work has approximated human judgments of the model response quality using by using powerful language models a judge ( LLM-as-a-Judge ). Although model judges have been shown to exhibit biases due to superficial features, such as the length of responses, prior work has indicated that such biases can be addressed ( Dubois et al., 2024 ) to improve the reliability of these judgments. However, the analysis of such biases and the corresponding debiasing techniques developed in prior work are based on a distribution of tasks that is not representative of the full range of applications of instruction-tuned language models. In this work, we reevaluate various choices for automatic evaluation on a wider range of instruction following tasks (Section 2 ). We choose a task distribution closely aligned with those typically used to train instruction-tuned models ( Ouyang et al., 2022 ) , and measure the agreement between human and model judges by comparing LLM-as-a-Judge and embedding-based similarity approaches. We experiment with using human-written reference responses in the process—by including them as additional context in the LLM-as-a-Judge or by measuring embedding similarity between model responses and human responses—and observe that they enhance the reliability of automatic evaluation across many tasks, resulting in up to a 3.2% improvement in agreement with human judges (Section 3.2 ). Our analysis also provides insights into how human-written responses are helpful for evaluating instruction following. We discovered that human-written responses often offer an orthogonal perspective to model-generated responses and should be used as a complementary reference when comparing model responses. Based on these observations, we develop a new evaluation benchmark with 4,258 human-written prompts and reference responses spanning 11 task-categories. We use a composite evaluation setup that uses the most reliable evaluation method for each task-category. Given the reliance on human-written responses, we name this benchmark Human Reference-guided Evaluation of instruction Following ( HREF ). Our new benchmark additionally addresses two important limitations in existing instruction-following evaluations: test-set leakage and a limited focus on individual tasks . Test-set leakage. A consequence of the open availability of the existing instruction following evaluation sets is that these datasets can (often inadvertently) end up in the post-training datasets. For instance, Lambert et al. (2024) show that datasets containing real user conversations with language models, like LMSys-Chat 1M contain significant portions of AlpacaEval data in them. Training on such contaminated datasets can lead to inflated model performance on these benchmarks. To deal with this issue, we create separate development and test splits of HREF, and keep the test split private. Limited focus on individual tasks. Prior instruction-following evaluations either focus on a small set of tasks ( Li et al., 2023 ; Zheng et al., 2023 ) or use a relatively small sample of real user interactions with language models ( Lin et al., 2024 ) where some tasks are under-represented 3 3 3 WildBench has task categories identified post-hoc, and the smallest category has only 16 instances. . As a result, both these approaches result in evaluation datasets that provide limited actionable insights about the model development process at the individual task level, e.g., which skills to upsample in the training datasets. In contrast, we take a task-centric view of data curation with HREF. We start with a taxonomy of 11 task categories used in Ouyang et al. (2022) and collect more than 100 human-written instruction-response pairs for each task category. We apply a task-specific evaluation method and report the result for each task category separately in order to provide a reliable evaluation and deliver insights about the tasks the developers should focus on. We study the impact of our design choices in HREF, including the size of the evaluation set, the choice of the judge model and baseline model, and our prompt template in Section 5 . We build a leaderboard that uses the private test split of HREF. Figure 1: An overview of our composite method leverage the human-written response to judge between two responses given an instruction. The example and the prompt shown in the figure are not exact. See details of these methods in Section 2.2 . 2 Empirical Basis for the Evaluation Setup Task Example Brainstorming What should I look for when buying a car? Open QA Do tomatoes contain MSG? Closed QA What was the first type of anesthesia used in surgery? On October 16, 1846, the first successful public demonstration of the use of ether for surgical anesthesia was performed, making pain-free surgery possible. Extraction I want to know the sizes ticks come in in a numbered list. Here is the texting I am talking about: Ticks come in three sizes depending on their life stage. They can be the size of a grain of sand, a poppy seed, or an apple seed. Generation Write a poem about tacos. Rewriting Rewrite the sentence in active voice. My vegetable garden was eaten by a donkey. Summarization Summarize this in one sentence: SOCIETY FOR HUMAN RIGHTS 1924 After being temporarily committed to a mental institution because of his sexual orientation, Henry Gerber, a German immigrant and World War I Army enlistee, establishes the Society for Human Rights, the first American homosexual rights organization. Classification If a poem is titled ”Hide and Seek” does that sound childish or mature? Fact Checking What were the top 5 cited papers in AI from 2022? Multi-Document Synthesis According to these reviews from Yelp and Google Maps, determine whether or not Moonshadows is an ideal location for a date night during my upcoming trip to Malibu. Yelp Reviews: \n 1. … \n 2. … \n 3. … \n