Evaluating Language Models as Synthetic Data Generators
Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig, Carnegie Mellon University, KAIST AI, University of Washington, NEC Laboratories Europe, Ss. Cyril, Methodius University of Skopje {seungone, welleck · 2024
Read Evaluating Language Models as Synthetic Data Generators by Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig, Carnegie Mellon University, KAIST AI, University of Washington, NEC Laboratories Europe, Ss. Cyril, Methodius University of Skopje {seungone, welleck (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03679.txt.
Introduction
Seungone Kim and nine co-authors build a shared yardstick for judging how well language models can make training data for other models. Their paper appeared in two thousand twenty-four. Fake data now fills much of post-training, so making good data counts as much as solving tasks. Past studies each used their own setup, so models could not be compared fairly.
Their bench, AgoraBench, fixes the settings and scores for the test. Six models each made over a million training items, and near a hundred student models were trained on the output. Strengths split by task: one model wrote the best new problems, another improved old ones best. Skill at making data did not track skill at solving tasks. Data traits like answer quality and task hardness predicted success better. Format and cost choices also swayed the results.
Catalog record
| CREATOR | Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig, Carnegie Mellon University, KAIST AI, University of Washington, NEC Laboratories Europe, Ss. Cyril, Methodius University of Skopje {seungone, welleck |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating Language Models as Synthetic Data Generators Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig, Carnegie Mellon University, KAIST AI, University of Washington, NEC Laboratories Europe, Ss. Cyril, Methodius University of Skopje {seungone, wellecks, gneubig}@cmu.edu Abstract Given the increasing use of synthetic data in language model (LM) post-training, an LM’s ability to generate high-quality data has become nearly as crucial as its ability to solve problems directly. While prior works have focused on developing effective data generation methods, they lack systematic comparison of different LMs as data generators in a unified setting. To address this gap, we propose AgoraBench , a benchmark that provides standardized settings and metrics to evaluate LMs’ data generation abilities. Through synthesizing 1.26 million training instances using 6 LMs and training 99 student models, we uncover key insights about LMs’ data generation capabilities. First, we observe that LMs exhibit distinct strengths. For instance, GPT-4o excels at generating new problems, while Claude-3.5-Sonnet performs better at enhancing existing ones. Furthermore, our analysis reveals that an LM’s data generation ability doesn’t necessarily correlate with its problem-solving ability. Instead, multiple intrinsic features of data quality—including response quality, perplexity, and instruction difficulty—collectively serve as better indicators. Finally, we demonstrate that strategic choices in output format and cost-conscious model selection significantly impact data generation effectiveness. Our code, checkpoints, and data are all publicly available at https://github.com/neulab/data-agora . 1 Introduction Post-training language models (LMs) on synthetic data is a promising approach for improving their ability to solve a wide range of tasks ( Wang et al. 2023 ; Honovich et al. 2023 ; Taori et al. 2023 ; Liu et al. 2024b ) . While acquiring data through manual annotation continues to play an important role, synthetic data generation offers a scalable complement to human labeling ( Viswanathan et al. 2023 ; Kim et al. 2023b ) . Hence, numerous works have proposed novel methods to effectively generate high-quality synthetic data ( Xu et al. 2024a ; Gunasekar et al. 2023 ; Yue et al. 2023 ; Yue et al. 2024 ) . As multiple proprietary LMs with comparable performance emerge and open-source LMs steadily catch up ( Hurst et al. 2024 ; Anthropic 2024 ; MetaAI 2024 ; Team 2024 ) , measuring each LM’s data generation capabilities has become as crucial as developing new data generation methods. Moreover, companies providing proprietary LMs have begun promoting the use of their latest models for generating synthetic data ( Nvidia 2024 ) . Carefully comparing data generation ability across LMs helps validate these claims and allows practitioners to wisely choose models for data synthesis. To systematically compare LMs’ capabilities as data generators, a unified experimental setting is needed, where only the data generator varies, while other components remain fixed. However, as shown in Figure 1 , prior works have focused more on demonstrating the effectiveness of their data generation method, leading to various experimental settings that make such comparison challenging. For instance, Self-Instruct ( Wang et al. 2023 ) , Alpaca ( Taori et al. 2023 ) , WizardLM ( Xu et al. 2024a ) and Orca ( Mukherjee et al. 2023 ) varied in their choice of LMs for data generation, quantity of synthetic training data, base models used for training, and benchmarks for evaluating the model trained on the synthetic dataset. These heterogeneous settings make it difficult to isolate and measure LMs’ data generation capabilities, highlighting the need for controlled settings. Figure 1: Illustration of the motivation of AgoraBench : Prior works focused on developing new methods to generate synthetic data. In contrast, our work focuses on systematically comparing different LMs as data generators based on existing data generation methods. Further explanation of data generation methods are covered in Section 2 . To this end, we propose AgoraBench , a benchmark for evaluating LMs’ data generation capabilities across nine settings, combining three domains (math, instruction-following, code) with three data generation methods (instance generation, response generation, quality enhancement). Within each setting, all variables except the data generator are controlled: the same meta-prompt and seed dataset are used, with each LM generating an identical number of training instances. Llama-3.1-8B is trained on each synthetic dataset and evaluated on a fixed set of benchmarks spanning different capabilities: mathematics, coding, and general instruction-following. To evaluate the quality of synthetic data, we define a metric called Performance Gap Recovered (PGR), which measures the relative improvement of the model trained on the data (denoted as ‘student model’) over its base model. Based on this setting, we assess six LMs as data generators: GPT-4o, GPT-4o-mini, Claude-3.5-Sonnet, and Llama-3.1-Instruct (8, 70, 405B). 1 1 1 Xu et al. 2024c , a contemporaneous work with ours, also measured various LMs’ data generation capabilities. In contrast to our work, they only examine the “response generation” setting, whereas we measure three data generation settings and also do a number of additional analyses on the relationship between the intrinsic quality of data and PGR. Our analysis reveals distinct strengths among different LMs in various kinds of data generation methods. For example, GPT-4o demonstrates superior performance in generating new instances (+ 46.75%), outperforming both Claude-3.5-Sonnet (+ 24.14%) and Llama-3.1-405B-Instruct (+ 10.10%). On the other hand, Claude-3.5-Sonnet excels at refining existing instances (+ 17.89%), surpassing both GPT-4o (+ 6.69%) and GPT-4o-mini (+ 5.49%). These findings demonstrate how AgoraBench can guide practitioners in selecting appropriate LMs for their specific needs. Unexpectedly, we also find that LMs with weaker problem-solving ability sometimes outperform stronger ones in data generation—for example, Claude-3.5-Sonnet (+ 23.43%) is less effective than Llama-3.1-8B-Instruct (+ 55.69%) at generating new instances in the code domain. Based on these findings, we investigate whether an LM’s data generation ability can be predicted by its problem-solving ability alone. Our analysis reveals no strong correlation between the two capabilities. Instead, multiple intrinsic features of data quality—including instruction difficulty, response quality, and response perplexity—collectively influence the student model’s improvement. Furthermore, we demonstrate that the top-5 principal components extracted from intrinsic measurements can explain 93.4% of the variance in the PGR values. Figure 2: AgoraBench tests three data generation methods : generating new instruction and response pairs (left), generating responses (middle), and enhancing the quality of the instruction and/or the response (right). Lastly, we conduct analysis experiments for effective data generation. For instance, we find that the output format of synthetic data significantly impacts performance: data generated using JSON format shows 4.45% lower performance on average across six settings compared to free-form generation. Additionally, in budget-constrained setting, generating more data with a weaker model can outperform generating less data with stronger model. We find that generating 50K instances with GPT-4o-mini, while 3.4 times cheaper, achieves better performance than generating 10K instances with GPT-4o in two out of three settings. 2 Preliminaries: Measuring Data Generation Capabilities of LMs Notations. Given seed data {D}_{seed} and a prompt describing the kind of data generation to perform (referred to as a ‘meta-prompt’) M , a data generator G generates D_{G}=G({D}_{seed},M), (1) where {D}_{seed} and D_{G} can both be expressed as \{(I_{i},R_{i})\mid i=1,\dots,n\} with I denoting an instruction, R denoting a corresponding response, and n denoting the size of the data. Table 1: AgoraBench Settings: