Call for Rigor in Reporting Quality of Instruction Tuning Data
Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim † 1 Department of Computer Science and Engineering, Korea University {glee889,seojae777,limhseok}@korea.ac.kr · 2025
Read Call for Rigor in Reporting Quality of Instruction Tuning Data by Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim † 1 Department of Computer Science and Engineering, Korea University {glee889,seojae777,limhseok}@korea.ac.kr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04807.txt.
Introduction
Hyeonseok Moon and co-authors call out sloppy reporting in studies that grade instruction tuning data. Data quality makes or breaks how well a tuned model follows people. Papers usually prove quality by training a model and scoring it. The trap sits in the training knobs: learning rates and schedules chosen on a whim.
The team shows those knobs vary wildly across studies of the same data. Worse, a knob choice alone can flip the verdict on whether a dataset is good. Their tests on LIMA and a slice of Alpaca data make the point concrete. Nearly any conclusion can be manufactured. They demand justified settings and full reporting so data claims can be checked.
Catalog record
| CREATOR | Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim † 1 Department of Computer Science and Engineering, Korea University {glee889,seojae777,limhseok}@korea.ac.kr |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04807
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Call for Rigor in Reporting Quality of Instruction Tuning Data Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim † 1 Department of Computer Science and Engineering, Korea University {glee889,seojae777,limhseok}@korea.ac.kr Abstract Instruction tuning is crucial for adapting large language models (LLMs) to align with user intentions. Numerous studies emphasize the significance of the quality of instruction tuning (IT) data, revealing a strong correlation between IT data quality and the alignment performance of LLMs. In these studies, the quality of IT data is typically assessed by evaluating the performance of LLMs trained with that data. However, we identified a prevalent issue in such practice: hyperparameters for training models are often selected arbitrarily without adequate justification. We observed significant variations in hyperparameters applied across different studies, even when training the same model with the same data. In this study, we demonstrate the potential problems arising from this practice and emphasize the need for careful consideration in verifying data quality. Through our experiments on the quality of LIMA data and a selected set of 1,000 Alpaca data points, we demonstrate that arbitrary hyperparameter decisions can make any arbitrary conclusion. Call for Rigor in Reporting Quality of Instruction Tuning Data Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim † 1 Department of Computer Science and Engineering, Korea University {glee889,seojae777,limhseok}@korea.ac.kr 1 Introduction Instruction Tuning (IT) is a widely adopted strategy for enabling a human-interactive use of the knowledge embedded in large language models (LLMs) Cao et al. ( 2023 ); Wang et al. ( 2024 ) . By training with datasets composed of instruction-response pairs, LLM can attain the ability to generate appropriate responses to given instructions Dubois et al. ( 2023 ); Zheng et al. ( 2023 ); Xu et al. ( 2023 ); Conover et al. ( 2023 ) . In implementing IT, data quality is considered a critical factor Zhou et al. ( 2023a ); Wang et al. ( 2024 ); Zhao et al. ( 2024b ); Lu et al. ( 2024 ) . Several studies have proven that selectively using high-quality IT data for training leads to better alignment performance than using the entire dataset Liu et al. ( 2024b ); Chen et al. ( 2024 ); Zhao et al. ( 2024a ); Mekala et al. ( 2024 ) . Traditionally, the quality of IT data is measured by evaluating the performance of models trained on it Liu et al. ( 2024b ); Chen et al. ( 2024 ); Zhao et al. ( 2024a ); Xia et al. ( 2024a ) . This approach stems from the consensus that data is deemed good if it produces a good model . Consequently, most studies on data quality establish a training configuration for models that represent data quality. Then, the performance of the trained model is regarded as the data quality. Zhou et al. ( 2023a ); Zhao et al. ( 2024a ); Xia et al. ( 2024b ); Du et al. ( 2023 ); Zhou et al. ( 2023b ) . Paper Epochs LR LR Scheduler Batch Data Pool Training Llama-2-7B with sampled 1K general domain IT data Ghosh et al. ( 2024 ) 3 5e-5 - 32 Lima Raghavendra et al. ( 2024 ) 3 1e-5 - 8 Dolly Yu et al. ( 2024 ) 3 1e-5 - 64 Alpaca / WizardLM Du et al. ( 2023 ) 3 2e-5 Cosine 128 Alpaca+HC3+WizardLM+Dolly+Self-Instruct+Lima Li et al. ( 2024 ) 3 2e-5 - 128 Alpaca / WizardLM Liu et al. ( 2024a ) 3 2e-5 Cosine 128 Alpaca-gpt4 / Lima Mekala et al. ( 2024 ) 3 2e-5 Cosine 128 Alpaca / Dolly Kong et al. ( 2024 ) 8 1e-5 Cosine 64 Lima Zhao et al. ( 2024a ) 15 1e-5 Linear 128 Alpaca / WizardLM / Lima Zhou et al. ( 2023a ) 15 (ES) 1e-5 Linear 64 Lima Training Llama-2-13B with 1K general domain IT data Ghosh et al. ( 2024 ) 3 5e-5 - 32 Lima Zhao et al. ( 2024b ) 10 1e-4 - 16 Alpaca-gpt4 Liu et al. ( 2024a ) 3 2e-5 Cosine 128 Alpaca-GPT4 / Lima Mekala et al. ( 2024 ) 3 2e-5 Cosine 128 Alpaca / Dolly Zhao et al. ( 2024a ) 15 1e-5 Linear 128 Alpaca / WizardLM / Lima Training Mistral 7B with 1K general domain IT data Kong et al. ( 2024 ) 4 1e-5 Cosine 64 Lima Zhao et al. ( 2024a ) 15 2e-6 Linear 128 Alpaca / WizardLM / Lima Ghosh et al. ( 2024 ) 3 5e-5 - 32 Lima Yu et al. ( 2024 ) 3 1e-5 - 64 Alpaca / WizardLM Yin et al. ( 2024 ) 4 4e-6 - 128 WizardLM / UltraChat / ShareGPT Table 1: Hyperparameters reported by previous studies, adopted to train LLMs with 1K general domain IT data. The data pool details the sources from which the 1K data samples were drawn. Detailed descriptions of these data pools are provided in the Table 4 . The ’+’ symbol indicates experiments where samples were drawn from a combined data mix of all mentioned datasets. The ’/’ symbol reports studies that sampled individually from each data pool. However, we observed that these studies often lack justification for the hyperparameter settings used in model training. Table 1 presents the diverse hyperparameter configurations utilized in previous research implementing IT with a sampled 1K general domain IT dataset. We discovered that the configurations may vary across studies, even when training the same model with identical data sizes. In this study, we question whether reaching coherent conclusions under varying settings is possible. Specifically, we emphasize that conclusions regarding data quality can easily be altered based on arbitrarily chosen hyperparameter settings. For instance, even if one might report that dataset A is superior to dataset B, another could claim that B is better by training models under different settings, even with the same dataset, model, and test settings. This variability poses a risk of causing significant confusion. As a representative case, we consider two general-domain IT datasets: LIMA Zhou et al. ( 2023a ) and sampled 1K dataset from Alpaca (Alpaca-longest Zhao et al. ( 2024a ) ). In Zhao et al. ( 2024a ) , it was reported that a model trained on Alpaca-longest outperformed a model trained on LIMA. However, our experiments contrarily demonstrate that LIMA can also be regarded as better than Alpaca-longest, depending on the selected training setting. Given the current research trend of arbitrarily determining hyperparameters for validation models, this confusion can be identified as a severe yet persistent problem. Through our experiments, we emphasize the necessity of rigor in reporting data quality. Furthermore, our discussion suggests the importance of identifying (at least) locally optimal hyperparameters and reporting data quality under these settings. 2 Related Works Figure 1: The performance comparison between the two models trained with LIMA and Alpaca-Longest. We train Llama-2-7B model with each dataset, We evaluate the data quality when training each dataset with the Llama-2-7B model. is depicted on the Y-axis represents the hyperparameter settings used in each experiment. We bolded the settings that consistently demonstrated conclusive results across all three evaluation datasets. Previous research has widely acknowledged the importance of data quality in performing IT. Chen et al. (