RobustFT : Robust Supervised Fine-tuning for Large Language Models under Noisy Response
Junyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang · 2024
Read RobustFT : Robust Supervised Fine-tuning for Large Language Models under Noisy Response by Junyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14922.txt.
Description
Junyu Luo and co-authors clean training data for language models in a 2024 paper. Fine tuning on task data adapts a model to a job, but real datasets always carry noisy answers. That noise drags down the trained model's skill on the very tasks it should master.
Their framework, RobustFT, first finds the noisy entries, then relabels them. A team of expert models, boosted by reasoning prompts, does the detection better than a single checker. The cleaned data then retrain the target model. The authors argue every practical fine tuning pipeline needs such a guard, since hand checking cannot scale to modern dataset sizes.
Catalog record
| CREATOR | Junyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-14922