RobustFT : Robust Supervised Fine-tuning for Large Language Models under Noisy Response

Junyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang · 2024

Read RobustFT : Robust Supervised Fine-tuning for Large Language Models under Noisy Response by Junyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14922.txt.

Description

Junyu Luo and co-authors clean training data for language models in a 2024 paper. Fine tuning on task data adapts a model to a job, but real datasets always carry noisy answers. That noise drags down the trained model's skill on the very tasks it should master.

Their framework, RobustFT, first finds the noisy entries, then relabels them. A team of expert models, boosted by reasoning prompts, does the detection better than a single checker. The cleaned data then retrain the target model. The authors argue every practical fine tuning pipeline needs such a guard, since hand checking cannot scale to modern dataset sizes.

Catalog record

CREATORJunyu Luo, Xiao Luo, Kaize Ding, Jingyang Yuan, Zhiping Xiao, Ming Zhang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-14922

Browse the full library · About the Tower of Babel