Correcting Large Language Model Behavior via Influence Function

Han Zhang, Zhuo Zhang, Yi Zhang, Yuanzhao Zhai, Hanyang Peng, Yu Lei, Yue Yu, Hui Wang, Bin Liang, Lin Gui, Ruifeng Xu · 2024

Read Correcting Large Language Model Behavior via Influence Function by Han Zhang, Zhuo Zhang, Yi Zhang, Yuanzhao Zhai, Hanyang Peng, Yu Lei, Yue Yu, Hui Wang, Bin Liang, Lin Gui, Ruifeng Xu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16451.txt.

Description

Han Zhang and co-authors propose LANCET in a 2024 paper on fixing unwanted behavior in large language models. Training data can go stale as human values shift, yet finding and fixing bad examples by hand costs much human time. The team seek a method that needs no new human input.

First, a math tool called an influence function finds the training examples that most shaped a bad output. Then a training step adjusts the model based on that pattern. In tests, the method corrected behavior well and beat methods that collect fresh human choices. It also helps explain why a model learned a given habit.

Catalog record

CREATORHan Zhang, Zhuo Zhang, Yi Zhang, Yuanzhao Zhai, Hanyang Peng, Yu Lei, Yue Yu, Hui Wang, Bin Liang, Lin Gui, Ruifeng Xu
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-16451

Browse the full library · About the Tower of Babel