SUV : Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning

Tianyang Xu, Xiaoze Liu, Feijie Wu, Xiaoqian Wang, Jing Gao · 2025

Read SUV : Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning by Tianyang Xu, Xiaoze Liu, Feijie Wu, Xiaoqian Wang, Jing Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22948.txt.

Description

Tianyang Xu and co-authors built a way to make chat models forget protected text in two thousand twenty-five. Large language models learn from huge text sets. They can memorize and repeat passages under copyright, which has sparked lawsuits. Full retraining to remove such text is far too costly. The team instead teaches the model to unlearn chosen passages.

Their method first gathers cases where the model repeats protected text. Training then swaps those outputs for fresh, plausible wording. Extra math guards keep skill on unrelated tasks from slipping. Tests show the model drops the protected passages at scale. It keeps its general language ability at the same time. The approach offers firms a practical path to legal compliance.

Catalog record

CREATORTianyang Xu, Xiaoze Liu, Feijie Wu, Xiaoqian Wang, Jing Gao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22948

Browse the full library · About the Tower of Babel