Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?

Jeanmely Rojas Nunez, Viraj Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo, Vasu Sharma, Maheep Chaudhary · 2026

Read Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT? by Jeanmely Rojas Nunez, Viraj Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo, Vasu Sharma, Maheep Chaudhary (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28860.txt.

Description

Jeanmely Rojas and six colleagues ask whether RL keeps inner circuits better than fine-tuning. Fine-tuning often induces severe loss of prior skills, and recent work attributes RL's edge to updates staying closer to base policy. They extend this outer account to the circuit level with differential circuit weakness, a measure of circuit decay. On Qwen2.5-3B-Instruct adapted to science question-answering, SFT adapts faster but disrupts circuits more and forgets more prior skills, while RL preserves more of the base circuit at slower learning cost.

Catalog record

CREATORJeanmely Rojas Nunez, Viraj Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo, Vasu Sharma, Maheep Chaudhary
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21735
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28860

Browse the full library · About the Tower of Babel