New News : System-2 Fine-tuning for Robust Integration of New Knowledge

Core Francisco Park, Zechen Zhang *, Hidenori Tanaka · 2025

Read New News : System-2 Fine-tuning for Robust Integration of New Knowledge by Core Francisco Park, Zechen Zhang *, Hidenori Tanaka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01812.txt.

Introduction

Core Francisco Park, Zechen Zhang, and Hidenori Tanaka test whether language models can truly absorb fresh news into their weights. Their work appeared in twenty twenty-five. Models ace questions when the news sits in the prompt, yet bake it in through training and they stumble.

The team built New News, a set of plausible invented stories across math, coding, discoveries, and events, each with questions that hinge on the facts. Plain fine-tuning lagged far behind in-context reading. Their remedy, System-2 fine-tuning, generates paraphrases, implications, and self-asked questions to deepen the training. The self-questioning recipe worked best, preserving general skill. One warning emerged: training with the news visible in context can shadow and wreck the learning.

Catalog record

CREATORCore Francisco Park, Zechen Zhang *, Hidenori Tanaka
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE127 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01812

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

New News : System-2 Fine-tuning for Robust Integration of New Knowledge Core Francisco Park, Zechen Zhang *, Hidenori Tanaka Abstract Humans and intelligent animals can internalize new information and accurately internalize their implications to perform downstream tasks. While large language models (LLMs) can achieve this through in-context learning (ICL) when the information (news) is explicitly given as context, adequately integrating the information into model weights via fine-tuning remains challenging. In this paper, we introduce New News , a dataset composed of hypothetical yet plausible news spanning multiple domains (mathematics, coding, discoveries, leaderboards, events), accompanied by downstream evaluation questions whose correct answers critically depend on understanding and internalizing the news. First, we demonstrate a substantial gap between naive fine-tuning and in-context learning (FT-ICL gap) on our dataset. To address this gap, we explore a suite of self-play data generation protocols — paraphrases , implications , and Self-QA — designed to distill the knowledge processed by the model with context into the weights of the model, which we term System-2 Fine-tuning (Sys2-FT). We systematically evaluate ICL and Sys2-FT performance across data domains and model scales with the Qwen 2.5 family of models. Our results demonstrate that the Self-QA protocol of Sys2-FT significantly improves models’ in-weight learning of the news while preserving general capabilities. Furthermore, we discover the contextual shadowing effect , where training with the news in context followed by its rephrases or QAs catastrophically degrades learning of the news. Finally, we show preliminary evidence of an emerging scaling law of Sys2-FT. 1 Introduction Learning new knowledge in a consistent and continuous way is one of the most important cognitive abilities. While large language models ( Brown et al., 2020 ; OpenAI, 2024a ; Team, 2024b ; Dubey et al., 2024 ; Yang et al., 2024 ) have been successful in crushing knowledge and problem-solving focused benchmarks ( Hendrycks et al., 2021a ; Hendrycks et al., 2021b ; Rein et al., 2023 ) , these benchmarks do not measure the ability to successfully adapt one’s belief when internalizing new information, which is arguably a hallmark of general intelligence. Interestingly, current models demonstrate impressive in-context learning abilities and can process novel information efficiently when the new information is given in context ( Wei et al., 2023 ; Team, 2024a ; Lampinen et al., 2022 ; Park et al., 2024 ) ; yet, it remains a challenge to consolidate the knowledge in weights ( Snell et al., 2022 ; Berglund et al., 2024 ; Guan et al., 2025 ) . For example, upon learning the news that Trump won the 2024 US election, most people can instinctively update their world models, propagate implications and react accordingly. Given such news as context, language models are able to process its implication adequately as well through its chain of thoughts; however, it is hard to distill these implications back into its weights via fine-tuning (FT), as past works have shown the unreliability of fine-tuning as a knowledge injection technique ( Mitchell et al., 2022b ; Meng et al., 2022 ; Berglund et al., 2024 ) . In this paper, we aim to set up the groundwork to systematically study integration of new information (“news”) into large language model weights. Our main contributions are as follows: 1. New News , a dataset measuring the ability to integrate new information (Sec. 3 ) . We carefully curate New News , a dataset consisting of 75 hypothetical news and 375 downstream questions across 5 different domains: math, coding, discoveries, leaderboards and events. The questions measure how well the given news is internalized by evaluating complex downstream implications and consequences. This dataset clearly characterizes the gap between the naive FT and ICL across model scales. 2. Evaluation of System-2 Fine-tuning protocols: Self-QA is a strong protocol for updating models with new knowledge (Fig. 4 ) . We evaluate a suite of methods which we term system-2 fine-tuning (Sys2-FT) that leverage the model with news in-context to generate fine-tuning data, such as paraphrases, implications or QA pairs. We find that Sys2-FT significantly improves the appropriate internalization of the news compared to naive fine-tuning. In particular, our Self-QA protocol shows high performance and robustness across model scales and model families (additional experiments on Llama 3.1 8B in C.3 ), sometimes even matchinng the ICL performance while preserving general capabilities. 3. Identification of two curses between fine-tuning and in-context learning (Fig. 6 ) . We identify two important effects where FT hinders ICL abilities and vice versa. First, the curse of overexposure manifests as FT negatively affecting a model’s ICL ability on the same news; second, we find a robust contextual shadowing effect where news prefixing the Sys2-FT data can catastrophically degrade the learning signal during fine-tuning. These findings could have non-trivial implications for practical purposes of fine-tuning with new documents. 4. Emergent scaling properties of System-2 Fine-tuning (Fig. 10 ) . By normalizing math Self-QA fine-tuning runs by compute, we reveal scaling properties of Sys2-FT, suggesting that larger models are more data-efficient learners. Figure 1: Overview. We introduce New News , a dataset consisting of hypothetical but not counterfactual news which has rich downstream implications in order to test the ability to integrate new information. To update model weights , we explore a suite of methods we dub System-2 Fine-tuning (Sys2-FT). Sys2-FT involves generating synthetic datasuch as paraphrases, implications and QA pairs from the news using models’ native in-context learning abilities. We find that our specific Self-QA protocol performs significantly better than naive FT. 2 Related works Knowledge Editing Our work shares motivation with knowledge editing ( Zhang et al., 2024 ; Wang et al., 2024a ) in updating models’ factual understandings and world models. However, a major difference is that our goal is not to precisely edit a relational fact in the model, but rather to integrate new and non-counterfactual information appropriately into the model. In this regard, both the New News dataset and Sys2-FT protocols are different from the approaches explored in the knowledge editing literature. Traditional editing datasets and benchmarks such as zsRE ( Levy et al., 2017 ) and Wikibio ( Lebret et al., 2016 ; Zhang et al., 2024 ) tend to focus on simple subject-relation-object pair edits, whereas our evaluation dataset consists of more realistic and comprehensive updates on news; classic model editing methods such as ROME ( Meng et al., 2022 ) and MEND ( Mitchell et al., 2022a ) also tend to localize the edit in the model a priori , whereas the System-2 Fine-tuning method is more natural and not constrained in any way beyond the choice of data augmentation protocols. In fact, due to the aforementioned points, knowledge editing techniques often suffer from producing incorrect ripple effects and incoherent downstream reasoning in multi-hop questions ( Cohen et al., 2023 ; Zhong et al., 2023 ) , and more importantly the target effect is often not even well defined ( Hase et al., 2024 ) . Belief Update There is evidence that LLMs have internal world model representations ( Li et al., 2022 ; Gurnee and Tegmark, 2023 ; Hazineh et al., 2023 ; Vafa et al., 2024 ) and form beliefs about the world ( Hase et al., 2021 ; Zhu et al.,

Read the complete text