Evaluating and Understanding Scheming Propensity in LLM Agents
Mia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner · 2026
Read Evaluating and Understanding Scheming Propensity in LLM Agents by Mia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01608.txt.
Description
Wenye Lin and Kai Han improve the reasoning of large language models without erasing what they already know. Their 2026 work targets a known trade-off: extra training boosts thought, but it can wipe prior skills. Past work credits fresh on-policy data, yet the pair find a second, overlooked cause.
They show that a hidden regularizing effect sits inside a popular preference method reward estimate. Their method, SPoT, first fixes wrong steps in training traces with tiny edits from an expert oracle. Those near-native traces then train the model with a simple right-or-wrong score per trace. With just a few thousand fixed math pairs, a mid-size model gains clear accuracy in brief training. Gains hold on both familiar and new task types.
Catalog record
| CREATOR | Mia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 128367 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01608