Evaluating and Understanding Scheming Propensity in LLM Agents

Mia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner · 2026

Read Evaluating and Understanding Scheming Propensity in LLM Agents by Mia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01608.txt.

Description

Wenye Lin and Kai Han improve the reasoning of large language models without erasing what they already know. Their 2026 work targets a known trade-off: extra training boosts thought, but it can wipe prior skills. Past work credits fresh on-policy data, yet the pair find a second, overlooked cause.

They show that a hidden regularizing effect sits inside a popular preference method reward estimate. Their method, SPoT, first fixes wrong steps in training traces with tiny edits from an expert oracle. Those near-native traces then train the model with a simple right-or-wrong score per trace. With just a few thousand fixed math pairs, a mid-size model gains clear accuracy in brief training. Gains hold on both familiar and new task types.

Catalog record

CREATORMia Hopman, Jannes Elstner, Maria Avramidou, Amritanshu Prasad, David Lindner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE128367
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.01608

Browse the full library · About the Tower of Babel