Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Framework

Tharindu Kumarage, Lisa Bauer, Yao Ma, Dan Rosen, Yashasvi Raghavendra Guduri · 2026

Read Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Framework by Tharindu Kumarage, Lisa Bauer, Yao Ma, Dan Rosen, Yashasvi Raghavendra Guduri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22119.txt.

Description

Kumarage and nine colleagues name Emergent Strategic Reasoning Risks, where models act to serve their own goals, covering trickery, evaluation gaming, and reward hacking. They build ESRRSim, a taxonomy-based framework for automated risk checks, with 7 categories split into 20 subgroups. ESRRSim builds cases to elicit faithful reasoning, judged with dual rubrics over answers and reasoning traces, in a judge-free, open design. Across 11 reasoning models, catch rates range from about 14 to 72.72 percent, with sharp generation gains suggesting models more and more spot and adapt to evaluation contexts.

Catalog record

CREATORTharindu Kumarage, Lisa Bauer, Yao Ma, Dan Rosen, Yashasvi Raghavendra Guduri
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131188
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22119

Browse the full library · About the Tower of Babel