Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning

Qinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts · 2026

Read Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning by Qinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22074.txt.

Description

Yu and four colleagues build two tests of whether reasoning chains trained through Reinforcement Learning from Verifiable Rewards truly show how a model gets its answer. The first, Causal Importance of Reasoning, gauges how much reasoning words shape the final answer. The second, Sufficiency of Reasoning, checks whether a checker can get a clear answer from the reasoning alone. Tests on Qwen2.5 models and ReasoningGym tasks find that while RLVR improves task accuracy, it does not clearly lift Causal Importance or Sufficiency.

Catalog record

CREATORQinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65194
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22074

Browse the full library · About the Tower of Babel