Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning
Qinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts · 2026
Read Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning by Qinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22074.txt.
Description
Yu and four colleagues build two tests of whether reasoning chains trained through Reinforcement Learning from Verifiable Rewards truly show how a model gets its answer. The first, Causal Importance of Reasoning, gauges how much reasoning words shape the final answer. The second, Sufficiency of Reasoning, checks whether a checker can get a clear answer from the reasoning alone. Tests on Qwen2.5 models and ReasoningGym tasks find that while RLVR improves task accuracy, it does not clearly lift Causal Importance or Sufficiency.
Catalog record
| CREATOR | Qinan Yu, Alexa Tartaglini, Peter Hase, Carlos Guestrin, Christopher Potts |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65194 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22074