Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning

Jiayu Wang, Yifei Ming, Zixuan Ke, Caiming Xiong, Shafiq Joty, Aws Albarghouthi, Frederic Sala · 2025

Read Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning by Jiayu Wang, Yifei Ming, Zixuan Ke, Caiming Xiong, Shafiq Joty, Aws Albarghouthi, Frederic Sala (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04723.txt.

Description

Jiayu Wang and six colleagues wrote a 2025 paper on how reinforcement learning improves math reasoning in language models. Training by reward has raised scores a lot on hard problems. Yet why the training works, step by step, stayed murky.

Their frame, SPARKLE, splits reasoning into three parts for close study. It tracks how a model follows a plan, how it pulls in stored knowledge, and how it chains subproblems. Scores alone hide which of these parts gained most. The authors use the split to find sharp, sometimes surprising effects. One involves what happens when the model is handed extra hints. Such insight can guide the next round of training methods.

Catalog record

CREATORJiayu Wang, Yifei Ming, Zixuan Ke, Caiming Xiong, Shafiq Joty, Aws Albarghouthi, Frederic Sala
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04723

Browse the full library · About the Tower of Babel