Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning

Maggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected] · 2025

Read Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning by Maggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00432.txt.

Description

Maggie Huan and co-authors ask, in a 2025 paper, whether training language models hard on math makes them better at everything else, and find the transfer surprisingly weak. Math scores have become the headline measure of model reasoning, climbing past human marks on famous benchmarks. Leaderboard gains may, though, be narrow drilling rather than general wit.

The team evaluated over twenty open reasoning tuned models across math, science questions, agent planning, coding, and instruction following. Most math stars failed to carry their gains into the other domains. Controlled experiments on one model family, tuned on math data alone with different methods, isolated the cause more cleanly. The results reframe what a math benchmark certifies: strong evidence about math, weak evidence about general problem solving. Buyers and builders who treat math scores as a general intelligence meter are, on this evidence, reading the wrong gauge.

Catalog record

CREATORMaggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00432

Browse the full library · About the Tower of Babel