Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
Maggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected] · 2025
Read Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning by Maggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00432.txt.
Description
Maggie Huan and co-authors ask, in a 2025 paper, whether training language models hard on math makes them better at everything else, and find the transfer surprisingly weak. Math scores have become the headline measure of model reasoning, climbing past human marks on famous benchmarks. Leaderboard gains may, though, be narrow drilling rather than general wit.
The team evaluated over twenty open reasoning tuned models across math, science questions, agent planning, coding, and instruction following. Most math stars failed to carry their gains into the other domains. Controlled experiments on one model family, tuned on math data alone with different methods, isolated the cause more cleanly. The results reframe what a math benchmark certifies: strong evidence about math, weak evidence about general problem solving. Buyers and builders who treat math scores as a general intelligence meter are, on this evidence, reading the wrong gauge.
Catalog record
| CREATOR | Maggie Huan 1,2, , Yuetai Li 3,∗ , Tuney Zheng 4,∗ , Xiaoyu Xu 5 , Seungone Kim 1 , Minxin Du 5 , Radha Poovendran 3 , Graham Neubig 1 , Xiang Yue 1, 1 Carnegie Mellon University 2 University of Pennsylvania 3 University of Washington 4 M-A-P 5 The Hong Kong Polytechnic University [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00432