Big-Math : A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
Alon Albalak, Duy Phung, Nathan Lile, Rafael Rafailov †, Kanishk Gandhi, Louis Castricato, Anikait Singh, Chase Blagden, Violet Xiang, Dakota Mahan, Nick Haber · 2025
Read Big-Math : A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models by Alon Albalak, Duy Phung, Nathan Lile, Rafael Rafailov †, Kanishk Gandhi, Louis Castricato, Anikait Singh, Chase Blagden, Violet Xiang, Dakota Mahan, Nick Haber (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17387.txt.
Description
Alon Albalak leads a large team releasing a math dataset built for training reasoning models. Their paper appeared in two thousand twenty-five. Open math sets force a bad trade: few hand-written gems, or masses of machine-made questions of shaky quality. Reinforcement learning needs many problems with checkable answers. The team set out to supply both scale and quality.
Big-Math holds over two hundred fifty thousand questions with verifiable answers. The team filtered and cleaned openly available sources with care. Three rules guided the curation. Answers must be uniquely checkable, problems open-ended, and solutions in closed form. The result suits reward-based training directly. Language models can practice math against it at scale.
Catalog record
| CREATOR | Alon Albalak, Duy Phung, Nathan Lile, Rafael Rafailov †, Kanishk Gandhi, Louis Castricato, Anikait Singh, Chase Blagden, Violet Xiang, Dakota Mahan, Nick Haber |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-17387