EasyMath: A 0-shot Math Benchmark for SLMs
Drishya Karki, Michiel Kamphuis, Angelecia Frey · 2025
Read EasyMath: A 0-shot Math Benchmark for SLMs by Drishya Karki, Michiel Kamphuis, Angelecia Frey (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14852.txt.
Description
Drishya Karki, Michiel Kamphuis and Angelecia Frey present EasyMath, a compact zero-shot benchmark for math in small language models, in work from 2025. Thirteen categories run from plain arithmetic and order of operations to word problems, algebra and edge cases, skipping specialist topics. Twenty-three models from fourteen million to four billion parameters were scored by exact, numeric and symbolic checks. Accuracy rose with size and training, chain-of-thought helped a little, and consistency improved at scale.
Catalog record
| CREATOR | Drishya Karki, Michiel Kamphuis, Angelecia Frey |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14852