EasyMath: A 0-shot Math Benchmark for SLMs

Drishya Karki, Michiel Kamphuis, Angelecia Frey · 2025

Read EasyMath: A 0-shot Math Benchmark for SLMs by Drishya Karki, Michiel Kamphuis, Angelecia Frey (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14852.txt.

Description

Drishya Karki, Michiel Kamphuis and Angelecia Frey present EasyMath, a compact zero-shot benchmark for math in small language models, in work from 2025. Thirteen categories run from plain arithmetic and order of operations to word problems, algebra and edge cases, skipping specialist topics. Twenty-three models from fourteen million to four billion parameters were scored by exact, numeric and symbolic checks. Accuracy rose with size and training, chain-of-thought helped a little, and consistency improved at scale.

Catalog record

CREATORDrishya Karki, Michiel Kamphuis, Angelecia Frey
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14852

Browse the full library · About the Tower of Babel