BankMathBench: A Benchmark for Numerical Reasoning in Banking Scenarios * These authors contributed equally to this work.

2026

Read BankMathBench: A Benchmark for Numerical Reasoning in Banking Scenarios * These authors contributed equally to this work. (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17072.txt.

Description

Yunseung Lee led a four-author team building a test for a skill banking chatbots keep fumbling: everyday numerical reasoning. Chatbots now field questions on deposits, savings, and loans, yet they still misread product types, apply terms wrongly, or botch calculations with exponents and geometric series. Existing math sets test pure math, and finance sets test documents, leaving routine banking tasks unmeasured.

BankMathBench fills that gap with realistic tasks at three levels: single-product reasoning, multi-product comparison, and multi-condition scenarios. When open models were trained on the set, their formula and numerical accuracy rose markedly, and tool-augmented fine-tuning lifted average accuracy by large margins at every level over zero-shot baselines. The benchmark thus doubles as both a yardstick and a training aid for banking numeracy.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-17072

Browse the full library · About the Tower of Babel