RUST-BENCH : Benchmarking LLM Reasoning on Unstructured Text within Structured Tables
Nikhil Abhyankar, Purvi Chaurasia, Sanchit Kabra, Ananya Srivastava, Vivek Gupta, Chandan K. Reddy · 2025
Read RUST-BENCH : Benchmarking LLM Reasoning on Unstructured Text within Structured Tables by Nikhil Abhyankar, Purvi Chaurasia, Sanchit Kabra, Ananya Srivastava, Vivek Gupta, Chandan K. Reddy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04491.txt.
Description
Nikhil Abhyankar leads six authors with RUST-BENCH, a test of reasoning over messy real tables. Older benchmarks use small, tidy tables that hide how hard real data can be. Real tables mix fixed fields with free text and stretch across thousands of tokens.
The bench holds seven thousand nine hundred sixty-six questions from two thousand thirty-one real tables. One part draws on science grant records, the other on NBA statistics. Tests vary scale, mixed formats, domain detail, and reasoning depth all at once. Leading language models still struggle on heterogeneous tables, which shows where table reasoning must improve.
Catalog record
| CREATOR | Nikhil Abhyankar, Purvi Chaurasia, Sanchit Kabra, Ananya Srivastava, Vivek Gupta, Chandan K. Reddy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04491