WorkstreamBench: Evaluating LLM Agents on End-to-End Spreadsheet Tasks in Finance
Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, Hongseok Namkoong · 2026
Read WorkstreamBench: Evaluating LLM Agents on End-to-End Spreadsheet Tasks in Finance by Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, Hongseok Namkoong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22664.txt.
Introduction
Yen and others evaluate language model agents on end to end spreadsheet work in finance, a skill prior benchmarks missed by testing only question answering or single formula edits. Their MBABench set grades full deliverables on accuracy, formula quality and format, reflecting professional review standards for modelling, forecasting and scenario analysis. Across 18 agents, even the strongest fall short of basic professional standards, and scores drop sharply once tasks chain beyond a few calculations. The authors conclude current agents cannot yet reliably produce professional grade spreadsheets at real world complexity.
Catalog record
| CREATOR | Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, Hongseok Namkoong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105039 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22664
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WorkstreamBench: Evaluating LLM Agents on End-to-End Spreadsheet Tasks in Finance Thomson Yen, Julian Poeltl, Harshith Srinivas Gear, Yilin Meng, Joshua Fan, Adam Shen, Yili Liu, Ali Bauyrzhan, Siri Du, Haoyang Liu, Daniel Guetta, Hongseok Namkoong Abstract LLM agents are increasingly expected to carry out end-to-end workflows, producing complete artifacts from high-level user instructions. To meet enterprise needs, frontier AI labs have developed agents that can construct entire spreadsheets from scratch. This is especially relevant in finance, where core workflows such as financial modeling, forecasting, and scenario analysis are commonly conducted through spreadsheets. Yet, existing spreadsheet benchmarks do not measure this advanced capability, focusing instead on question-answering or single-formula edits. To address this gap, we provide one of the first evaluations of agents on end-to-end spreadsheet tasks, focusing on economically critical financial workflows such as modeling and scenario analysis. Since deliverables therein are routinely reviewed and revised by multiple stakeholders, judging their quality necessarily involves high-level criteria such as readability or ease of modification. To reflect the multidimensional nature of solution quality, we develop an evaluation taxonomy comprising three dimensions: Accuracy , Formula , and Format , each comprising fine-grained criteria that reflect professional standards. The Claude family leads the benchmark and produces the most professional-looking outputs in our qualitative review, but even the strongest agents frequently fall short of professional finance standards and degrade sharply as the difficulty increases beyond a few chained calculations. This suggests that current agents are not yet able to reliably produce professional-quality spreadsheets at the level of complexity real-world workflows demand. 1 Introduction Spreadsheets are a cornerstone of modern business work. Recent product releases such as Claude for Excel ( 2 ) and ChatGPT for Excel ( 18 ) demonstrate that agents can now construct entire spreadsheets end-to-end from high-level instructions. This emerging capability is especially pertinent in finance, where financial modeling, forecasting, and scenario analysis are almost entirely conducted through spreadsheets ( 5 ; 4 ) . Existing benchmarks, however, evaluate agents only on narrow atomic tasks, such as simple spreadsheet manipulations or question answering over tabular data (left of Figure 1 ) ( 15 ; 6 ; 28 ; 8 ) . GDPval ( 21 ) takes a step towards evaluating the end-to-end execution of economically valuable tasks, five of which involve financial spreadsheets; however, its evaluation requires opaque internal expert annotations. As a result, the community lacks a transparent benchmark for end-to-end construction of financial spreadsheets. To address this gap, we introduce WorkstreamBench, a benchmark that evaluates agents on complex end-to-end spreadsheet tasks in finance. As a concrete task example, consider a private equity firm assessing an acquisition. To support this decision, analysts construct a financial model : a structured account of the company’s past and possible futures, integrating how much money the company makes and spends (profit and loss statement), what it owns and owes (balance sheet), and how cash moves in and out (cash flow statement), covering both the past and suitable scenario analyses under customizable assumptions (e.g. what if the company’s future growth rate is 3% as opposed to 5%). An illustrative deliverable is shown in Figure 1 , in stark contrast to the simpler atomic tasks focusing on introducing one correct formula, question-answering, or summarization that prior benchmarks focus on ( 23 ; 27 ; 13 ; 24 ; 14 ) . Crucially, the resulting model is not a one-off private calculation. It is passed up the corporate chain to managers and VPs for reviews and edits, and then to the client’s analysts and decision makers for the same scrutiny. As a result of this high-stakes, collaborative nature, a deliverable herein naturally demands more than computational accuracy. The relevant notion of quality is necessarily multi-faceted: spanning readability, structural clarity (does the workbook clearly present modeling assumptions?), and flexibility (is it easy to modify?). To operationalize this notion, we propose a taxonomy of three core dimensions. Accuracy measures workbook correctness, from soundness of the underlying computation to completeness of the required scenario analyses. Formula assesses the robustness and interpretability of cell-level computations. Format captures various aspects that impact the readability of the spreadsheet. Each dimension is further decomposed into fine-grained subdimensions that specify concrete success criteria, such as Handle Edge Cases or Logic Readability . The latter, for example, requires formulas to be clear and intent-revealing, avoiding monolithic expressions to facilitate future reviews and edits (see Figure 3 ). These criteria are, by their nature, difficult to verify programmatically. We therefore employ an LLM-based judge and systematically verify its decisions with experts over a wide range of spreadsheet attempts in Section 5 . In general, we found that its assessments align closely with those of human experts. Figure 1 : Compared to prior work that focus on atomic tasks on spreadsheet ( left ), WorkstreamBench evaluates LLM agents on completing end-to-end spreadsheet tasks in critical finance domain ( right ), covering key criteria that determines usability of resulting deliverable in professional settings. Prior tasks focus on simple atomic tasks that center on question-answering or edits involving few values or formula, where evaluation can largely be performed via exact-matching. In contrast, WorkstreamBench expects a complete multi-sheet workbook, and consequently employs a holistic evaluation centered on high-level quality relevant in professional settings (e.g. readability). Our main contributions are as follows: • We introduce WorkstreamBench, one of the first benchmarks that center around evaluating LLM agents on end-to-end tasks. Compared to GDPval ( 21 ) , our benchmark focus on spreadsheet tasks related to financial workflows. • To enable a holistic evaluation of the deliverable expected of end-to-end tasks, we develop a quality taxonomy that reflects desiderata in financial workflows. We then develop and validate a corresponding LLM-as-judge pipeline for its evaluation. • We conduct manual and quantitative analysis on the tasks and the corresponding agents’ attempts, and find that even the best agents today frequently fall short of simple yet crucial professional standards. Furthermore, we identify significant performance degradation as task difficulty increases, suggesting that agents still struggle with real-world spreadsheet workflows that experienced professionals tackle. Figure 2 : The rubric ( left ) and the composite scores of agents on WorkstreamBench ( right ). The error bar indicates standard error. We found the Claude Web outperforms all others by a clear margin in all three core dimensions separately. However, substantial gap remains in current agents’ capabilities to meet professional standards. 2 End-to-end Spreadsheet Task - An Example in Finance End-to-end spreadsheet tasks differ qualitatively from the atomic tasks examined in prior work ( 23 ; 27 ; 13 ; 24 ; 14 ) (see Figure 1 ): the deliverable is a complete, multi-sheet workbook rather than a single atomic task, i.e., writing a suitable function, calculating an expected number, or answering questions about a given spreadsheet. This shift in deliverable scale and complexity, coupled with its downstream use, demands a correspondingly different notion of quality. Especially in finance, where spreadsheets are regularly reviewed, modified, and reused by multiple stakeholders, quality naturally extends beyond numerical correctness. In this section, we illustrate this point with a representative task from the ModelOff competition ( 10 ) . Example Task: "Bread and Butter" (ModelOff 2015). Contestants are asked to build a financial model for