EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents
Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara · 2026
Read EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents by Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13841.txt.
Description
Bogavelli and twelve co-authors build EVA-Bench, a full test suite for voice agents used at work. It runs bot-to-bot voice chats, checks the fake user for slips, and remakes bad chats before scores are set. Two joint scores rate the agents: EVA-A for right answers and EVA-X for user feel. The suite holds 213 cases in three work domains, plus stress tests for accent and noise.
Catalog record
| CREATOR | Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 480869 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13841