EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara · 2026

Read EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents by Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13841.txt.

Description

Bogavelli and twelve co-authors build EVA-Bench, a full test suite for voice agents used at work. It runs bot-to-bot voice chats, checks the fake user for slips, and remakes bad chats before scores are set. Two joint scores rate the agents: EVA-A for right answers and EVA-X for user feel. The suite holds 213 cases in three work domains, plus stress tests for accent and noise.

Catalog record

CREATORTara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Hari Subramani, Joseph Marinier, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE480869
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13841

Browse the full library · About the Tower of Babel