More Agents Helps but Adversarial Robustness Gap Persists *Equal contribution

2025

Read More Agents Helps but Adversarial Robustness Gap Persists *Equal contribution (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07112.txt.

Description

Khashayar Alavi, Zhastay Yeltay, Lucie Flek, and Akbar Karimi test whether teams of language model agents stay reliable when math questions are corrupted. Voting among many sampled agents, their Agent Forest system, reliably raises accuracy on clean problems. The authors perturbed questions with punctuation noise at three intensities and with realistic human typos from the WikiTypo and R2ATA collections. They then tested six open-source models on four benchmarks with up to twenty-five agents.

Collaboration helped: accuracy rose with agent count, with the largest gains between one and five agents and diminishing returns past about ten. But the adversarial gap never closed. Punctuation damage scaled with severity, and human-like typos remained the dominant bottleneck, producing the largest accuracy gaps and highest attack success rates even for big agent teams.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07112

Browse the full library · About the Tower of Babel