More Agents Helps but Adversarial Robustness Gap Persists *Equal contribution
2025
Read More Agents Helps but Adversarial Robustness Gap Persists *Equal contribution (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07112.txt.
Description
Khashayar Alavi, Zhastay Yeltay, Lucie Flek, and Akbar Karimi test whether teams of language model agents stay reliable when math questions are corrupted. Voting among many sampled agents, their Agent Forest system, reliably raises accuracy on clean problems. The authors perturbed questions with punctuation noise at three intensities and with realistic human typos from the WikiTypo and R2ATA collections. They then tested six open-source models on four benchmarks with up to twenty-five agents.
Collaboration helped: accuracy rose with agent count, with the largest gains between one and five agents and diminishing returns past about ten. But the adversarial gap never closed. Punctuation damage scaled with severity, and human-like typos remained the dominant bottleneck, producing the largest accuracy gaps and highest attack success rates even for big agent teams.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07112