ArgBench: Benchmarking LLMs on Computational Argumentation Tasks

Yamen Ajjour, Carlotta Quensel, Nedim Lipka, Henning Wachsmuth · 2026

Read ArgBench: Benchmarking LLMs on Computational Argumentation Tasks by Yamen Ajjour, Carlotta Quensel, Nedim Lipka, Henning Wachsmuth (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17366.txt.

Description

Ajjour, Quensel, Lipka, and Wachsmuth create ArgBench, the first unified benchmark for computational argumentation in language models. It gathers 33 earlier datasets into one form and tests five model families across 46 tasks, from mining arguments and judging quality to reasoning about arguments and generating them. A systematic analysis then weighs the roles of model size, training skills, reasoning steps, and few-shot examples. The benchmark aims to make argumentation ability comparable across models instead of scattered across incompatible tests.

Catalog record

CREATORYamen Ajjour, Carlotta Quensel, Nedim Lipka, Henning Wachsmuth
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88310
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17366

Browse the full library · About the Tower of Babel