Argument Summarization and its Evaluation in the Era of Large Language Models

Moritz Altemeyer, Steffen Eger, Johannes Daxenberger, Yanran Chen, Tim Altendorf, Philipp Cimiano, Benjamin Schiller · 2025

Read Argument Summarization and its Evaluation in the Era of Large Language Models by Moritz Altemeyer, Steffen Eger, Johannes Daxenberger, Yanran Chen, Tim Altendorf, Philipp Cimiano, Benjamin Schiller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00847.txt.

Description

Moritz Altemeyer and six co-authors examined in 2025 how large language models change the summarizing of arguments, and how anyone can tell a good summary from a bad one. Argument summaries compress debates into their load-bearing claims, a task at the heart of argument mining.

The team plugged modern models into older systems, built two fresh model-based summarizers, and proposed grading summaries with a model-guided rubric checked against a new human benchmark. Generation and grading both hit state-of-the-art marks. Trustworthy automatic grading matters because argument tools now feed news and policy dashboards.

Catalog record

CREATORMoritz Altemeyer, Steffen Eger, Johannes Daxenberger, Yanran Chen, Tim Altendorf, Philipp Cimiano, Benjamin Schiller
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-00847

Browse the full library · About the Tower of Babel