Benchmarking Abstractive Summarisation: A Dataset of Human-authored Summaries of Norwegian News Articles

Samia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal · 2025

Read Benchmarking Abstractive Summarisation: A Dataset of Human-authored Summaries of Norwegian News Articles by Samia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-07718.txt.

Description

Samia Touileb and co-authors present a 2025 paper on a Norwegian summarization benchmark. Judging AI summaries needs gold-standard texts written by people. The team built a set of Norwegian news articles, each with three human summaries. Every summary comes in both written forms of Norwegian, Bokmål and Nynorsk. Native speakers wrote the references.

The paper details how the data were made. Open language models for Norwegian were then graded on the set. Human judges also compared model output against the human texts. The benchmark proved demanding for current models. The authors offer the set as a yardstick for abstractive summarization in a lower-resource language. Twin written standards make it a rare test of flexibility as well.

Catalog record

CREATORSamia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-07718

Browse the full library · About the Tower of Babel