Benchmarking Abstractive Summarisation: A Dataset of Human-authored Summaries of Norwegian News Articles
Samia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal · 2025
Read Benchmarking Abstractive Summarisation: A Dataset of Human-authored Summaries of Norwegian News Articles by Samia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-07718.txt.
Description
Samia Touileb and co-authors present a 2025 paper on a Norwegian summarization benchmark. Judging AI summaries needs gold-standard texts written by people. The team built a set of Norwegian news articles, each with three human summaries. Every summary comes in both written forms of Norwegian, Bokmål and Nynorsk. Native speakers wrote the references.
The paper details how the data were made. Open language models for Norwegian were then graded on the set. Human judges also compared model output against the human texts. The benchmark proved demanding for current models. The authors offer the set as a yardstick for abstractive summarization in a lower-resource language. Twin written standards make it a rare test of flexibility as well.
Catalog record
| CREATOR | Samia Touileb, Vladislav Mikhailov, Marie Kroka, Lilja Øvrelid, Erik Velldal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-07718