Less is More: Quality-Aware Training Data Selection for Scientific Summarization

Maria Nefeli Paraskevopoulou, Tatiana Passali, Grigorios Tsoumakas · 2026

Read Less is More: Quality-Aware Training Data Selection for Scientific Summarization by Maria Nefeli Paraskevopoulou, Tatiana Passali, Grigorios Tsoumakas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24828.txt.

Description

Maria Nefeli Paraskevopoulou, Tatiana Passali, and Grigorios Tsoumakas argue that less training data can beat more, if the data are chosen by quality. Scientific summarisation systems usually train on author written abstracts as gold summaries. Those abstracts vary widely in how well they match the article they summarise. The team first builds one of the largest datasets for long document summarisation in biomedicine. It contains 1.88 million articles from PubMed Central.

Two kinds of metrics supply the quality signals: source grounded measures and model based ones. Training on high quality subsets beats random sampling at the same training size. On factuality oriented metrics, chosen subsets can even match or beat larger random ones. The findings make reference quality a first order concern for summarisation research. Paraskevopoulou and colleagues release the dataset for public use. Quality aware selection, they conclude, is a cheap way to gain training efficiency.

Catalog record

CREATORMaria Nefeli Paraskevopoulou, Tatiana Passali, Grigorios Tsoumakas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24828

Browse the full library · About the Tower of Babel