Context-Aware Hierarchical Merging for Long Document Summarization

Litu Ou, Mirella Lapata · 2025

Read Context-Aware Hierarchical Merging for Long Document Summarization by Litu Ou, Mirella Lapata (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00977.txt.

Description

Litu Ou and Mirella Lapata tackle a flaw in how computers summarise very long documents, in a 2025 paper. The standard trick splits a huge text into chunks, summarises each, then merges the summaries step by step. Each merge can bend the facts a little, and the bends compound into outright errors. The authors ask whether feeding source context back into the merges can keep the summary honest.

They test three ways to add that context: swapping mid-level summaries for matching source passages, polishing summaries against the source as evidence, and tying summaries to the source through quiet citation links. On legal and story datasets, every context-fed version beat both plain merging and direct summarising with a leading open model. Polishing against the source tended to work best. The study charts a practical route to faithful long summaries.

Catalog record

CREATORLitu Ou, Mirella Lapata
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-00977

Browse the full library · About the Tower of Babel