End-to-End Long Document Summarization using Gradient Caching

Rohit Saxena Hao Tang Frank Keller, [email protected], [email protected] · 2025

Read End-to-End Long Document Summarization using Gradient Caching by Rohit Saxena Hao Tang Frank Keller, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01805.txt.

Description

Long texts, such as full reports or books, strain the memory of the models that sum them up, since cost grows with the square of length. Rohit Saxena, Hao Tang, and Frank Keller fix that strain in a 2025 study with a cache trick. Their method trains a sum model on the whole text, with no cuts.

The text is read in panes that do not lap, and the parts join at the write step. On the way back, slope notes are cached and fed through the read step in chunks, like a known memory trick. Their build read more than half a million words in training. It beat past sum models with no extra parts added.

Catalog record

CREATORRohit Saxena Hao Tang Frank Keller, [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01805

Browse the full library · About the Tower of Babel