End-to-End Long Document Summarization using Gradient Caching
Rohit Saxena Hao Tang Frank Keller, [email protected], [email protected] · 2025
Read End-to-End Long Document Summarization using Gradient Caching by Rohit Saxena Hao Tang Frank Keller, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01805.txt.
Description
Long texts, such as full reports or books, strain the memory of the models that sum them up, since cost grows with the square of length. Rohit Saxena, Hao Tang, and Frank Keller fix that strain in a 2025 study with a cache trick. Their method trains a sum model on the whole text, with no cuts.
The text is read in panes that do not lap, and the parts join at the write step. On the way back, slope notes are cached and fed through the read step in chunks, like a known memory trick. Their build read more than half a million words in training. It beat past sum models with no extra parts added.
Catalog record
| CREATOR | Rohit Saxena Hao Tang Frank Keller, [email protected], [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01805