When Should LLMs Be Less Specific? Selective Abstraction for Reliable Long-Form Text Generation

Shani Goren, Ido Galil, Ran El-Yaniv, Technion · 2026

Read When Should LLMs Be Less Specific? Selective Abstraction for Reliable Long-Form Text Generation by Shani Goren, Ido Galil, Ran El-Yaniv, Technion (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11908.txt.

Description

Language models remain prone to factual errors that erode trust and limit adoption in high-risk settings. Holding back when trust is low helps, but binary all-or-nothing abstention discards valuable long-form information. Shani Goren and two co-authors introduce Selective Abstraction, a method that lets models trade detail for reliability by trimming uncertain content. Responses are split into atomic claims, each stating a single fact, and uncertain atoms are replaced with vaguer versions.

The method is defined by choosy risk and breadth, and tested with a pipeline that treats risk as factual correctness and measures breadth by retained information. Across six open-source models on two fact-check benchmarks, atom-wise SA beats existing baselines in test after test, improving the risk-breadth curve area by about 28 percent over claim removal. Reducing detail, the work shows, can boost accuracy and reliability while preserving most of the meaning.

Catalog record

CREATORShani Goren, Ido Galil, Ran El-Yaniv, Technion
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11908

Browse the full library · About the Tower of Babel