Beyond Precision: Importance-Aware Recall for Factuality Evaluation in Long-Form LLM Generation

Nazanin Jafari, James Allan, Mohit Iyyer · 2026

Read Beyond Precision: Importance-Aware Recall for Factuality Evaluation in Long-Form LLM Generation by Nazanin Jafari, James Allan, Mohit Iyyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03141.txt.

Description

Jafari, Allan, and Iyyer argue that checking long-form model answers for truth misses half the job when only precision is scored. Their framework also measures recall against reference facts built from outside sources, weighting each fact by relevance and salience. They find current models score far better on precision than recall, covering top facts well while leaving much relevant material out.

Catalog record

CREATORNazanin Jafari, James Allan, Mohit Iyyer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32249
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03141

Browse the full library · About the Tower of Babel