TruthFlow: Truthful LLM Generation via Representation Flow Correction

Hanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen · 2025

Read TruthFlow: Truthful LLM Generation via Representation Flow Correction by Hanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04556.txt.

Description

Hanyu Wang and co-authors present a method that steers language models toward truthful answers in a 2025 paper. Models often state falsehoods with confidence, a flaw called hallucination. Past fixes nudge every input with the same correction vector, which fits diverse questions poorly.

Their method, TruthFlow, learns a flow that builds a custom correction for each query. The correction moves the model's inner state from a hallucination-prone setting toward a truthful one. At answer time, the trained flow supplies that tailored nudge. On a standard truthfulness benchmark, output quality rose across several advanced models. A flow trained once also transferred well to unseen hallucination tests, which suggests the fix captures a general trait.

Catalog record

CREATORHanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04556

Browse the full library · About the Tower of Babel